Understanding Gender and Racial Bias in AI, Part 3 :: UXmatters

Fake It Till You Make It

The good news is that there is some good news. A 2004 metastudy by Dr. Nilanjana Dasgupta [1] showed, “People’s awareness of potential bias, their motivation, and opportunity to control it, are a few of the factors that influence whether attitudes translate into action.” Dasgupta says, “Implicit prejudice and stereotypes are malleable and … they do not always produce discriminatory action.” In her article, she describes how people’s unwillingness to have others perceive them as prejudiced and their desire to avoid conflict resulted in better, less-explicitly biased behavior toward minority and other disadvantaged groups—including the overweight, elderly, and LGBTQ communities. Even if you are not a fully woke, hyper-politically correct, committed antiracist, you can turn your attitudes into actions. In other words, fake it till you make it.

Here are some concrete tips for actively combating your own implicit or unconscious bias.

Recruit Outside Your Usual Base

I’ve discussed recruiting outside your usual base in Part 1 and Part 2 of this series, but it’s worth mentioning again. As UX researchers and designers, we must force ourselves and our product teams outside of our usual, mostly white participant pools. We must listen to every group we are claiming to represent and every group whose needs we are attempting to meet. If that means driving to a community center in a historically black neighborhood and navigating slippery sidewalks while heavily pregnant on a bitter New England afternoon, just do it. We need to hear these voices. This is not an act of bravery. It’s a job requirement. (Pregnancy and hostile New England weather are optional.)

Record and Transcribe Your Research Sessions

Once you’ve recorded and transcribed your focus groups, interviews, field studies, and usability studies, let your findings sit for a spell. Work on something else for just long enough to forget who said what. Ideally, you should anonymize transcripts by removing participants’ names from these conversations. You want to separate the responses from the individual participants—and separate the words from the faces and voices of your participants. You’ll be able to be more inclusive and be less likely to report results that reflect your implicit biases.

If you don’t have time to let your transcripts simmer, ask teammates or colleagues who did not observe your research sessions to score your transcripts and analyze your findings. An unbiased set of eyes and ears can make a big difference to your research. Teammates who did not personally interact with participants won’t bring their preconceived notions or biases to the analysis process. Doing this requires some trust and a lot of collaboration—both of which would likely improve the accuracy and validity of your research report.

Run Your Transcripts Through a Natural Language Processor

If you have a savvy developer sitting near you, ask her to run your transcripts through a natural language processor (NLP). She can score your results using text-sentiment analysis tools from Microsoft or Google. Despite all my warnings about bias in machine learning and the underlying data, I mostly trust the natural text-sentiment APIs. These AI-driven tools eliminate human bias. They score words and phrases—or sentences and paragraphs, depending on what you give them—on a scale from -1, most negative, to +1, most positive. The underlying data, in this case, is the dictionary. Yes, I know the dictionary isn’t perfect either, but this is a known problem, and it is being addressed. No tool is perfect, but an NLP sentiment analysis of your transcripts quickly tells you whether your research participants feel good or bad about your product or service. Treat these scores as a supplement to, not a replacement for human evaluation of your findings. As a bonus, when you harness this technology in innovating your UX process, your workmates may finally recognize you as the nerd you truly are.

Keep an Open Mind

Even if you’re flying solo on these endeavors, be sure to listen to, capture, and address user needs and frustrations—regardless of whether you share them. Every idea, suggestion, complaint, and question is valid, even when you feel like your usability-test participants punched you in the gut and called your baby ugly. Turn their casual criticisms into next-generation business solutions. Don’t turn your nose up at problems for which you can’t imagine a solution. Sometimes seemingly unsolvable problems produce the most innovative solutions. Anyway, that’s what brainstorming sessions are for. Try to avoid prescreening your results by imagining all the things your boss or teammates might discount, disregard, or just plain discard. Of course, your colleagues might surprise you. Every once in a blue moon, your development lead might say something is easy to implement. Even if he’s never done that before, there’s a first time for everything. Don’t anticipate rejection. Just play back what you heard in its entirety.

Bring Back the Demographic Data

Once you’ve scored the unidentified voices in your transcripts, go back to see who said what. Add demographic data such as age, race, and gender to your research report. One of two things might happen: Either you’ll discover that your white users and nonwhite users share the same goals and needs, or you’ll discover unique opportunities among your nonwhite customers. In the first case, you truly are designing for everyone. In the second case, you have an opportunity to identify niche jobs to be done among minority consumer groups. This can simultaneously expand your professional design challenges and your organization’s sales in previously untapped markets. Talk about a win-win.

In Conclusion

Help all users to find their joy. This is what User Experience should be about. As Don Norman and Jakob Nielsen put it, “The first requirement for an exemplary user experience is to meet the exact needs of the customer, without fuss or bother. Next comes simplicity and elegance that produce products that are a joy to own, a joy to use.” We all know that a joyful user experience is better for business. It feels good, and it’s good for everyone. Frankly, we could all use a little more joy as we say goodbye to this dumpster fire of a year.

Stay tuned for Part 4, the final part of this series in February 2021. Happy new year! 


[1] Dasgupta, Nilanjana. “Implicit Ingroup Favoritism, Outgroup Favoritism, and Their Behavioral Manifestations.” Social Justice Research, Vol. 17, No. 2, May 2004.

Source link