Why we should start measuring bias.

The state of the universe.
Jan. 26 2006 4:10 PM

Screen Test

Why we should start measuring bias.

Illustration by Robert Neubecker. Click image to expand.

"Everyone's a little bit racist sometimes," proclaims the Broadway musical Avenue Q. "Doesn't mean we go/ Around committing hate crimes/ Look around and you will find/ No one's really colorblind/ Maybe it's a fact/ We all should face/ Everyone makes judgments/ Based on race."

How do you test internal bias? You can try asking people, but since most of us don't like to think of ourselves as biased, we won't necessarily admit to it on a questionnaire, even anonymously. But there's a test to detect the kind of bias people won't admit to and may not even be aware of themselves—a test that works. The psychologists who devised it, however, are squeamish about real-world uses of it. They shouldn't be. Though it shouldn't be used as the basis for hiring decisions, the test has its place.


In 2003, Mahzarin Banaji, Anthony G. Greenwald, and Brian Nosek published a paper detailing an experimental methodology they had developed called the Implicit Association Test, or IAT. Rather than asking subjects what they thought about different races (or what they thought they thought), Banaji and her colleagues decided to time them as they paired words and images.

In the test's most popular version, the Race IAT, subjects are shown a computer screen and asked to match positive words (love, wonderful, peace) or negative words (evil, horrible, failure) with faces of African-Americans or whites. Their responses are timed. If you tend to associate African-Americans with "bad" concepts, it will take you longer to group black faces with "good" concepts because you perceive them as incompatible. If you're consistently quicker at connecting positive words with whites and slower at connecting positive words with blacks—or quicker at connecting negative words with blacks and slower at connecting negative words with whites—you have an implicit bias for white faces over those of African-Americans. In other words, the time it takes you to pair the faces and words yields an empirical measure of your attitudes. (Click here for a more detailed description of the test.)

The elegance of Banaji's test is that it doesn't let you lie. What's being measured is merely the speed of each response. You might hate the idea of having a bias against African-Americans, but if it takes you significantly longer to group black faces with good concepts, there's no way you can hide it. You can't pretend to connect words and images faster any more than a sprinter can pretend to run faster. And you won't significantly change your score if you deliberately try to slow down your white = good and black = bad pairings.

Banaji, now a social psychologist at Harvard, has found that 88 percent of the white subjects who take her test show some bias against blacks. The majority of all subjects also test anti-gay, anti-elderly, and anti-Arab Muslim. Many people also exhibit bias against their own group: About half of blacks test anti-black; 36 percent of Arab Muslims test anti-Arab Muslim; and 38 percent of gays show an automatic preference for heterosexuals. (You can take the test yourself here; the results can be deeply humbling.)

The IAT, then, is an objective measure of bias. And research has shown that the test is powerfully predictive of behavior—as Banaji notes in refuting critics' claims that the test measures not individual bias but awareness of bias within society. People with high racial bias scores are more likely to choose a white partner to work with and more willing to cut funding for minority student groups. They're also more likely to judge minority suspects guilty in ambiguous situations and assign longer prison sentences to suspects with minority names.

Yet the test's creators are extremely wary about unleashing the powerful tool they've created. Banaji has threatened to testify in court against efforts to use her test in real-world situations. Using the test to ferret out biased people, she argues, assumes that people who have high implicit bias scores will always behave in a biased way—which is not the case, since the tests don't predict behavior with 100 percent accuracy. Banaji also points out that some highly motivated subjects may be able to beat the test by focusing on "counter-stereotypes," for instance, by thinking about black heroes like Dr. Martin Luther King Jr. and Nelson Mandela just before taking the test.

Banaji is right: The test isn't a perfect predictor, and it may be possible to beat it. Those are good reasons to limit the test's uses. But they don't justify never using it at all.

Consider juries. Since studies show that people with high bias scores judge minorities guiltier than whites, people who test as highly biased against minorities shouldn't serve on juries in cases involving minority defendants. It's standard for judges to strike prospective jurors who exhibit clear prejudice against a defendant; at the federal corruption trial of former Atlanta Mayor Bill Campbell, one prospective juror was recently dismissed for writing in the questionnaire that he thought Campbell, who is African-American, should be "hung from the highest tree." Other jurors, however, don't volunteer their bias on questionnaires. Banaji's test would tell us who they are. Sure, not everyone who tests high for bias will actually judge the case before them in a biased way. But given the high stakes for the defendant—and the relatively low ones for a prospective juror—isn't it better to err on the side of keeping biased people out of the jury box?



More Than Scottish Pride

Scotland’s referendum isn’t about nationalism. It’s about a system that failed, and a new generation looking to take a chance on itself. 

What Charles Barkley Gets Wrong About Corporal Punishment and Black Culture

Why Greenland’s “Dark Snow” Should Worry You

Three Talented Actresses in Three Terrible New Shows

Why Do Some People See the Virgin Mary in Grilled Cheese?

The science that explains the human need to find meaning in coincidences.


Happy Constitution Day!

Too bad it’s almost certainly unconstitutional.

Is It Worth Paying Full Price for the iPhone 6 to Keep Your Unlimited Data Plan? We Crunch the Numbers.

What to Do if You Literally Get a Bug in Your Ear

  News & Politics
Sept. 17 2014 8:15 AM Ted Cruz Will Not Join a Protest of "The Death of Klinghoffer" After All
Sept. 16 2014 4:16 PM The iPhone 6 Marks a Fresh Chance for Wireless Carriers to Kill Your Unlimited Data
The Eye
Sept. 16 2014 12:20 PM These Outdoor Cat Shelters Have More Style Than the Average Home
  Double X
The XX Factor
Sept. 15 2014 3:31 PM My Year As an Abortion Doula
  Slate Plus
Slate Plus Video
Sept. 16 2014 2:06 PM A Farewell From Emily Bazelon The former senior editor talks about her very first Slate pitch and says goodbye to the magazine.
Brow Beat
Sept. 17 2014 9:03 AM My Father Was James Brown. I Watched Him Beat My Mother. And Then I Found Myself With Someone Like Dad.
Future Tense
Sept. 17 2014 8:27 AM Only Science Fiction Can Save Us! What sci-fi gets wrong about income inequality.
  Health & Science
Bad Astronomy
Sept. 17 2014 7:30 AM Ring Around the Rainbow
Sports Nut
Sept. 15 2014 9:05 PM Giving Up on Goodell How the NFL lost the trust of its most loyal reporters.