The perils of analyzing test scores by race.

Science, technology, and life.
April 30 2009 10:21 AM

True, False, or Neither?

The perils of analyzing test scores by race.

Person taking a multiple choice test.
Analyzing test scores by race is risky

" 'No Child' Law Is Not Closing a Racial Gap." That's the New York Times headline about a report issued this week on school test scores. The Times story begins:

William Saletan William Saletan

Will Saletan writes about politics, science, technology, and other stuff for Slate. He’s the author of Bearing Right.

The achievement gap between white and minority students has not narrowed in recent years, despite the focus of the No Child Left Behind law on improving the scores of blacks and Hispanics, according to results of a federal test considered to be the nation's best measure of long-term trends in math and reading proficiency. Between 2004 and last year, scores for young minority students increased, but so did those of white students, leaving the achievement gap stubbornly wide, despite President George W. Bush's frequent assertions that the No Child law was having a dramatic effect. Although Black and Hispanic elementary, middle and high school students all scored much higher on the federal test than they did three decades ago, most of those gains were not made in recent years, but during the desegregation efforts of the 1970s and 1980s.

The Times implies that the racial angle is important because it shows the No Child law failed. But the same angle is being touted by exponents of hereditary differences in intelligence. In fact, they're quoting the Times story to validate their point. "NYT: NAEP Racial Gaps Haven't Magically Disappeared," says the headline at Steve Sailer's blog, which serves as a headquarters for believers in "human biodiversity." "Study after study, yet no one wants to introduce ol' reliable Occam," observes one commenter. Another cites a well-known paper on race, heredity, and IQ, asking: "Why don't they read this—it explains a lot."

The Washington Post, in its article about the test-scores report, doesn't focus on race. " 'Nation's Report Card' Sees Gains in Elementary, Middle Schools," says the Post headline. The article begins:

Math and reading scores for 9- and 13-year-olds have risen since the 2002 enactment of No Child Left Behind, providing fuel to those who want to renew the federal law and strengthen its reach in high schools. Performance on the National Assessment of Educational Progress, which offers a long view of U.S. student achievement, shows several bright spots. Nine-year-olds posted the highest scores ever in reading and math in 2008. Black and Hispanic students of that age also reached record reading scores, though they continued to trail white peers. But results released yesterday were disappointing for high school students. Seventeen-year-olds gained some ground in reading since 2004, but their average performance in math and reading has not budged since the early 1970s.

You can find the same information about the racial gap in this summary. But it isn't the focus. It's just one detail among many.

Advertisement

Why categorize and measure students by race? Aren't there better ways to organize the data? "Lower-performing 9- and 13-year-olds make gains," says one section of the NAEP report [PDF]."No significant change for 17-year-olds at any performance level," says another. "Reading scores improve for 9-year-old public and private school students over long term," says a third. "Score increases for 17-year-olds whose parents did not finish high school," says a fourth. These tables organize the data by factors that can help us target and adjust educational policy: kids with low scores, kids in public school, kids in high school, kids whose parents didn't graduate. I'd like to see tables for income  and spending per pupil, too. But race? Does that category really help? And what message does it send to kids when headlines assert a persistent "racial gap"?

On this question, I'm in no position to throw stones. I've come to my cautionary view the hard way. Liberal creationists—people who think no genetically based difference can be admitted in average ability between populations—are mistaken. But that doesn't make race a useful or socially healthy way of categorizing people.

Beware looking and settling for racial analysis when some other combination of categorieseconomics, culture, genetics—more accurately fits the data. As the NAEP coverage illustrates, that's a warning worth heeding on the left as well as the right.

(Now playing at the Human Nature blog: 1. The mainstreaming of marijuana. 2) Emergency contraception and personal responsibility. 3. Outing executioners.)

TODAY IN SLATE

War Stories

The Right Target

Why Obama’s airstrikes against ISIS may be more effective than people expect.

The One National Holiday Republicans Hope You Forget

It’s Legal for Obama to Bomb Syria Because He Says It Is

I Stand With Emma Watson on Women’s Rights

Even though I know I’m going to get flak for it.

Should You Recline Your Seat? Two Economists Weigh In.

Doublex

It Is Very, Very Stupid to Compare Hope Solo to Ray Rice

Or, why it is very, very stupid to compare Hope Solo to Ray Rice.

Building a Better Workplace

In Defense of HR

Startups and small businesses shouldn’t skip over a human resources department.

Why Is This Mother in Prison for Helping Her Daughter Get an Abortion?

The Only Good Thing That Happened at Today’s Soul-Crushing U.N. Climate Talks

  News & Politics
Foreigners
Sept. 23 2014 6:40 PM Coalition of the Presentable Don’t believe the official version. Meet America’s real allies in the fight against ISIS.
  Business
Moneybox
Sept. 23 2014 2:08 PM Home Depot’s Former Lead Security Engineer Had a Legacy of Sabotage
  Life
Outward
Sept. 23 2014 1:57 PM Would a Second Sarkozy Presidency End Marriage Equality in France?
  Double X
The XX Factor
Sept. 23 2014 2:32 PM Politico Asks: Why Is Gabby Giffords So “Ruthless” on Gun Control?
  Slate Plus
Political Gabfest
Sept. 23 2014 3:04 PM Chicago Gabfest How to get your tickets before anyone else.
  Arts
Brow Beat
Sept. 23 2014 4:45 PM Why Is Autumn the Only Season With Two Names?
  Technology
Future Tense
Sept. 23 2014 5:36 PM This Climate Change Poem Moved World Leaders to Tears Today
  Health & Science
Science
Sept. 23 2014 4:33 PM Who Deserves Those 4 Inches of Airplane Seat Space? An investigation into the economics of reclining.
  Sports
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.