How many Iraqi civilians have died as a result of the war?

Military analysis.
Oct. 29 2004 6:49 PM

100,000 Dead—or 8,000

How many Iraqi civilians have died as a result of the war?

The authors of a peer-reviewed study, conducted by a survey team from Johns Hopkins University, claim that about 100,000 Iraqi civilians have died as a result of the war. Yet a close look at the actual study, published online today by the British medical journal the Lancet, reveals that this number is so loose as to be meaningless.

The report's authors derive this figure by estimating how many Iraqis died in a 14-month period before the U.S. invasion, conducting surveys on how many died in a similar period after the invasion began (more on those surveys later), and subtracting the difference. That difference—the number of "extra" deaths in the post-invasion period—signifies the war's toll. That number is 98,000. But read the passage that cites the calculation more fully:

We estimate there were 98,000 extra deaths (95% CI 8000-194 000) during the post-war period.

Readers who are accustomed to perusing statistical documents know what the set of numbers in the parentheses means. For the other 99.9 percent of you, I'll spell it out in plain English—which, disturbingly, the study never does. It means that the authors are 95 percent confident that the war-caused deaths totaled some number between 8,000 and 194,000. (The number cited in plain language—98,000—is roughly at the halfway point in this absurdly vast range.)

Advertisement

This isn't an estimate. It's a dart board.

Imagine reading a poll reporting that George W. Bush will win somewhere between 4 percent and 96 percent of the votes in this Tuesday's election. You would say that this is a useless poll and that something must have gone terribly wrong with the sampling. The same is true of the Lancet article: It's a useless study; something went terribly wrong with the sampling.

The problem is, ultimately, not with the scholars who conducted the study; they did the best they could under the circumstances. The problem is the circumstances. It's hard to conduct reliable, random surveys—and to extrapolate meaningful data from the results of those surveys—in the chaotic, restrictive environment of war.

However, these scholars are responsible for the hype surrounding the study. Gilbert Burnham, one of the co-authors, told the International Herald Tribune (for a story reprinted in today's New York Times), "We're quite sure that the estimate of 100,000 is a conservative estimate." Yet the text of the study reveals this is simply untrue. Burnham should have said, "We're not quite sure what our estimate means. Assuming our model is accurate, the actual death toll might be 100,000, or it might be somewhere between 92,000 lower and 94,000 higher than that number."

Not a meaty headline, but truer to the findings of his own study.

Here's how the Johns Hopkins team—which, for the record, was led by Dr. Les Roberts of the university's Bloomberg School of Public Health—went about its work. They randomly selected 33 neighborhoods across Iraq—equal-sized population "clusters"—and, this past September, set out to interview 30 households in each. They asked how many people in each household died, of what causes, during the 14 months before the U.S. invasion—and how many died, of what, in the 17 months since the war began. They then took the results of their random sample and extrapolated them to the entire country, assuming that their 33 clusters were perfectly representative of all Iraq.

TODAY IN SLATE

Politics

Don’t Worry, Obama Isn’t Sending U.S. Troops to Fight ISIS

But the next president might. 

The Extraordinary Amicus Brief That Attempts to Explain the Wu-Tang Clan to the Supreme Court Justices

Amazon Is Officially a Gadget Company. Here Are Its Six New Devices.

The Human Need to Find Connections in Everything

It’s the source of creativity and delusions. It can harm us more than it helps us.

How Much Should You Loathe NFL Commissioner Roger Goodell?

Here are the facts.

Altered State

The Plight of the Pre-Legalization Marijuana Offender

What should happen to weed users and dealers busted before the stuff was legal?

Surprise! The Women Hired to Fix the NFL Think the NFL Is Just Great.

You Shouldn’t Spank Anyone but Your Consensual Sex Partner

Moneybox
Sept. 17 2014 5:10 PM The Most Awkward Scenario in Which a Man Can Hold a Door for a Woman
  News & Politics
Weigel
Sept. 18 2014 8:58 AM Does this Colorado Poll Show Latino Voters Bailing on the 2014 Election?
  Business
Business Insider
Sept. 17 2014 1:36 PM Nate Silver Versus Princeton Professor: Who Has the Right Models?
  Life
The Vault
Sept. 18 2014 9:57 AM “The Sun Never Sets Upon the British Empire,” Explained in GIF by an Old Children’s Toy
  Double X
The XX Factor
Sept. 17 2014 6:14 PM Today in Gender Gaps: Biking
  Slate Plus
Slate Fare
Sept. 17 2014 9:37 AM Is Slate Too Liberal?  A members-only open thread.
  Arts
Television
Sept. 18 2014 8:53 AM The Other Huxtable Effect Thirty years ago, The Cosby Show gave us one of TV’s great feminists.
  Technology
Future Tense
Sept. 18 2014 10:07 AM “The Day It All Ended” A short story from Hieroglyph, a new science fiction anthology.
  Health & Science
Bad Astronomy
Sept. 18 2014 7:30 AM Red and Green Ghosts Haunt the Stormy Night
  Sports
Sports Nut
Sept. 17 2014 3:51 PM NFL Jerk Watch: Roger Goodell How much should you loathe the pro football commissioner?