Should We Trust That Study Saying Half a Million Iraqis Died in the War?

How It Works
Oct. 18 2013 1:39 PM

Half a Million Deaths is a Statistic

93113849
An injured Iraqi woman flees the site of two car bombs that exploded in quick succession near two Baghdad churches 01 August 2004, causing many casualties.

Photo by SAEED KHAN/AFP/Getty Images

The politically charged question of how many Iraqis were killed as a result of the war that began in 2003 has been a tough one to pin down. Former U.S. CentCom Commander Gen. Tommy Franks famously claimed that “we don’t do body counts,” though U.S. military documents released by Wikileaks in 2010 contained records of more than 100,000 people killed in Iraq following the 2003 invasion. The independent group Iraq Body Count has documented between 114,973 and 126,121 civilian deaths since 2003. But not all deaths are recorded, and what about those killed not by direct violence but by other factors caused by the war? Efforts to measure these casualties have proven more controversial.

Joshua Keating Joshua Keating

Joshua Keating is a staff writer at Slate focusing on international affairs and writes the World blog. 

The latest effort to measure the death toll is a paper published recently by a large team of researchers in the peer-reviewed online journal PLOS Medicine. Media reports have described the paper as finding that half a million deaths were caused by the war. Of the 405,000 estimated deaths, 60 percent (240,000) were caused by violence. The rest were “associated with the collapse of infrastructure and other indirect, but war-related, causes.” Living in the middle of a warzone isn’t all that good for your health.

Advertisement

The new article builds on a controversial 2006 study published in the Lancet which estimated that 655,000 Iraqis had been killed as a result of the war at that time. While it garnered quite a bit of attention at the time, critics, including Slate’s Fred Kaplan, criticized its methodology.

So is the new study any better? Before looking into that, it’s important to understand how studies like this work. The researchers aren’t actually counting deaths; they survey randomly selected households throughout the country—2,000 of them for the new study—and ask them about their births and deaths since 2001, two years before the invasion. From these surveys, the researchers estimate the overall mortality rate in the country before and after the invasion and use it to calculate how many excess deaths were caused by the war.

One of the criticisms of the Lancet study was that its sample size was too small and not geographically representative—it was still highly dangerous to conduct field research in many parts of Iraq in 2006. Today, researchers have access to more parts of the country, and the new study covered twice as many areas.

The Lancet report was also criticized for surveying only homes on main commercial streets, which are more likely to be affected by fighting. The selection method in the new paper was more random. The researchers also got an impressive 98.55 percent response rate from the households surveyed.

These studies are highly affected by the baseline numbers used. The Lancet survey estimated an annual mortality rate of 5.5 per 1,000 people for the two years prior to the war and 13.3 per 1,000 in the years after. Some experts were suspicious of these numbers, noting that the U.N. Population Division put the pre-war death rate at 10 per 1,000.

In the new study, the numbers are quite different. The survey found a death rate of 2.89 per 1,000 in the two years before the war and 4.55 between 2003 and 2011.

I asked lead author Amy Hagopian of the University of Washington School of Public Health why the numbers were so much lower. In an e-mail to Slate, she replied, “We’re not sure why [there is a] difference between the pre-war crude death rates, but we looked at several possibilities.” These included the difference in sampling methods, the extensive migration from Iraq since the war, which could result in households that had experienced more violence leaving the country and lowering the estimates, and “recall bias.”

“As time goes on, respondents become less accurate in recalling details of the household demographics,” she wrote. 

Because of these factors and others, that actual estimate in the paper—as opposed to the eye-popping “half a million” figure that’s been reported, is a pretty wide range. The authors estimate with 95 percent certainty that the war caused between 48,000 and 751,000 excess deaths. Given that range, the numbers don’t seem that far off of the figures from the Iraq Body Count or Wikileaks.   

Ultimately, studies like these are interesting from a social science and public health perspective, but probably shouldn’t be given all that much political weight. “Only 100,000 deaths” is a morally absurd statement. And had we known in 2003 that in 2013, bombings killing 60 or more people in Iraq would still be a relatively common occurrence, I doubt the idea of invading would have been so popular. 

TODAY IN SLATE

War Stories

The Right Target

Why Obama’s airstrikes against ISIS may be more effective than people expect.

The One National Holiday Republicans Hope You Forget

It’s Legal for Obama to Bomb Syria Because He Says It Is

I Stand With Emma Watson on Women’s Rights

Even though I know I’m going to get flak for it.

Should You Recline Your Seat? Two Economists Weigh In.

Doublex

It Is Very, Very Stupid to Compare Hope Solo to Ray Rice

Or, why it is very, very stupid to compare Hope Solo to Ray Rice.

Building a Better Workplace

In Defense of HR

Startups and small businesses shouldn’t skip over a human resources department.

Why Is This Mother in Prison for Helping Her Daughter Get an Abortion?

Politico Wonders Why Gabby Giffords Is So “Ruthless” on Gun Control

Behold
Sept. 23 2014 4:45 PM An Up-Close Look at the U.S.–Mexico Border
  News & Politics
Foreigners
Sept. 23 2014 6:40 PM Coalition of the Presentable Don’t believe the official version. Meet America’s real allies in the fight against ISIS.
  Business
Moneybox
Sept. 23 2014 2:08 PM Home Depot’s Former Lead Security Engineer Had a Legacy of Sabotage
  Life
Outward
Sept. 23 2014 1:57 PM Would a Second Sarkozy Presidency End Marriage Equality in France?
  Double X
The XX Factor
Sept. 23 2014 2:32 PM Politico Asks: Why Is Gabby Giffords So “Ruthless” on Gun Control?
  Slate Plus
Political Gabfest
Sept. 23 2014 3:04 PM Chicago Gabfest How to get your tickets before anyone else.
  Arts
Brow Beat
Sept. 23 2014 8:38 PM “No One in This World” Is One of Kutiman’s Best, Most Impressive Songs
  Technology
Future Tense
Sept. 23 2014 5:36 PM This Climate Change Poem Moved World Leaders to Tears Today
  Health & Science
Science
Sept. 23 2014 4:33 PM Who Deserves Those 4 Inches of Airplane Seat Space? An investigation into the economics of reclining.
  Sports
Sports Nut
Sept. 23 2014 7:27 PM You’re Fired, Roger Goodell If the commissioner gets the ax, the NFL would still need a better justice system. What would that look like?