How accurate is pre-election polling in Afghanistan?

Answers to your questions about the news.
Aug. 17 2009 6:12 PM

How Accurate Is Pre-Election Polling in Afghanistan?

More accurate than it was the last time around.

Burqa-clad female supporters of Afghan President Hamid Karzai arrive at an election gathering in Kandahar. Click image to expand.
Supporters of Hamid Karzai arrive at an election gathering

Afghanistan is gearing up for elections this Thursday. Recent polls suggest that Hamid Karzai will garner the most votes but fall short of a majority, necessitating a runoff election. How accurate are polls in Afghanistan?

They're better than they were before the country's 2004 election but not nearly as good as Western polls. During the last presidential election, Hamid Karzai won with 55 percent of the vote. One prominent poll had predicted that Karzai would win 78 percent of the vote. Exit polls from the same organization, the International Republican Institute, a nonpartisan group established by Congress to support fledgling democracies, came much closer, missing the margin of victory by fewer than nine points. The failures of 2004 have led Afghan pollsters to improve their sampling techniques, and most analysts expect better results this time around.

Advertisement

Many polls out of Afghanistan report margins of error similar to, or smaller than, the typical U.S. opinion poll. But these numbers don't account for the possibility that the survey sample was not truly random. Since virtually all American households have a telephone, U.S. pollsters use machines that dial random numbers, giving each home roughly the same chance of being surveyed. This method would severely undercount rural and poor voters in Afghanistan, many of whom don't own phones. There, face-to-face interviews are the only option, but these are expensive and sometimes dangerous—interviewers have been killed.

Pollsters in Afghanistan rely on multistage stratification to generate representative samples. They select a certain number of districts at random from within each province, then select a cluster of villages at random from within each district. Finally, a certain number of households are chosen at random from within that cluster. (Some pollsters use population data to increase the probability that a more populous cluster or village will be selected.) To be even more careful, they use a statistical technique to select a random member from each household who is then interviewed by someone of the same sex to encourage participation. Experienced pollsters often ask the same question several different ways to make sure the interviewee understands and is answering honestly.

In theory, this process should generate a representative group. But it's not that simple in Afghanistan. Some areas are off-limits due to security concerns. Other regions are so remote that an interviewer can't get there and back during the time frame of the poll. These areas have to be replaced with regions that have similar ethnic compositions and population densities.

When all the data have been collected, the pollster checks the demographics of the survey population against those of the general population. If a survey population is only 40 percent female, for example, the pollster would give extra weight to the female respondents. Many pollsters in Afghanistan try to weight their data for gender and ethnic group. The problem is that Afghanistan hasn't completed a census in 30 years, so no one really understands the demographics of the country. Pollsters are left trying to piece together fragmentary data from unreliable sources. Many refuse to weight their data at all. Others simply qualify their reports with a warning about potential bias, which may or may not make it into media coverage. Some organizations compare their poll results with other data-collection methods, such as focus groups, as a reality check.

Got a question about today's news? Ask the Explainer.

Explainer thanks Craig Charney of Charney Research, Andrew Garfield of Glevum Associates, Scott Keeter of the Pew Research Center, and David Williams of Williams and Associates.

TODAY IN SLATE

War Stories

The Right Target

Why Obama’s airstrikes against ISIS may be more effective than people expect.

The One National Holiday Republicans Hope You Forget

It’s Legal for Obama to Bomb Syria Because He Says It Is

I Stand With Emma Watson on Women’s Rights

Even though I know I’m going to get flak for it.

Should You Recline Your Seat? Two Economists Weigh In.

Doublex

It Is Very, Very Stupid to Compare Hope Solo to Ray Rice

Or, why it is very, very stupid to compare Hope Solo to Ray Rice.

Building a Better Workplace

In Defense of HR

Startups and small businesses shouldn’t skip over a human resources department.

Why Is This Mother in Prison for Helping Her Daughter Get an Abortion?

Politico Wonders Why Gabby Giffords Is So “Ruthless” on Gun Control

Behold
Sept. 23 2014 4:45 PM An Up-Close Look at the U.S.–Mexico Border
  News & Politics
Foreigners
Sept. 23 2014 6:40 PM Coalition of the Presentable Don’t believe the official version. Meet America’s real allies in the fight against ISIS.
  Business
Moneybox
Sept. 23 2014 2:08 PM Home Depot’s Former Lead Security Engineer Had a Legacy of Sabotage
  Life
Outward
Sept. 23 2014 1:57 PM Would a Second Sarkozy Presidency End Marriage Equality in France?
  Double X
The XX Factor
Sept. 23 2014 2:32 PM Politico Asks: Why Is Gabby Giffords So “Ruthless” on Gun Control?
  Slate Plus
Political Gabfest
Sept. 23 2014 3:04 PM Chicago Gabfest How to get your tickets before anyone else.
  Arts
Brow Beat
Sept. 23 2014 8:38 PM “No One in This World” Is One of Kutiman’s Best, Most Impressive Songs
  Technology
Future Tense
Sept. 23 2014 5:36 PM This Climate Change Poem Moved World Leaders to Tears Today
  Health & Science
Science
Sept. 23 2014 4:33 PM Who Deserves Those 4 Inches of Airplane Seat Space? An investigation into the economics of reclining.
  Sports
Sports Nut
Sept. 23 2014 7:27 PM You’re Fired, Roger Goodell If the commissioner gets the ax, the NFL would still need a better justice system. What would that look like?