Seven Months Later, Gallup Explains How It Botched 2012 So Badly   

Reporting on Politics and Policy.
June 4 2013 3:24 PM

Seven Months Later, Gallup Explains How It Botched 2012 So Badly   

David Axelrod enjoys being right.

Photo by Mandel Ngan/AFP/Getty Images

It became a running joke near the end of last year’s presidential campaign that every day at 1 p.m. EST, Gallup would unveil its latest polling data showing Mitt Romney with an insurmountable lead over Barack Obama and Twitter would freak out.

The Gallup poll was a key data point for conservatives looking for signs that, contrary to Nate Silver’s vaunted predictions, Romney would win, but also for journalists looking for an exciting narrative in what was ultimately a fairly static race.


As calculated by Silver, Gallup tilted to Romney by an average of 7.2 points in the final three weeks of the election, making it the least reliable poll of 2012.

Today Gallup is out with its official post-mortem of how it got things so wrong. It found that four areas most likely combined to result in the disparity between the polling firm’s final prediction of a 49-48 Romney popular vote win, and the actual result of a 51-47 Obama victory.

Those four areas were as follows: how they weighted likely voters, underrepresentation of the East and West coasts in geographical controls, underrepresentation of nonwhite voters based on how Gallup determined ethnic backgrounds of survey respondents, and issues in how it contacted landlines that resulted in an “older and more Republican” survey sample.

In responding to a description of the Gallup survey by reporter Joshua Green, Obama’s former chief campaign strategist David Axelrod commented on Twitter that “[a]ll of these were issues that were raised during the campaign, but met with stubborn resistance from the Gallup organization.”

He’s not wrong.     

The Obama campaign sent out this memo on Oct. 15, 2012, calling a Gallup survey showing the campaign trailing by 5 points an “extreme outlier” and questioning the firm’s likely voter methodology. Silver also pointed to Gallup’s likely voter model as being potentially flawed in a lengthy post on “endemic issue[s] with their methodology.”

Gallup’s weighting of Southern states was questioned by liberal blogger Markos Moulitsas and discussed in this blog space at around the same time.

And way back in June of last year, the Huffington Post's Mark Blumenthal noted Gallup’s anti-Obama bias and postulated that it had something to do with how they measured the racial composition of the electorate.

At the time of the fiercest criticism, Gallup editor-in-chief Frank Newport said that there was “no evidence” that his company’s likely voter models were off. Now he’s saying they’ll do better next time.

Jeremy Stahl is a Slate senior editor. You can follow him on Twitter.



The World

The Budget Disaster that Sabotaged the WHO’s Response to Ebola

How Movies Like Contagion and Outbreak Distort Our Response to Real Epidemics

PowerPoint Is the Worst, and Now It’s the Latest Way to Hack Into Your Computer

The Shooting Tragedies That Forged Canada’s Gun Politics

A Highly Unscientific Ranking of Crazy-Old German Beers


Welcome to 13th Grade!

Some high schools are offering a fifth year. That’s a great idea.


The Actual World

“Mount Thoreau” and the naming of things in the wilderness.

Want Kids to Delay Sex? Let Planned Parenthood Teach Them Sex Ed.

Would You Trust Walmart to Provide Your Health Care? (You Should.)

  News & Politics
Oct. 22 2014 9:42 PM Landslide Landrieu Can the Louisiana Democrat use the powers of incumbency to save herself one more time?
Continuously Operating
Oct. 22 2014 2:38 PM Crack Open an Old One A highly unscientific evaluation of Germany’s oldest breweries.
Lexicon Valley
Oct. 23 2014 10:30 AM Which Came First, the Word Chicken or the Word Egg?
  Double X
The XX Factor
Oct. 23 2014 8:51 AM The Male-Dominated Culture of Business in Tech Is Not Great for Women
  Slate Plus
Tv Club
Oct. 22 2014 5:27 PM The Slate Walking Dead Podcast A spoiler-filled discussion of Episodes 1 and 2.
Brow Beat
Oct. 23 2014 9:00 AM Exclusive Premiere: Key & Peele Imagines the Dark Side of the Make-A-Wish Program
Future Tense
Oct. 22 2014 5:33 PM One More Reason Not to Use PowerPoint: It’s The Gateway for a Serious Windows Vulnerability
  Health & Science
Bad Astronomy
Oct. 23 2014 7:30 AM Our Solar System and Galaxy … Seen by an Astronaut
Sports Nut
Oct. 20 2014 5:09 PM Keepaway, on Three. Ready—Break! On his record-breaking touchdown pass, Peyton Manning couldn’t even leave the celebration to chance.