Seven Months Later, Gallup Explains How It Botched 2012 So Badly   

Reporting on Politics and Policy.
June 4 2013 3:24 PM

Seven Months Later, Gallup Explains How It Botched 2012 So Badly   

104594788
David Axelrod enjoys being right.

Photo by Mandel Ngan/AFP/Getty Images

It became a running joke near the end of last year’s presidential campaign that every day at 1 p.m. EST, Gallup would unveil its latest polling data showing Mitt Romney with an insurmountable lead over Barack Obama and Twitter would freak out.

The Gallup poll was a key data point for conservatives looking for signs that, contrary to Nate Silver’s vaunted predictions, Romney would win, but also for journalists looking for an exciting narrative in what was ultimately a fairly static race.

Advertisement

As calculated by Silver, Gallup tilted to Romney by an average of 7.2 points in the final three weeks of the election, making it the least reliable poll of 2012.

Today Gallup is out with its official post-mortem of how it got things so wrong. It found that four areas most likely combined to result in the disparity between the polling firm’s final prediction of a 49-48 Romney popular vote win, and the actual result of a 51-47 Obama victory.

Those four areas were as follows: how they weighted likely voters, underrepresentation of the East and West coasts in geographical controls, underrepresentation of nonwhite voters based on how Gallup determined ethnic backgrounds of survey respondents, and issues in how it contacted landlines that resulted in an “older and more Republican” survey sample.

In responding to a description of the Gallup survey by reporter Joshua Green, Obama’s former chief campaign strategist David Axelrod commented on Twitter that “[a]ll of these were issues that were raised during the campaign, but met with stubborn resistance from the Gallup organization.”

He’s not wrong.     

The Obama campaign sent out this memo on Oct. 15, 2012, calling a Gallup survey showing the campaign trailing by 5 points an “extreme outlier” and questioning the firm’s likely voter methodology. Silver also pointed to Gallup’s likely voter model as being potentially flawed in a lengthy post on “endemic issue[s] with their methodology.”

Gallup’s weighting of Southern states was questioned by liberal blogger Markos Moulitsas and discussed in this blog space at around the same time.

And way back in June of last year, the Huffington Post's Mark Blumenthal noted Gallup’s anti-Obama bias and postulated that it had something to do with how they measured the racial composition of the electorate.

At the time of the fiercest criticism, Gallup editor-in-chief Frank Newport said that there was “no evidence” that his company’s likely voter models were off. Now he’s saying they’ll do better next time.

Jeremy Stahl is a Slate senior editor. You can follow him on Twitter.

 

TODAY IN SLATE

Politics

Meet the New Bosses

How the Republicans would run the Senate.

The Government Is Giving Millions of Dollars in Electric-Car Subsidies to the Wrong Drivers

Scotland Is Just the Beginning. Expect More Political Earthquakes in Europe.

Photos of the Crowds That Took Over NYC for the People’s Climate March

Friends Was the Last Purely Pleasurable Sitcom

The Eye

This Whimsical Driverless Car Imagines Transportation in 2059

Medical Examiner

Did America Get Fat by Drinking Diet Soda?  

A high-profile study points the finger at artificial sweeteners.

I Wrote a Novel Envisioning a Nigerian Space Program. Then I Learned Nigeria Actually Has One.

A Futurama Writer on How the Vietnam War Shaped the Series

  News & Politics
Politics
Sept. 22 2014 11:13 AM Your Own Personal Rand Paul How the libertarian hero makes his foreign policy contradictions disappear.
  Business
Business Insider
Sept. 22 2014 9:39 AM Adrian Peterson Has a Terrible Contract, and Cutting Him Would Save the Vikings a Lot of Money
  Life
Atlas Obscura
Sept. 22 2014 11:15 AM Avenue of the Baobabs: Madagascar's Magical Upside-Down Trees
  Double X
The XX Factor
Sept. 19 2014 4:58 PM Steubenville Gets the Lifetime Treatment (And a Cheerleader Erupts Into Flames)
  Slate Plus
Science
Sept. 22 2014 8:08 AM Slate Voice: “Why Is So Much Honey Clover Honey?” Mike Vuolo shares the story of your honey.
  Arts
Television
Sept. 21 2014 9:00 PM Attractive People Being Funny While Doing Amusing and Sometimes Romantic Things Don’t dismiss it. Friends was a truly great show.
  Technology
Future Tense
Sept. 22 2014 11:23 AM Robot Plants Are the Latest in a Long Line of Robot Thingies
  Health & Science
Bad Astronomy
Sept. 22 2014 11:23 AM Two Impacts, One Landslide… on Mercury
  Sports
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.