With a month to go before the election, how do Slate readers' political predictions compare with the pros?

Test your powers of political forecasting.
Oct. 4 2010 8:54 PM

You vs. the Pundits

With a month to go before the election, how do Slate readers' political predictions compare with the pros?

About six weeks ago, Slate launched Lean/Lock, an interactive game that allows readers to test their skills as a political pundit. With one month to go until the election, we decided to take a quick look at how your predictions align with those of some more prominent forecasters.


In Lean/Lock, players can predict the winners in 36 Senate, House, and governors' races and make their picks provisional ("leaning" toward a candidate) or certain ("locking" on him or her). So far at least, Slate readers don't radically disagree with the professional pundits. But they have developed enough differences to make a meaningful comparison. If you throw out what the forecasters call "tossup" races, aggregate Lean/Lock picks diverged about 15 percent of the time from the predictions of four traditional forecasters—CQ Politics, Cook Political Report, Rothenberg Political Report and Larry Sabato's Crystal Ball. Lean/Lock players disagreed more strongly, however, with Nate Silver's simulations at Five Thirty Eight: Overall, players disagreed with 66 percent of Silver's predictions. Here's a look at a few races where the game has produced curious results.

Kentucky Senate
Slate readers say: Rand Paul (R) 57 percent, Jack Conway (D) 43 percent. Thirty-three percent of picks are locked.
Pundits say: Leans Republican (Sabato, CQ); tossup (Rothenberg, Cook).

The Lean/Lock database shows that Conway led Paul for most of August, initially by 20 points. But Paul, a libertarian by philosophy if not party,  began gaining in late August and now leads by 13 points. The situation on the ground in Kentucky appears to tell the same story: Voters initially found Paul too extreme to be a serious candidate but have warmed to him considerably as he has inched closer to the political mainstream. Two-thirds of the players are keeping their options open, however. The blip around Sept. 18 initially confused us, since news searches in that window don't turn up anything bombastic. A look under the hood shows an influx of new players around that time that briefly threw off the standings. They normalized within a few days.

Massachusetts Governor
West Virginia Senate
California House 11
California Governor
Illinois Governor
Pennsylvania Senate
New Hampshire Senate
Florida Governor
Kentucky Senate
Nevada House 3
North Dakota House
South Carolina Governor
South Carolina Senate

Alaska Senate
Slate readers say: Joe Miller (R) 86 percent, Scott McAdams (D) 14 percent. Fifty-three percent of picks are locked.
Pundits say:Likely Republican (Sabato, CQ); safe Republican (Rothenberg, Cook).

From Day One, the vast majority of players have considered Miller a shoo-in, though Lean/Lock doesn't allow for third-party candidates like incumbent Sen. Lisa Murkowski, who lost the Republican primary to Miller. Her presence in the race could explain why many players have yet to lock their picks. Miller's standing in Lean/Lock almost exactly matches the odds that 538's Nate Silver, using a statistical modeling approach, places on Miller.

Idaho 1
Slate readers say: Raul Labrador (R) 80 percent, Walt Minnick (D) 20 percent. Forty-two percent of picks are locked.
Pundits say:Tossup (Sabato); leans Democratic (CQ, Rothenberg, Cook).

The extreme confidence in the Republican is a bit puzzling here. But House races are harder to predict than statewide races, and the fact that fewer than half of those predicting Labrador's victory have sealed their choice suggests readers are waiting this one out.

New Hampshire Senate
Slate readers say: Paul W. Hodes (D) 64 percent, Kelly Ayotte (R) 36 percent. Thirty-two percent of picks are locked.
Pundits say:Likely Republican (Rothenberg); leans Republican (Sabato, CQ); tossup (Cook).

This race is where Lean/Lock players disagree most with the pros. Silver's algorithms give Ayotte, a former state attorney general, a 91 percent chance of beating Hodes, who has represented the state in the U.S. House for two terms. But Lean/Lock players are betting otherwise: Even among the most confident players—those who are locking—Hodes has a 8 percentage-point edge.

Nevada Senate
Slate readers say: Harry Reid (D) 79 percent, Sharron Angle (R) 21 percent. Forty-nine percent of picks are locked.
Pundits say:Tossup (Sabato, CQ, Rothenberg, Cook).

Lean/Lock players have been generally skeptical of Tea Party candidates, and this race is no exception. Angle is perceived as one of the Tea Party's weakest candidates, but Reid must defend his incumbency while Nevada faces the nation's highest unemployment rate, one of the reasons that forecasters still consider the race a major tossup. The uncertainty among the professionals hasn't stopped Lean/Lock players, however, from favoring the Senate majority leader by a huge margin.

Become a fan of Slate  on Facebook. Follow us on Twitter.

Chris Wilson is a Slate contributor.


Medical Examiner

Here’s Where We Stand With Ebola

Even experienced international disaster responders are shocked at how bad it’s gotten.

Why Are Lighter-Skinned Latinos and Asians More Likely to Vote Republican?

A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

The XX Factor
Sept. 22 2014 12:29 PM A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

Subprime Loans Are Back

And believe it or not, that’s a good thing.

It Is Very Stupid to Compare Hope Solo to Ray Rice

Building a Better Workplace

In Defense of HR

Startups and small businesses shouldn’t skip over a human resources department.

How Ted Cruz and Scott Brown Misunderstand What It Means to Be an American Citizen

Divestment Is Fine but Mostly Symbolic. There’s a Better Way for Universities to Fight Climate Change.

  News & Politics
Sept. 22 2014 6:30 PM What Does It Mean to Be an American? Ted Cruz and Scott Brown think it’s about ideology. It’s really about culture.
Sept. 22 2014 5:38 PM Apple Won't Shut Down Beats Music After All (But Will Probably Rename It)
Dear Prudence
Sept. 23 2014 6:00 AM Naked and Afraid Prudie offers advice on whether a young boy should sleep in the same room with his nude grandfather.
  Double X
The XX Factor
Sept. 22 2014 7:43 PM Emma Watson Threatened With Nude Photo Leak for Speaking Out About Women's Equality
  Slate Plus
Slate Plus
Sept. 22 2014 1:52 PM Tell Us What You Think About Slate Plus Help us improve our new membership program.
Brow Beat
Sept. 22 2014 9:17 PM Trent Reznor’s Gone Girl Soundtrack Sounds Like an Eerie, Innovative Success
Future Tense
Sept. 22 2014 6:27 PM Should We All Be Learning How to Type in Virtual Reality?
  Health & Science
Medical Examiner
Sept. 22 2014 4:34 PM Here’s Where We Stand With Ebola Even experienced international disaster responders are shocked at how bad it’s gotten.
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.