The Author of How Not to Be Wrong Explains How He Was Wrong

The power of mathematical thinking.
June 13 2014 4:41 PM

How I Was Wrong

Barry Bonds.
San Francisco Giants slugger Barry Bonds watches his record-setting 73rd home run on Oct. 7, 2001.

Photo by John G. Mabanglo/AFP/Getty Images

When you write a book called How Not to Be Wrong, you ought to expect to be fact-checked a little. And one of the virtues of the new, data-driven journalism currently in vogue is the habit of going back and checking one’s own old stuff. We’re not supposed to avert our gaze from the howlers in our old columns. We’re supposed to find the mistakes and learn from them.

In that spirit I’m going to use the last entry in this blog to look over some of my old columns from Slate, with special attention to the times I blew it.


But there were some mistakes, too. Here are the three biggest.

Barry Bonds isn’t going to break the home run record. Bonds had 39 home runs in the 88 games making up the first half of the 2001 season, putting him on pace for a record-breaking 72 homers for the year. But I knew the theory of regression to the mean, which reminds us that the league leader in home runs at midseason is likely to have been both good and lucky, and thus isn’t apt to maintain his league-leading pace. Historically, typical league-leaders only hit two-thirds as many home runs in the second half as they did in the first. If that trend held in 2001, Bonds would finish the season with 61 home runs.

In fact, he increased his pace, ending up with 73 home runs and the all-time season record. My reasoning wasn’t bad. It’s just that I’d neglected the possibility that there was another factor besides natural ability and luck that was working in Bonds’ favor.

Political polarization isn’t spinning out of control. Also in 2001, I wrote about Keith Poole and Howard Rosenthal’s DW-NOMINATE system for quantifying political polarization, and tracking it over the whole history of Congress. Their startling finding was that what appeared to be a sudden jerk upward in partisanship was actually a return to the normal levels of polarization that had prevailed for decades before a temporary period of abnormal bipartisanship kicked in for part of the 20th century.

But actually, the people decrying partisanship spinning out of control were right. By 2001, as I wrote, polarization had risen back to normal levels—but then it kept on rising. A Pew poll released Thursday shows the highest levels of political polarization the organization has ever recorded among American voters.

Why did I get this one wrong? I was too wedded to the idea that the past would repeat itself, that the plateau at a certain level of polarization that obtained in the first half of the 20th century would repeat itself. That degree of polarization represented a kind of equilibrium under the old conditions. But conditions change, and I didn’t stop to think about whether that might be happening.

Democrats won’t take control of the House of Representatives in 2006. I carefully computed a probability distribution based on Charlie Cook’s pre-election division of the House races into “leaning Republican,” “leaning Democratic,” and “tossup,” and came up with the answer that the Democrats had somewhere between a 15 percent and 50 percent chance of taking over the House. But Cook himself, looking at all the data he had available, and in light of his own experience, had a different take: “If nothing changes, I think the House will turn.”

It turned, and turned big, the Democrats not only eliminating the GOP majority but ending up with a 233–202 majority of their own.

Now it’s possible that some last-minute shift in fortune moved the needle in the Democrats’ direction. But it’s also possible—actually, likely—that Charlie Cook knows how to synthesize his data better than I do. Mathematical analysis of the human world can’t be carried by mathematicians working alone, if we want to do it right. It has to be a partnership between people who can wrangle the numbers and people with the deep domain knowledge the numbers alone don’t capture.

This is the final entry in the How Not to Be Wrong blog. I hope it’s given some kind of a sense of the range and force of mathematical ideas. And if you still want more? Well, I wrote a whole book about this stuff, featuring most of the examples on this blog, and a lot more besides.

Jordan Ellenberg is a professor of mathematics at the University of Wisconsin and the author of How Not to Be Wrong. He blogs at Quomodocumque.



The Democrats’ War at Home

How can the president’s party defend itself from the president’s foreign policy blunders?

An Iranian Woman Was Sentenced to Death for Killing Her Alleged Rapist. Can Activists Save Her?

Piper Kerman on Why She Dressed Like a Hitchcock Heroine for Her Prison Sentencing

Windows 8 Was So Bad That Microsoft Will Skip Straight to Windows 10

We Need to Talk: A Terrible Name for a Good Women’s Sports Show


Cringing. Ducking. Mumbling.

How GOP candidates react whenever someone brings up reproductive rights or gay marriage.


How Even an Old Hipster Can Age Gracefully

On their new albums, Leonard Cohen, Robert Plant, and Loudon Wainwright III show three ways.

The U.S. Has a New Problem in Syria: The Moderate Rebels Feel Like We’ve Betrayed Them

Homeland Is Good Again! For Now, at Least.

Oct. 1 2014 11:48 AM An Up-Close Look at the U.S.–Mexico Border
  News & Politics
The World
Oct. 1 2014 12:20 PM Don’t Expect Hong Kong’s Protests to Spread to the Mainland
Oct. 1 2014 2:16 PM Wall Street Tackles Chat Services, Shies Away From Diversity Issues 
The Eye
Oct. 1 2014 1:04 PM An Architectural Crusade Against the Tyranny of Straight Lines
  Double X
The XX Factor
Oct. 1 2014 2:08 PM We Need to Talk: Terrible Name, Good Show
  Slate Plus
Political Gabfest
Oct. 1 2014 1:53 PM Slate Superfest East How to get your tickets before anyone else.
Brow Beat
Oct. 1 2014 2:24 PM The New Interstellar Trailer Is the Most Exciting Yet
Future Tense
Oct. 1 2014 2:26 PM The Apple Graveyard Leave a flower for a dead Apple product.
  Health & Science
Oct. 1 2014 2:36 PM Climate Science Is Settled Enough The Wall Street Journal’s fresh face of climate inaction.
Sports Nut
Sept. 30 2014 5:54 PM Goodbye, Tough Guy It’s time for Michigan to fire its toughness-obsessed coach, Brady Hoke.