When Empirical Evidence Matters

A blog about business and economics.
April 19 2013 11:50 AM

When To Take Empirical Evidence Seriously

The entire Reinhart-Rogoff fiasco reminded me of my post from last year on how empirical evidence is overrated at times by a chart-happy blogosphere. Reading Nate Silver's book gave me a better way of putting this. In his chapter on climate change, he makes the point that one reason climate change skepticism is so tenacious is that the statistical data about climate patterns really is a bit on the noisy and ambiguous side. The reason you can know that the skeptics are wrong isn't so much because the data is so overwhelmingly persuasive, it's that the data is overwhelmingly persuasive in light of the underlying science of how greenhouse gas emissions would cause climate change. Absent the causal theory about the greenhouse effect, simply looking at a chart of world temperatures and the correlation with CO2 emissions wouldn't prove very much. The empirical data is important because it's in line with the predictions of a persuasive theoretical account.

The R&R situation is basically the opposite. In the absence of a plausible account of why a high debt:GDP ratio would cause slow real growth even in the absence of high interest rates, you would want to see overwhelming empirical evidence for the existence of such an effect before you believed it. And they just didn't have the goods. 


In general you're going to find that most empirical world in a field like economics is subject to some considerable uncertainty. It's very difficult to run proper experiments, and when you can run proper experiments the relevance to the real world isn't always clear. So when you look at a purported empirical finding you need to ask not only how strong is the evidence, but what's a reasonable prior assessment before looking at the new empirical data. A correlation is never sufficient to establish a causal relationship, but it might be good evidence for the existence of one or else it might not. That depends, in part, on how strong your theory is. The only theoretical account backing the R&R causal inference was a kind of hazy moralism, which should never be good enough.

Matthew Yglesias is the executive editor of Vox and author of The Rent Is Too Damn High.


Medical Examiner

Here’s Where We Stand With Ebola

Even experienced international disaster responders are shocked at how bad it’s gotten.

Why Are Lighter-Skinned Latinos and Asians More Likely to Vote Republican?

A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

The XX Factor
Sept. 22 2014 12:29 PM A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

Subprime Loans Are Back

And believe it or not, that’s a good thing.

It Is Very Stupid to Compare Hope Solo to Ray Rice

Building a Better Workplace

In Defense of HR

Startups and small businesses shouldn’t skip over a human resources department.

How Ted Cruz and Scott Brown Misunderstand What It Means to Be an American Citizen

Divestment Is Fine but Mostly Symbolic. There’s a Better Way for Universities to Fight Climate Change.

  News & Politics
Sept. 22 2014 6:30 PM What Does It Mean to Be an American? Ted Cruz and Scott Brown think it’s about ideology. It’s really about culture.
Sept. 22 2014 5:38 PM Apple Won't Shut Down Beats Music After All (But Will Probably Rename It)
Sept. 22 2014 4:45 PM Why Can’t the Census Count Gay Couples Accurately?
  Double X
The XX Factor
Sept. 22 2014 7:43 PM Emma Watson Threatened With Nude Photo Leak for Speaking Out About Women's Equality
  Slate Plus
Slate Plus
Sept. 22 2014 1:52 PM Tell Us What You Think About Slate Plus Help us improve our new membership program.
Brow Beat
Sept. 22 2014 9:17 PM Trent Reznor’s Gone Girl Soundtrack Sounds Like an Eerie, Innovative Success
Future Tense
Sept. 22 2014 6:27 PM Should We All Be Learning How to Type in Virtual Reality?
  Health & Science
Medical Examiner
Sept. 22 2014 4:34 PM Here’s Where We Stand With Ebola Even experienced international disaster responders are shocked at how bad it’s gotten.
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.