Household Survey vs Payroll Survey

A blog about business and economics.
Oct. 5 2012 10:45 AM

The Household Survey Always Finds More Jobs Than The Payroll Survey


There's plenty of attention being paid today to the fact that employment as measured by the BLS household survey really surged, while the payroll survey just offered moderately good news. The household survey presumably has some real epistemic value, but I think it's important to try to not opportunistically switch from one dataset to the other. But however you like this, it's worth noting that the household survey always finds a lot more jobs than the payroll survey.

You'll see above a chart of the gap in terms of thousands of jobs. We're talking a gap that ranges in scale from hundreds of thousands of jobs to over a million jobs. It's a very large gap. And unfortunately for analysts, it's not a stable gap either. It looks a little bit like labor market booms—as in the mid-sixties or the late-nineties—cause the gap to close, but it's quite noisy on a month-to-month basis and seems to have other mysterious sources of variation.


If you recall the data disputes of the mid-aughts when the gap was rising, we used to have a lot of accusations and counter-accusations flying around. Sometimes liberals would suggest that the Bush administration was deliberately cooking the books on the household survey (but for some reason forgetting to do so on the payroll survey) and that's why the gap was rising. And conservatives sometimes argued that we were seeing a surge in home-based businesses (eBay often got a mention) that the payroll survey wasn't finding. I wonder in retrospect if undocumented workers in the construction sector weren't playing a role here. At any rate, we never really figued it out and the discrepency never went away. Instead it stabilized at a level higher than what we saw in the nineties but lower than what we saw in the eighties.

I have genuinely no theory to offer about this, just the observation that when you hear theories offered it's important to try to locate them in the broader context of longstanding and variable disagreement between the series.

Matthew Yglesias is the executive editor of Vox and author of The Rent Is Too Damn High.


The Juice

Ford’s Big Gamble

It’s completely transforming America’s best-selling vehicle.

Should the United States Grant Asylum to Victims of Domestic Violence?

The Apple Watch Will Make Everyone Around You Just a Little Worse Off

This Was the First Object Ever Designed

Don’t Expect Adrian Peterson to Go to Prison

In much of America, beating your kids is perfectly legal. 


How the Apple Watch Will Annoy Us

A glowing screen attached to someone else’s wrist is shinier than all but the blingiest jewels.


A Little Bit Softer Now, a Little Bit Softer Now …

The sad, gradual decline of the fade-out in popular music.

Is Everyone Going to Declare Independence if Scotland Does It? 

I Tried to Write an Honest Profile of One of Bollywood’s Biggest Stars. It Didn’t Go Well.

Trending News Channel
Sept. 12 2014 11:26 AM Identical Twins Aren’t Really Identical
  News & Politics
Sept. 12 2014 7:24 PM Come and Take It Libertarians fight for people whose property was seized by the police.
Sept. 12 2014 5:54 PM Olive Garden Has Been Committing a Culinary Crime Against Humanity
Sept. 12 2014 3:32 PM Yes, Those Straight Guys Who Wed for Rugby Tickets Are Mocking Marriage. What’s New?
  Double X
The XX Factor
Sept. 12 2014 4:05 PM Life as an NFL Wife: “He's the Star. Keep Him Happy.”
  Slate Plus
Behind the Scenes
Sept. 12 2014 5:55 PM “Do You Know What Porn Is?” Conversations with Dahlia Lithwick’s 11-year-old son.
Brow Beat
Sept. 14 2014 7:10 PM Watch Michael Winslow Perform Every Part of “Whole Lotta Love” With Just His Voice
Future Tense
Sept. 12 2014 3:53 PM We Need to Pass Legislation on Artificial Intelligence Early and Often
  Health & Science
New Scientist
Sept. 14 2014 8:38 AM Scientific Misconduct Should Be a Crime It’s as bad as fraud or theft, only potentially more dangerous.
Sports Nut
Sept. 12 2014 4:36 PM “There’s No Tolerance for That” Pete Carroll and Jim Harbaugh say they don’t abide domestic abuse. So why do the Seahawks and 49ers have a combined six players accused of violence against women?