Household Survey vs Payroll Survey

A blog about business and economics.
Oct. 5 2012 10:45 AM

The Household Survey Always Finds More Jobs Than The Payroll Survey


There's plenty of attention being paid today to the fact that employment as measured by the BLS household survey really surged, while the payroll survey just offered moderately good news. The household survey presumably has some real epistemic value, but I think it's important to try to not opportunistically switch from one dataset to the other. But however you like this, it's worth noting that the household survey always finds a lot more jobs than the payroll survey.

You'll see above a chart of the gap in terms of thousands of jobs. We're talking a gap that ranges in scale from hundreds of thousands of jobs to over a million jobs. It's a very large gap. And unfortunately for analysts, it's not a stable gap either. It looks a little bit like labor market booms—as in the mid-sixties or the late-nineties—cause the gap to close, but it's quite noisy on a month-to-month basis and seems to have other mysterious sources of variation.


If you recall the data disputes of the mid-aughts when the gap was rising, we used to have a lot of accusations and counter-accusations flying around. Sometimes liberals would suggest that the Bush administration was deliberately cooking the books on the household survey (but for some reason forgetting to do so on the payroll survey) and that's why the gap was rising. And conservatives sometimes argued that we were seeing a surge in home-based businesses (eBay often got a mention) that the payroll survey wasn't finding. I wonder in retrospect if undocumented workers in the construction sector weren't playing a role here. At any rate, we never really figued it out and the discrepency never went away. Instead it stabilized at a level higher than what we saw in the nineties but lower than what we saw in the eighties.

I have genuinely no theory to offer about this, just the observation that when you hear theories offered it's important to try to locate them in the broader context of longstanding and variable disagreement between the series.

Matthew Yglesias is the executive editor of Vox and author of The Rent Is Too Damn High.



Talking White

Black people’s disdain for “proper English” and academic achievement is a myth.

Hong Kong’s Protesters Are Ridiculously Polite. That’s What Scares Beijing So Much.

The One Fact About Ebola That Should Calm You: It Spreads Slowly

Operation Backbone

How White Boy Rick, a legendary Detroit cocaine dealer, helped the FBI uncover brazen police corruption.

A Jaw-Dropping Political Ad Aimed at Young Women, Apparently

The XX Factor
Oct. 1 2014 4:05 PM Today in GOP Outreach to Women: You Broads Like Wedding Dresses, Right?

How Even an Old Hipster Can Age Gracefully

On their new albums, Leonard Cohen, Robert Plant, and Loudon Wainwright III show three ways.

How Tattoo Parlors Became the Barber Shops of Hipster Neighborhoods

This Gargantuan Wind Farm in Wyoming Would Be the Hoover Dam of the 21st Century

Oct. 1 2014 8:34 AM This Gargantuan Wind Farm in Wyoming Would Be the Hoover Dam of the 21st Century To undertake a massively ambitious energy project, you don’t need the government anymore.
  News & Politics
Oct. 1 2014 7:26 PM Talking White Black people’s disdain for “proper English” and academic achievement is a myth.
Buy a Small Business
Oct. 1 2014 11:48 PM Inking the Deal Why tattoo parlors are a great small-business bet.
Oct. 1 2014 6:02 PM Facebook Relaxes Its “Real Name” Policy; Drag Queens Celebrate
  Double X
The XX Factor
Oct. 1 2014 5:11 PM Celebrity Feminist Identification Has Reached Peak Meaninglessness
  Slate Plus
Behind the Scenes
Oct. 1 2014 3:24 PM Revelry (and Business) at Mohonk Photos and highlights from Slate’s annual retreat.
Brow Beat
Oct. 1 2014 9:39 PM Tom Cruise Dies Over and Over Again in This Edge of Tomorrow Supercut
Future Tense
Oct. 1 2014 6:59 PM EU’s Next Digital Commissioner Thinks Keeping Nude Celeb Photos in the Cloud Is “Stupid”
  Health & Science
Oct. 1 2014 4:03 PM Does the Earth Really Have a “Hum”? Yes, but probably not the one you’re thinking.
Sports Nut
Oct. 1 2014 5:19 PM Bunt-a-Palooza! How bad was the Kansas City Royals’ bunt-all-the-time strategy in the American League wild-card game?