Do People Have To Like an Ad for It To Work?

The new science of winning campaigns
Aug. 24 2012 6:41 PM

Do People Have To Like an Ad for It To Work?

Members of the news media record Mitt Romney from a television set as he hosts a Romney For President Volunteer Google+ hangout town hall at the Google Chicago headquarters March 20, 2012 in Chicago, Illi.

Photo by Chip Somodevilla/Getty Images

After musing this morning on different ways of thinking about what a TV ad can do, I’d be remiss if I didn’t note two sources that have spent the summer auditioning new tools to assess the success of a single spot.  

Vanderbilt University political scientist John Geer has teamed up with YouGov, a pollster that uses Internet-based samples, and launched the Ad Rating Project, which allows a 600-person panel to judge ads. The project is designed to be a democratized counterweight to punditry. “We no longer have to rely solely on ad-hoc conversations among experts, various fact checkers, and journalists about whether an ad crosses the line,” Geer and YouGov’s Doug Rivers wrote in Politico. “We instead give Americans a chance to weigh in with their thoughts.”  As a consequence, it relies on purely qualitative questions. Did viewers like the ad? Was it memorable, interesting, unfair, untruthful or unbelievable? Did it make them feel hopeful, happy, disgusted, angry, and worried?

These are, of course, foremost judgments about aesthetics and propriety. Adam Schaeffer, a co-founder and research director of the Republican consulting firm Evolving Strategies, is trying to measure impact.

His firm is promoting the use of what it brands a “PocketTrial,” basically a lab experiment, in which an online sample is randomly shown ads and then polled on the state of the race and candidate popularity afterwards. Since the viewers were assigned to groups randomly, Schaeffer can attribute differences in how the groups respond to the influence of the ads they saw. “This is the only way you can get some purchase on causality,” he says.

When he recently showed two short videos to his subjects to assess the impact of messaging related to Paul Ryan’s selection—one from Romney’s campaign trumpeting the ticket, the other from Obama’s attacking the Ryan Plan—in each case male viewers moved dramatically in the directions each ad wanted to push them while female ones barely budged. “Women seem more stable in their vote choice,” he says.

Schaeffer is reassuringly timid about venturing an assumption as to why that might be. But he scoffs at the idea that the answer could be uncovered by asking voters to declare whether they find an ad interesting or claim to be disgusted by it. “We just observe—we don’t ask people to judge an ad,” he says. “We don’t care what they think of it.”

Sasha Issenberg is the author of The Victory Lab about the new science of political campaigns.



Blacks Don’t Have a Corporal Punishment Problem

Americans do. But when blacks exhibit the same behaviors as others, it becomes part of a greater black pathology. 

I Bought the Huge iPhone. I’m Already Thinking of Returning It.

Scotland Is Just the Beginning. Expect More Political Earthquakes in Europe.

Lifetime Didn’t Think the Steubenville Rape Case Was Dramatic Enough

So they added a little self-immolation.

Two Damn Good, Very Different Movies About Soldiers Returning From War

Medical Examiner

The Most Terrifying Thing About Ebola 

The disease threatens humanity by preying on humanity.

Students Aren’t Going to College Football Games as Much Anymore, and Schools Are Getting Worried

The Good Wife Is Cynical, Thrilling, and Grown-Up. It’s Also TV’s Best Drama.

  News & Politics
Sept. 19 2014 9:15 PM Chris Christie, Better Than Ever
Business Insider
Sept. 20 2014 6:30 AM The Man Making Bill Gates Richer
Sept. 20 2014 7:27 AM How Do Plants Grow Aboard the International Space Station?
  Double X
The XX Factor
Sept. 19 2014 4:58 PM Steubenville Gets the Lifetime Treatment (And a Cheerleader Erupts Into Flames)
  Slate Plus
Slate Picks
Sept. 19 2014 12:00 PM What Happened at Slate This Week? The Slatest editor tells us to read well-informed skepticism, media criticism, and more.
Brow Beat
Sept. 19 2014 4:48 PM You Should Be Listening to Sbtrkt
Future Tense
Sept. 19 2014 6:31 PM The One Big Problem With the Enormous New iPhone
  Health & Science
Bad Astronomy
Sept. 20 2014 7:00 AM The Shaggy Sun
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.