Turning words into touchdowns: Does a player's speech predict how he'll perform in the NFL?

The stadium scene.
April 27 2011 5:27 PM

Turning Words Into Touchdowns

Does a player's speech predict how he'll perform in the NFL?

(Continued from Page 1)

Analyst Steven Hofmann brings up the example of the 2005 draft. The two top quarterback prospects that year were Alex Smith and Aaron Rodgers. Smith played for the University of Utah and wowed the scouts with his athletic ability at the NFL combine. He also scored an amazing 40 out of 50 on the Wonderlic intelligence test. The 49ers, who saw him as a smart, gifted athlete, made him the first pick in the draft. Rodgers, who many thought would go No. 1, had the painful experience of lingering in the green room on live television until he was selected by the Packers as the 24th pick.

Hofmann, as we know, has been gathering the college press conferences of first-round draft picks and analyzing them. Here is one of the charts on quarterbacks:

1_123125_123037_2279927_2290351_110427_snut_nfl_qb1

The y axis is the positive power score—the belief in one's ability to influence events and outcomes: "I refuse to consider that" or "I promise that it won't happen again." The x axis shows the in-group affiliation score, terms and expressions that indicate whether the speaker associates positively with a group: "We did a great job today" or "Our linebackers were amazing." These two traits are correlated with a player's career NFL passer rating.

What would you have done if you were the 49ers general manager on draft day in 2005? The guy you like, Alex Smith, has low scores in positive power and in-group affiliation. He talks like someone who doesn't see himself as a leader. The guy you are about to pass over, Aaron Rodgers, is at the opposite end of the spectrum. He's a guy who talks like Julius Caesar. My guess: You probably would have dismissed it as academic hooey.

Achievement Metrics is trying to persuade NFL executives that it's not selling pointy-headed gibberish. It's presented its work at the premier sports stats conference at MIT and has been approached by curious teams. At the very least, this speech research seems more persuasive than the Wonderlic, which has been shown in repeated studies to have no ability to predict future performance. One reason the Wonderlic remains despite its uselessness is that we can't measure the so-called "intangibles." The private interviews the players have with teams, the two-hour psychological exam that the Giants used to administer, the personality tests—all of these are about trying to gain some purchase on what separates a Tom Brady from a Brady Quinn.

Advertisement

The beauty of what Achievement Metrics is trying to do is that spontaneous speech cannot be faked. (This is in contrast to the Wonderlic, which you can prep for like the SAT.) Textual analysis is not a crystal ball, of course. But look again at the chart above. There are six quarterbacks whose positive power and in-group affiliation scores were both above the median: Aaron Rodgers, Philip Rivers, Jay Cutler, Josh Freeman, Jason Campbell, and Rex Grossman. There are also six signal-callers whose positive power and in-group affiliation scores were both below the median: Alex Smith, Brady Quinn, Matt Leinart, Vince Young, Matthew Stafford, and Carson Palmer. The former group has thrown 470 career touchdown passes. The latter has thrown 290, with more than half of those belonging to Palmer. If I were an NFL general manager, I'd feel a lot more comfortable if the guy I was drafting was in that first group.

Achievement Metrics' Roger Hall and Steven Hofmann were upfront about the fact that they deal in probabilities, not certainties. "If all the correlations were perfect," Hall told me, "We would be lying." Even so, they are refining their analyses and gaining more confidence. This year, they told me, they see a similar pattern to 2005. There are five supposedly solid prospects in this year's quarterback class—Cam Newton, Blaine Gabbert, Jake Locker, Ryan Mallett, and Andy Dalton. One of these men, they told me, is in the quadrant of players who have not gone on to great success in the NFL.

Hall and Hofmann would not identify which quarterback is in the quadrant of doom. They are keeping this year's data proprietary in the hopes that NFL teams will pay them for their research. If you were the Carolina Panthers, how much would you be willing to spend to find out whether Cam Newton scores like Alex Smith or Aaron Rodgers?

TODAY IN SLATE

Medical Examiner

Here’s Where We Stand With Ebola

Even experienced international disaster responders are shocked at how bad it’s gotten.

It Is Very, Very Stupid to Compare Hope Solo to Ray Rice

The U.S. Is So, So Far Behind Europe on Clean Energy

Even if You Don’t Like Batman, You Might Like Gotham

Friends Was the Last Purely Pleasurable Sitcom

The Eye

This Whimsical Driverless Car Imagines Transportation in 2059

Politics

Meet the New Bosses

How the Republicans would run the Senate.

A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

How Moscow’s Anti-War March Revealed One of Russia’s Deepest Divides

  News & Politics
Politics
Sept. 22 2014 6:30 PM What Does It Mean to Be an American? Ted Cruz and Scott Brown think it’s about ideology. It’s really about culture.
  Business
Moneybox
Sept. 22 2014 5:38 PM Apple Won't Shut Down Beats Music After All (But Will Probably Rename It)
  Life
Outward
Sept. 22 2014 4:45 PM Why Can’t the Census Count Gay Couples Accurately?
  Double X
The XX Factor
Sept. 22 2014 7:43 PM Emma Watson Threatened With Nude Photo Leak for Speaking Out About Women's Equality
  Slate Plus
Slate Plus
Sept. 22 2014 1:52 PM Tell Us What You Think About Slate Plus Help us improve our new membership program.
  Arts
Brow Beat
Sept. 22 2014 7:46 PM Azealia Banks’ New Single Is Her Best in Years
  Technology
Future Tense
Sept. 22 2014 6:27 PM Should We All Be Learning How to Type in Virtual Reality?
  Health & Science
Medical Examiner
Sept. 22 2014 4:34 PM Here’s Where We Stand With Ebola Even experienced international disaster responders are shocked at how bad it’s gotten.
  Sports
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.