Blogging the Stanford Machine Learning Class

Why We Can’t Use Machine Learning To Predict Presidential Elections—Yet
What's to come?
Dec. 20 2011 1:19 PM

Blogging the Stanford Machine Learning Class


Will my new skills help me predict presidential elections?

Machines can learn to recognize text and faces, but can they do more?


Shortly after the end of World War II, the British math prodigy Freeman Dyson and the Indian physics phenom Harish-Chandra, both at Cambridge, had a conversation about their plans to change fields. “I am leaving physics for mathematics; I find physics messy, unrigorous, elusive,” Harish-Chandra told his colleague. Dyson supposedly replied: “I am leaving mathematics for physics for exactly the same reasons.”

After a semester in Stanford’s online machine learning class, I find the discipline messy and elusive, if not easy, when I expected it to be more elegant and theoretical. I wrote earlier that the math gets tough at some point in any sort science, but that doesn’t mean the end result, if you survive the equations, has to lose its elegance as well. In the final lectures of this class, which ended last week, we saw examples of how machines can learn to decipher text and faces in photos with surprising accuracy. (Imagine being blind and wearing a hat that narrated your surroundings.) But the process is rife with error correction and heavily dependent on the subjective decisions that the researchers make when deciding how to take these complex problems piece by piece.

I’m glad that very smart researchers are working on these problems, and I’m relieved I’m not one of them. Some people’s imaginations light up at these sorts of problems, in which the task is to extract meaning from a noisy, disorganized bunch of data. Throughout the course, professor Andrew Ng would mention work he and colleagues had done teaming up with researchers from other disciplines, from tumor detection to self-driving cars. This is not a science that should be limited to improved Google results and smarter phone applications. The hope, among machine-learning enthusiasts, is that more graduate students devote themselves to the field and then go forth into the world to mingle with the many researchers who are in need of smart, adaptive learning algorithms to make sense of their data.


The computing pioneer Charles Babbage supposedly once said that he’d give up the rest of his life to return in 500 years for a three-day tour of the scientific new age. I’m not quite at that level of curiosity about machine learning, but I look forward to checking in periodically over the next decade to see how it has advanced. It’s quite possible that, like computing itself, it will have become a staple in a wide variety of industries. We can already safely predict that it will be important to medicine, for example. Less obvious and more tantalizing is whether it will become useful to the applied social sciences.

More than 10 years ago, Slate ran an article outlining why you can’t build a model to predict presidential elections. The logic there still holds: You can predict any outcome you like depending which data you choose to use. One of the most powerful aspects of the algorithms we studied in this class was their ability to compute tremendous amounts of data and scale it down to the most important factors. Researchers also have ways of preventing their models from “overfitting” the data. In other words, one could probably create an algorithm that predicted past elections with great accuracy, but it might be so finely tuned to the quirks and turns of that historical data that it would be meaningless in 2012. It may seem preposterous to think that any mountainous pile of polls, unemployment rates, approval ratings, the stock markets, and a million other factors could, if correctly parsed by a smart machine, predict human behavior. But by and large, people behave rationally, and machines, if we learned anything, can model rational systems very well. And they’re getting better every day.

Chris Wilson is a Slate contributor.



Scalia’s Liberal Streak

The conservative justice’s most brilliant—and surprisingly progressive—moments on the bench.

Colorado Is Ground Zero for the Fight Over Female Voters

There’s a Way to Keep Ex-Cons Out of Prison That Pays for Itself. Why Don’t More States Use It?

The NFL Explains How It Sees “the Role of the Female”

The Music Industry Is Ignoring Some of the Best Black Women Singing R&B


Theo’s Joint and Vanessa’s Whiskey

No sitcom did the “Very Special Episode” as well as The Cosby Show.


The Other Huxtable Effect

Thirty years ago, The Cosby Show gave us one of TV’s great feminists.

Cliff Huxtable Explains the World: Five Lessons From TV’s Greatest Dad

Why Television Needs a New Cosby Show Right Now

  News & Politics
Sept. 18 2014 8:20 PM A Clever Attempt at Explaining Away a Vote Against the Farm Bill
Sept. 18 2014 6:02 PM A Chinese Company Just Announced the Biggest IPO in U.S. History
The Slate Quiz
Sept. 18 2014 11:44 PM Play the Slate News Quiz With Jeopardy! superchampion Ken Jennings.
  Double X
Sept. 18 2014 8:07 PM Crying Rape False rape accusations exist, and they are a serious problem.
  Slate Plus
Behind the Scenes
Sept. 18 2014 1:23 PM “It’s Not Every Day That You Can Beat the World Champion” An exclusive interview with chess grandmaster Fabiano Caruana.
Brow Beat
Sept. 18 2014 4:33 PM The Top 5 Dadsplaining Moments From The Cosby Show
Future Tense
Sept. 18 2014 6:48 PM By 2100 the World's Population Could Be 11 Billion
  Health & Science
Sept. 18 2014 3:35 PM Do People Still Die of Rabies? And how do you know if an animal is rabid?
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.