The Netflix Prize was brilliant. Google and Microsoft should steal the idea.

Innovation, the Internet, gadgets, and more.
Sept. 22 2009 5:37 PM

The Netflix Prize Was Brilliant

Google and Microsoft should steal the idea.

Netflix.

It's no surprise that Netflix has launched another contest to improve its movie-recommendations system—the $1 million the company gave away for the first Netflix Prize was the steal of the century. On Monday, three years after the contest kicked off, Netflix awarded the jackpot to BellKor's Pragmatic Chaos, a team of seven engineers, mathematicians, and computer scientists who managed to improve the DVD-rental service's recommendations by 10 percent. BellKor beat out another team— the Ensemble, with more than 30 members—that had achieved the exact same ratings improvement but lost by turning in its method 20 minutes after BellKor.

Imagine if Netflix had paid all these math whizzes the prevailing wage—say, $100,000 a year. The company would have had to shell out more than $3 million for just one year of the top performers' time, and that's assuming it could've sussed out who the top performers were going to be. Of course, many of the programmers worked far longer than a year, some of them setting aside their primary occupations in order to work on the Netflix problem full-time. As Netflix CEO Reed Hastings admitted to the New York Times, "You look at the cumulative hours and you're getting Ph.D.s for a dollar an hour."

Advertisement

But even that number discounts the contest's true benefits to Netflix. Had the company simply put out a help-wanted ad for software engineers, it probably wouldn't have been able to recruit many of the geniuses it found through the competition. That's because most of them already have other jobs. BellKor's members work for, among others, AT&T and Yahoo, and many members of the Ensemble are employed by the data-consulting firm Opera Solutions. The participants also spanned the globe. Netflix got submissions from people in more than 100 countries, and the winning team's members worked in New Jersey, Montreal, Israel, and Austria.

The Netflix Prize isn't entirely novel. Science prizes date back to at least the 18th century, when the British government offered ₤20,000 to the first person to come up with a way to determine a ship's longitude. Other notable innovation-prize winners include Charles Lindbergh, who won the Orteig Prize in 1927 for flying across the Atlantic, and SpaceShipOne, which won the 2004 Ansari X Prize, a contest to launch a privately funded manned craft into space.

But the Netflix effort was unusual for a couple of reasons. First, it was funded explicitly for the benefit of a private company; though many participants were interested in finding better ways to predict fickle human tastes, Netflix was looking for research that would help boost its bottom line. The company has already folded some of what it learned from the contest into its recommendations system, and that has helped increase its customer-retention rate. The Netflix prize is also notable for what it was after—not a feat of derring-do, like Lindbergh's, or one of engineering, like SpaceShipOne, but rather a kind of mathematical recipe. Netflix was looking for an idea—and it turns out that Internet-enabled collaboration is particularly well-suited to fostering such abstractions.

Indeed, the Netflix Prize should serve as a model for other tech companies working on hard problems, as it combines the best parts of open-source development with the best parts of proprietary code. Just like an open-source project, the prize was remarkable for its spirit of cooperation—over the life of the contest, competitors frequently became collaborators, joining one another's teams when they realized that they could never win by going it alone. The winning team is actually a mélange of three different teams; they joined up in June, and their winning algorithm combines the best ideas of each group.

TODAY IN SLATE

History

Slate Plus Early Read: The Self-Made Man

The story of America’s most pliable, pernicious, irrepressible myth.

Rehtaeh Parsons Was the Most Famous Victim in Canada. Now, Journalists Can’t Even Say Her Name.

Mitt Romney May Be Weighing a 2016 Run. That Would Be a Big Mistake.

Amazing Photos From Hong Kong’s Umbrella Revolution

Transparent Is the Fall’s Only Great New Show

The XX Factor

Rehtaeh Parsons Was the Most Famous Victim in Canada

Now, journalists can't even say her name.

Doublex

Lena Dunham, the Book

More shtick than honesty in Not That Kind of Girl.

What a Juicy New Book About Diane Sawyer and Katie Couric Fails to Tell Us About the TV News Business

Does Your Child Have Sluggish Cognitive Tempo? Or Is That Just a Disorder Made Up to Scare You?

  News & Politics
History
Sept. 29 2014 11:45 PM The Self-Made Man The story of America’s most pliable, pernicious, irrepressible myth.
  Business
Moneybox
Sept. 29 2014 7:01 PM We May Never Know If Larry Ellison Flew a Fighter Jet Under the Golden Gate Bridge
  Life
Dear Prudence
Sept. 29 2014 3:10 PM The Lonely Teetotaler Prudie counsels a letter writer who doesn’t drink alcohol—and is constantly harassed by others for it.
  Double X
Doublex
Sept. 29 2014 11:43 PM Lena Dunham, the Book More shtick than honesty in Not That Kind of Girl.
  Slate Plus
Slate Fare
Sept. 29 2014 8:45 AM Slate Isn’t Too Liberal, but … What readers said about the magazine’s bias and balance.
  Arts
Brow Beat
Sept. 29 2014 9:06 PM Paul Thomas Anderson’s Inherent Vice Looks Like a Comic Masterpiece
  Technology
Future Tense
Sept. 29 2014 11:56 PM Innovation Starvation, the Next Generation Humankind has lots of great ideas for the future. We need people to carry them out.
  Health & Science
Medical Examiner
Sept. 29 2014 11:32 PM The Daydream Disorder Is sluggish cognitive tempo a disease or disease mongering?
  Sports
Sports Nut
Sept. 28 2014 8:30 PM NFL Players Die Young. Or Maybe They Live Long Lives. Why it’s so hard to pin down the effects of football on players’ lives.