So That’s Why Facebook Bought That Israeli Face-Recognition Startup

Future Tense
The Citizen's Guide to the Future
March 18 2014 5:45 PM

Facebook’s New Face-Recognition Software Is Scary Good

Facebook facial recognition algorithms and 3D modeling
From an original image of a face (a), DeepFace makes a 3-D model (d), which it can then rotate to generate images of the same face at different angles (g, h), which it can then match to different photos of the same person.

Image via Facebook

Almost two years ago, Facebook bought Face.com, an Israeli startup that specialized in face-recognition software. Given the instant backlash of headlines containing the word “creepy,” it’s no surprise that Facebook has kept pretty quiet about the technology since then.

Will Oremus Will Oremus

Will Oremus is Slate's senior technology writer.

Last week, though, Facebook quietly published a research paper that shows it has in fact been hard at work developing its face-recognition capabilities. The paper, co-authored by Face.com co-founder Yaniv Taigman, introduces a system called DeepFace that can match two images of the same face with incredible accuracy.

Trained on a data set of some 4 million photos “from a popular social network,” the software uses 3D modeling techniques and artificial neural networks to recognize similarities between two images of the same person—even when the angle, lighting, and facial expressions are different.

Advertisement

Just how good is DeepFace? On one benchmark data set, composed of professional photographs of thousands of different celebrities, it achieved an accuracy rate of 97.25 percent. That’s almost exactly as accurate as your average human.

Taigman and his co-authors—Ming Yang and Marc’Aurelio Ranzato of Facebook’s artificial intelligence team and Lior Wolf of Tel Aviv University—plan to present DeepFace at a computer vision conference in June, reports MIT Technology Review’s Tom Simonite.

But Facebook itself is not crowing about the achievement, probably because it’s wary of another round of “creepy” headlines. (Sorry guys!) The company wants to make it clear that DeepFace is an academic project, not an actual Facebook product.

“This is theoretical research, and we don’t currently use the techniques discussed in the paper on Facebook,” spokeswoman Lydia Chan told me.

The company’s reticence is understandable. Even as people become more comfortable entrusting big tech companies with their photos, files, and personal correspondence, facial recognition technologies remain something of a taboo. Google, for its part, said last year that it won’t add face-recognition features to Google Glass and won’t approve third-party apps that do.

Yet Google, too, has had its best AI minds hard at work training computers to recognize images. And no wonder: As creepy as face-recognition might be, it also holds enormous potential utility for applications ranging from advertising to law enforcement to Internet search.

Neither Facebook nor Google is eager to be the company to foist face-recognition software on an unwilling and outraged public. But if and when it becomes clear that people are as blasé about computers recognizing their face as they are today about computers reading their emails, neither company will want to be left behind. In fact, they'll already be at the forefront.

Previously in Slate:

Future Tense is a partnership of SlateNew America, and Arizona State University.

TODAY IN SLATE

Politics

Smash and Grab

Will competitive Senate contests in Kansas and South Dakota lead to more late-breaking races in future elections?

Even When They Go to College, the Poor Sometimes Stay Poor

Republicans Want the Government to Listen to the American Public on Ebola. That’s a Horrible Idea.

The Most Ingenious Teaching Device Ever Invented

Tom Hanks Has a Short Story in The New Yorker. It’s Not Good.

Brow Beat

Marvel’s Civil War Is a Far-Right Paranoid Fantasy

It’s also a mess. Can the movies do better?

Space: The Next Generation

An All-Female Mission to Mars

As a NASA guinea pig, I verified that women would be cheaper to launch than men.

Watching Netflix in Bed. Hanging Bananas. Is There Anything These Hooks Can’t Solve?

The Procedural Rule That Could Prevent Gay Marriage From Reaching SCOTUS Again

  News & Politics
Politics
Oct. 20 2014 7:13 PM Deadly Advice When it comes to Ebola, ignore American public opinion: It’s ignorant and misinformed about the disease.
  Business
Moneybox
Oct. 20 2014 7:23 PM Chipotle’s Magical Burrito Empire Keeps Growing, Might Be Slowing
  Life
Outward
Oct. 20 2014 3:16 PM The Catholic Church Is Changing, and Celibate Gays Are Leading the Way
  Double X
The XX Factor
Oct. 20 2014 6:17 PM I Am 25. I Don't Work at Facebook. My Doctors Want Me to Freeze My Eggs.
  Slate Plus
Tv Club
Oct. 20 2014 7:15 AM The Slate Doctor Who Podcast: Episode 9 A spoiler-filled discussion of "Flatline."
  Arts
Brow Beat
Oct. 20 2014 6:32 PM Taylor Swift’s Pro-Gay “Welcome to New York” Takes Her Further Than Ever From Nashville 
  Technology
Future Tense
Oct. 20 2014 4:59 PM Canadian Town Cancels Outdoor Halloween Because Polar Bears
  Health & Science
Medical Examiner
Oct. 20 2014 11:46 AM Is Anybody Watching My Do-Gooding? The difference between being a hero and being an altruist.
  Sports
Sports Nut
Oct. 20 2014 5:09 PM Keepaway, on Three. Ready—Break! On his record-breaking touchdown pass, Peyton Manning couldn’t even leave the celebration to chance.