Sketch recognition program can guess what you're drawing as you draw it

Can a Computer Program Beat You at Pictionary?

Trending News Channel
Videos Highlighting The Latest Search Trends.
Sept. 14 2012 5:30 PM

Can a Computer Program Beat You at Pictionary?

1347656300259

It may not know much about art, but it knows what it sees.

Computer researchers have developed a program that can recognize and identify rough, hand-drawn sketches, even as they are being created. Enlisting the limited artistic skills of everyday doodlers through Amazon's labor-outsourcing site, Mechanical Turk, the programmers received 20,000 sketches, which they collated into 256 object categories and fed to the computer as a recognition database. The team then created software that, using these object categories as reference, attempts to identify a scribble as it is being drawn.

Pretty impressive. But you can still crush it in Pictionary. The digital doodle ID’er has about a 56-percent success rate in pegging pen scratch, compared to a human's nearly 75 percent. This gap is due to the limited 256-category knowledge, which the programmers say can be expanded.

Beyond some serious gaming potential, the program could be used down the road in universal, translation-free search applications, on the theory that worldwide, a bunny rabbit is a bunny rabbit.

  Slate Plus
Politics
May 22 2015 11:14 AM What Happened at Slate This Week? Assistant interactives editor Andrew Kahn on the best of Slate, from the history of slavery to Mad Men.
  Health & Science
Science
May 22 2015 11:56 AM Spider Skies Why are millions of Australian spiders climbing to high points and jumping?