An Ice Cream-Serving Robot May Be a Huge A.I. Breakthrough

Analyzing the top news stories across the web
June 28 2014 7:00 AM

An Ice Cream-Serving Robot May Be a Huge A.I. Breakthrough

134260848-robotics-student-gildo-andreoni-interacts-with-a
A spark of understanding?

Photo by Oli Scarff/Getty Images

This post first appeared in Business Insider.

Robots need some very specific instructions in order to successfully accomplish tasks. If you want a robot to bring you a beer while you recline on the couch, it needs to know what a beer is, that a beer is in a refrigerator, what a refrigerator looks like, how to open said fridge, and so on. It's tedious!

Humans can't possibly provide all this context with a simple verbal request, so Ashutosh Saxena and researchers at Cornell University's Robot Learning Lab aim to help bridge this communication gap with a project called "Tell Me Dave."

Saxena's robot, equipped with a 3-D camera, scans its environment and identifies the objects in it, using computer vision software previously developed in Saxena's lab. The robot has been trained to associate objects with their capabilities: A pan can be poured into or poured from; stoves can have other objects set on them, and can heat things. So the robot can identify the pan, locate the water faucet and stove and incorporate that information into its procedure. If you tell it to "heat water" it can use the stove or the microwave, depending on which is available. And it can carry out the same actions tomorrow if you've moved the pan, or even moved the robot to a different kitchen.
Advertisement

Put another way, instead of hard-coding numerous processes that are effortless for a human but quite elaborate for robots (like grabbing a beer from the fridge), Saxena and crew have taught their PR2 bot to recognize various objects after being taught their traits. A microwave can be used to heat things, a bowl can hold water, a tap dispenses water, and so on. 

A quick verbal request to heat up a bowl of water, let's say, is now completely within a robot's purview despite the usually robot-beating lack of info associated with such a statement—a robot now "knows" how to fill in the steps missing from the request.

As a demonstration of this ability, the video below demonstrates a robot filling a rather open-ended ice cream order: "Take some coffee in a cup. Add ice cream of your choice. Finally, add raspberry syrup to the mixture." This is more or less how we imagine we'd speak to a robot in a sci-fi movie. It takes the robot some time, but soon enough: affogato!

Dylan Love is a writer for Business Insider. Follow him on Twitter.

TODAY IN SLATE

Politics

The Democrats’ War at Home

How can the president’s party defend itself from the president’s foreign policy blunders?

Congress’ Public Shaming of the Secret Service Was Political Grandstanding at Its Best

Michigan’s Tradition of Football “Toughness” Needs to Go—Starting With Coach Hoke

A Plentiful, Renewable Resource That America Keeps Overlooking

Animal manure.

Windows 8 Was So Bad That Microsoft Will Skip Straight to Windows 10

Politics

Cringing. Ducking. Mumbling.

How GOP candidates react whenever someone brings up reproductive rights or gay marriage.

Building a Better Workplace

You Deserve a Pre-cation

The smartest job perk you’ve never heard of.

Hasbro Is Cracking Down on Scrabble Players Who Turn Its Official Word List Into Popular Apps

Florida State’s New President Is Underqualified and Mistrusted. He Just Might Save the University.

  News & Politics
Politics
Sept. 30 2014 9:33 PM Political Theater With a Purpose Darrell Issa’s public shaming of the head of the Secret Service was congressional grandstanding at its best.
  Business
Moneybox
Sept. 30 2014 7:02 PM At Long Last, eBay Sets PayPal Free
  Life
Gaming
Sept. 30 2014 7:35 PM Who Owns Scrabble’s Word List? Hasbro says the list of playable words belongs to the company. Players beg to differ.
  Double X
The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
  Slate Plus
Behind the Scenes
Sept. 30 2014 3:21 PM Meet Jordan Weissmann Five questions with Slate’s senior business and economics correspondent.
  Arts
Brow Beat
Sept. 30 2014 8:54 PM Bette Davis Talks Gender Roles in a Delightful, Animated Interview From 1963
  Technology
Future Tense
Sept. 30 2014 7:00 PM There’s Going to Be a Live-Action Tetris Movie for Some Reason
  Health & Science
Medical Examiner
Sept. 30 2014 11:51 PM Should You Freeze Your Eggs? An egg freezing party is not a great place to find answers to this or other questions.
  Sports
Sports Nut
Sept. 30 2014 5:54 PM Goodbye, Tough Guy It’s time for Michigan to fire its toughness-obsessed coach, Brady Hoke.