David Ferrucci, lead researcher for IBM's Watson project, on designing a computer that can understand human language.

The most innovative and practical thinkers of our time.
Aug. 1 2011 12:52 PM

Computers Are Not Humans

David Ferrucci, lead researcher for IBM's Watson project, on designing a machine that can understand human language.

Slate's list of the 25 Americans who combine inventive genius and practicality—our best real-world problem solvers. Read more about how we chose them.

A general view of IBM's 'Watson' computing system at a press conference. Click image to expand.
IBM's Watson only scratches the surface of natural-language processing

Natural-language understanding is hard for a computer. Our beloved language looks like just a bunch of symbols to a computer, ultimately a long series of 0s and 1s. The meaning we associate with words, phrases, sentences, or entire compositions is grounded in human experience. We use language to capture and communicate human knowledge that makes sense only because of how the symbols in our language are grounded in a common experience.

For example, what does the word bat mean to you? I imagine lots of ideas are flying through your head, and you are wondering about the context in which these words are used and linking them to your personal experiences. As I give you more context, you may start to zero in on its intended meaning.

How about this: "The bat flew through the window."

Now at least you know that I am using bat as a noun and did not intend it to be a verb, as in "to bat around some ideas." But am I referring to a flying animal of the suborder Microchiroptera, or to a heavy stick used to hit a ball? More context is needed. If I added "and then Johnny came running home," then what would you think?

Our example with a bat is an easy one. Consider the word interesting. What does that conjure up for you? For me it may be very different, and yet we can both agree on the emotional or psychological response interestingness creates for people regardless of what they find interesting. This is uniquely human.

Human language is very rich. It can express the same idea in almost an infinite number of ways. Consider that these statements for purposes of diagnosis may be equivalent: 

The patient could not get anything down without pain.

The patient demonstrated persistent difficulty swallowing.

And that those statements contradict these other two:

The patient eats without discomfort.

The patient shows no signs of dysphagia.

Computers are not humans. They cannot map words and phrases to human experience and quickly look for the right contextual clues to understand precisely what is intended. All they have are the symbols, not their human meaning.

The challenge for  Watson, and more generally for natural-language-processing technologies, is to program computers to do a better job at understanding our language. Computers can process huge volumes of content quickly without getting tired. We are not that fast or enduring. The problem for computers is that so much of human knowledge is in natural-language content—from textbooks to blogs. It is not enough to deliver lists of thousands of documents that contain a few keywords. To help us, computers need to give us precise answers with meaningful justifications. They need to communicate in our terms rather than demand that we communicate in theirs. If we could program computers to more precisely interpret natural language the way we do, then we could leverage their speed to give us more precise and better justified responses based on enormous resources of knowledge that are simply out of our reach. This capability can dramatically advance business, society, and science in so many different areas.

The Watson you saw on Jeopardy! was built on decades of research and used a novel architecture and methodology for combining and advancing NLP and other AI techniques to deliver remarkable performance at a natural-language question-answering task. But it just scratched the surface. More work is needed to get computers to where they can deliver precise responses tailored to our information demands from the whole of human knowledge, whether it be in health care, science, education, or finance.

Return to Ferrucci's profile.

TODAY IN SLATE

Sports Nut

Grandmaster Clash

One of the most amazing feats in chess history just happened, and no one noticed.

The Extraordinary Amicus Brief That Attempts to Explain the Wu-Tang Clan to the Supreme Court Justices

Amazon Is Officially a Gadget Company. Here Are Its Six New Devices.

Do the Celebrities Whose Nude Photos Were Stolen Have a Case Against Apple?

The NFL Explains How It Sees “the Role of the Female”

Future Tense

Amazon Is Now a Gadget Company

Food

How to Order Chinese Food

First, stop thinking of it as “Chinese food.”

Scotland Is Inspiring Secessionists Across America

The Country Where Women Aren’t Allowed to Work Once They’re 36 Weeks’ Pregnant

The XX Factor
Sept. 18 2014 11:40 AM The Country Where Women Aren’t Allowed to Work Once They’re 36 Weeks’ Pregnant
Moneybox
Sept. 17 2014 5:10 PM The Most Awkward Scenario in Which a Man Can Hold a Door for a Woman
  News & Politics
The World
Sept. 18 2014 1:34 PM Americans Fault Obama for Giving Them Exactly the Anti-ISIS Strategy They Want
  Business
Business Insider
Sept. 17 2014 1:36 PM Nate Silver Versus Princeton Professor: Who Has the Right Models?
  Life
Doonan
Sept. 18 2014 2:00 PM On the Death of My Homophobic Dog I named him Liberace, but I couldn’t have chosen a less appropriate namesake for this coarse, emotionally withholding Norwich terrier.
  Double X
The XX Factor
Sept. 18 2014 12:03 PM The NFL Opines on “the Role of the Female”
  Slate Plus
Behind the Scenes
Sept. 18 2014 1:23 PM “It’s Not Everyday That You Can Beat the World Champion” An exclusive interview with chess grandmaster Fabiano Caruana.
  Arts
Brow Beat
Sept. 18 2014 2:03 PM Ryan Adams’ New Song Is a Reminder That He’s One of His Generation’s Best Songwriters
  Technology
Future Tense
Sept. 18 2014 1:24 PM Can the Celebrities Whose Photos Were Stolen Really Sue Apple? It may be harder to prove “harm” than it seems.
  Health & Science
Bad Astronomy
Sept. 18 2014 7:30 AM Red and Green Ghosts Haunt the Stormy Night
  Sports
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.