Who the Hell Cares if IBM's Watson Swears?

The Citizen's Guide to the Future
Jan. 10 2013 6:28 PM

Who the Hell Cares if IBM's Watson Swears?

108024371
IBM's Watson computing system at a press conference in 2011, before it appeared on Jeopardy!

Photo by Ben Hider/Getty Images

IBM’s Watson was a great fit for Jeopardy!. The machine, which took home the show’s $1 million prize in 2011, had the supreme intellect we’ve come to expect from Jeopardy! contestants—after all, it was designed specifically to answer the show’s questions. But it looks like Watson took a turn for the worse when researchers tried to teach it the intricacies of Internet slang by uploading the entirety of Urban Dictionary to its memory. What could possibly go wrong?

Arming Watson with this vast resource of vulgarity went about as you’d expect. It couldn’t tell which words in this fascinating new lexicon were appropriate for normal use—according to an account from Fortune magazine, Watson used the word “bullshit” in one answer to a query. Researchers promptly swept Urban Dictionary from its memory, and now Watson has a filter to prevent it from using profanity.

Advertisement

But it might be a good thing if Watson dropped an f-bomb every now and then. The whole endeavor was an exercise in beating the Turing test, which examines a machine’s ability to imitate a human’s written language capabilities. If Watson were to chat with a human, and that person couldn’t tell whether her correspondent was man or machine, then Watson would pass the test. To do that, as IBM scientist Eric Brown tells Fortune, Watson needs to know the subtleties of netspeak.

It’s unusual to talk on Gchat without an occasional “lol,” and many of the words and acronyms we use without thinking could trip up a machine that doesn’t understand them. They trip up people all the time, and Urban Dictionary is the best place to get a quick understanding.

In 2010, IBM’s David Ferrucci told the New York Times that Watson relies on “any kind of reference material you can imagine getting your hands on or licensing.” That includes millions of documents from dictionaries, encyclopedias, bibles, and literature—and it should include Urban Dictionary. Traditional reference works are all too slow (and perhaps too high-brow) to keep up with the language you might drop in a chat window.

Now, Urban Dictionary’s characteristic trait is going way too far on just about everything. With 6.9 million definitions and who knows how many completely made up words, there’s plenty to confuse even the smartest being. Even if Watson learns all these words, though, how often is it really going to have the chance to use a term like “Cosby sweater”? (Seriously, though, click that link at your own risk.)

If Watson’s going to pass the Turing test, I expect it to appreciate the full value of my OMG. And if it needs to call out my bullshit to do that? Well, that’d be a big win, too.

Future Tense is a partnership of SlateNew America, and Arizona State University.

TODAY IN SLATE

Medical Examiner

Here’s Where We Stand With Ebola

Even experienced international disaster responders are shocked at how bad it’s gotten.

It Is Very, Very Stupid to Compare Hope Solo to Ray Rice

The U.S. Is So, So Far Behind Europe on Clean Energy

Even if You Don’t Like Batman, You Might Like Gotham

Friends Was the Last Purely Pleasurable Sitcom

The Eye

This Whimsical Driverless Car Imagines Transportation in 2059

Politics

Meet the New Bosses

How the Republicans would run the Senate.

A Woman Who Escaped the Extreme Babymaking Christian Fundamentalism of Quiverfull

So, Apple Is Not Shuttering Beats, but the Streaming Service Will Probably Be Folded Into iTunes

  News & Politics
Politics
Sept. 22 2014 6:30 PM What Does It Mean to Be an American? Ted Cruz and Scott Brown think it’s about ideology. It’s really about culture.
  Business
Moneybox
Sept. 22 2014 5:38 PM Apple Won't Shut Down Beats Music After All (But Will Probably Rename It)
  Life
Outward
Sept. 22 2014 4:45 PM Why Can’t the Census Count Gay Couples Accurately?
  Double X
Doublex
Sept. 22 2014 4:06 PM No, Women’s Soccer Does Not Have a Domestic Violence Problem Or, why it is very, very stupid to compare Hope Solo to Ray Rice.
  Slate Plus
Slate Plus
Sept. 22 2014 1:52 PM Tell Us What You Think About Slate Plus Help us improve our new membership program.
  Arts
Brow Beat
Sept. 22 2014 5:45 PM The University of California Corrects “Injustice” by Making Its Rich Chancellors Even Richer
  Technology
Future Tense
Sept. 22 2014 6:27 PM Should We All Be Learning How to Type in Virtual Reality?
  Health & Science
Medical Examiner
Sept. 22 2014 4:34 PM Here’s Where We Stand With Ebola Even experienced international disaster responders are shocked at how bad it’s gotten.
  Sports
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.