Are Humanoid Robots To Blame When They Make Mistakes?

The Citizen's Guide to the Future
April 23 2012 3:54 PM

Are Humanoid Robots To Blame When They Make Mistakes?

Sometime in the future, you decide to buy a humanoid robot. It can perform chores, maybe even help out with care for children or an elderly relative. You and your family know it’s a machine, but you’ve come to identify with it. You’ve named it. You may even speak to it, like a pet, when no one else is around. But the first time it makes a mistake and, say, drops a dish it’s putting away, how will you react? Is the machine culpable?

Torie Bosch Torie Bosch

Torie Bosch is the editor of Future Tense, a project of Slate, the New America Foundation, and Arizona State that looks at the implications of new technologies. 

That’s the question guiding a new paper, “Do People Hold a Humanoid Robot Morally Accountable for the Harm It Causes?” (PDF), which was presented last month at the Human-Robot Interaction conference in Boston.


In an experiment, undergraduate students were put in a room with a humanoid robot named Robovie (and, at some points in the interaction, a researcher). Robovie’s speech and movements were controlled, Wizard of Oz-style, by two operators in another room. After some carefully crafted chit-chat, Robovie directed the student in a scavenger hunt. If the student found at least seven of the requested objects, she would win $20. But the hunt was rigged: It would be difficult for a student not to find more than seven of the items—and regardless of the objects found, Robovie declared that he or she had failed to win the prize. Watch a "losing" participant argue with Robovie in a video provided by the University of Washington.

After receiving the (incorrect) bad news, the students were individually interviewed about their perceptions of the robot and whether it was responsible for its mistakes. Here’s what happened:

We found that 65% of the participants attributed some level of moral accountability to Robovie for the harm that Robovie caused the participant by unfairly depriving the participant of the $20.00 prize money that the participant had won. … [P]articipants held Robovie less accountable than they would a human but more accountable than they would a machine. Thus as robots gain increasing capabilities in language comprehension and production, and engage in increasingly sophisticated social interactions with people, it is likely that many people will hold a humanoid robot as partially accountable for a harm that it causes.

To evaluate the level of responsibility people assign to robots, it’s helpful to know how people categorize the machines. The researchers found:

When asked whether Robovie was a living being, a technology, or something in-between, participants were about evenly split between “in-between” (52.5%) and “technological” (47.5%). In contrast, when asked the same question about a vending machine and a human, 100% responded that the vending machine was “technological,” 90% said that a human was a “living being,” and 10% viewed a human as “in-between.”

I’m curious about the 10 percent who viewed humans as “in between.” Do they think that we are already cyborgs?

Future Tense is a partnership of SlateNew America, and Arizona State University.



More Than Scottish Pride

Scotland’s referendum isn’t about nationalism. It’s about a system that failed, and a new generation looking to take a chance on itself. 

iOS 8 Comes Out Today. Do Not Put It on Your iPhone 4S.

Why Greenland’s “Dark Snow” Should Worry You

Three Talented Actresses in Three Terrible New Shows

The Human Need to Find Connections in Everything

It’s the source of creativity and delusions. It can harm us more than it helps us.


Happy Constitution Day!

Too bad it’s almost certainly unconstitutional.

What Charles Barkley Gets Wrong About Corporal Punishment and Black Culture

My Father Was James Brown. I Watched Him Beat My Mother. Then I Married Someone Like Him.

  News & Politics
Sept. 17 2014 12:02 PM Here It Is: The Flimsiest Campaign Attack Ad of 2014, Which Won’t Stop Running
Business Insider
Sept. 17 2014 1:36 PM Nate Silver Versus Princeton Professor: Who Has the Right Models?
Atlas Obscura
Sept. 17 2014 1:46 PM A Salute to Defiant Scots on the Eve of Their Possible Secession
  Double X
The XX Factor
Sept. 17 2014 1:26 PM Hey CBS, Rihanna Is Exactly Who I Want to See on My TV Before NFL Football Games
  Slate Plus
Slate Fare
Sept. 17 2014 9:37 AM Is Slate Too Liberal?  A members-only open thread.
Brow Beat
Sept. 17 2014 1:01 PM A Rare, Very Unusual Interview With Michael Jackson, Animated
Future Tense
Sept. 17 2014 12:35 PM IOS 8 Comes Out Today. Do Not Put It on Your iPhone 4S.
  Health & Science
Bad Astronomy
Sept. 17 2014 11:18 AM A Bridge Across the Sky
Sports Nut
Sept. 15 2014 9:05 PM Giving Up on Goodell How the NFL lost the trust of its most loyal reporters.