Should we be worried that our cars are controlled by software?

Innovation, the Internet, gadgets, and more.
Feb. 16 2010 4:03 PM

I'm Sorry, Dave, I'm Afraid I Can't Make a U-Turn

Should we be worried that our cars are controlled by software?

Also in Slate, Tom Vanderbilt explains why bad drivers are more dangerous than bum Toyotas.

(Continued from Page 1)

Software is also inevitably buggy. In very complex systems, engineers regard errors as inevitable. At Microsoft, an OS is considered ready for sale when engineers determine it has fewer than 500 known bugs. And those are just the bugs we know about. Software is hard to test, and errors are sometimes impossible to find in advance. Computers can do so many things at the same time—and so many different things in response to various inputs—that we usually have no idea what they'll do in a given real-world situation. Toyota has hired an independent engineering firm to examine the electronic throttle in its cars. But in the same way that it's often impossible to reproduce the combination of errors that just crashed your PC, these analysts won't be able to go through every situation that might cause the throttle to fail on the road. That's just the price of adding software to cars. Computers make vehicles more complex, and uncertainty is an inevitable cost of complexity. As Donald Rumsfeld might say, you get a lot more unknown unknowns.

But are we human beings much better? We fail in certain predictable, repeatable, and easily preventable ways. We drive too fast or too slowly for certain road conditions. We drive while distracted, intoxicated, or sleepy. We let people drive when they're too young and too old. Our sensory perception is limited—we have blind spots, we can't process simultaneous stimuli, and we can't accurately judge changing road conditions. We're also given to irrationality, letting our emotions take over while we're driving a dangerous machine.


There have been lots of studies looking into the causes of traffic accidents. They all come to the same conclusion—the overwhelming reason we get in crashes is driver error. The best thing about the computerization of cars, then, is precisely the thing we find most terrifying: Software is beginning to override human control. We are the most dangerous parts of the cars we drive. The less driving people do, the fewer people will die on the roads.

Software is already starting to step in for human beings who fail on the road. Many cars now come equipped with autonomous cruise control, systems that use laser or radar to determine if your car is getting too close to other vehicles and automatically slow you down if you are. We've also got electronic stability control—a computer constantly monitors your wheels to determine if you're skidding and steers you back on course if necessary.

Is it scary that we're putting in systems that let computers override human judgment? Only if you believe that human judgment is infallible. I don't. Sure, it's unnerving that a computer is now running my car. But I'm sure glad it's running yours.

Become a fan of Farhad Manjoo on Facebook.



The Democrats’ War at Home

How can the president’s party defend itself from the president’s foreign policy blunders?

Congress’ Public Shaming of the Secret Service Was Political Grandstanding at Its Best

Michigan’s Tradition of Football “Toughness” Needs to Go—Starting With Coach Hoke

A Plentiful, Renewable Resource That America Keeps Overlooking

Animal manure.

Windows 8 Was So Bad That Microsoft Will Skip Straight to Windows 10


Cringing. Ducking. Mumbling.

How GOP candidates react whenever someone brings up reproductive rights or gay marriage.

Building a Better Workplace

You Deserve a Pre-cation

The smartest job perk you’ve never heard of.

Hasbro Is Cracking Down on Scrabble Players Who Turn Its Official Word List Into Popular Apps

Florida State’s New President Is Underqualified and Mistrusted. He Just Might Save the University.

  News & Politics
Sept. 30 2014 9:33 PM Political Theater With a Purpose Darrell Issa’s public shaming of the head of the Secret Service was congressional grandstanding at its best.
Sept. 30 2014 7:02 PM At Long Last, eBay Sets PayPal Free
Sept. 30 2014 7:35 PM Who Owns Scrabble’s Word List? Hasbro says the list of playable words belongs to the company. Players beg to differ.
  Double X
The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
  Slate Plus
Behind the Scenes
Sept. 30 2014 3:21 PM Meet Jordan Weissmann Five questions with Slate’s senior business and economics correspondent.
Brow Beat
Sept. 30 2014 8:54 PM Bette Davis Talks Gender Roles in a Delightful, Animated Interview From 1963
Future Tense
Sept. 30 2014 7:00 PM There’s Going to Be a Live-Action Tetris Movie for Some Reason
  Health & Science
Medical Examiner
Sept. 30 2014 11:51 PM Should You Freeze Your Eggs? An egg freezing party is not a great place to find answers to this or other questions.
Sports Nut
Sept. 30 2014 5:54 PM Goodbye, Tough Guy It’s time for Michigan to fire its toughness-obsessed coach, Brady Hoke.