Should we be worried that our cars are controlled by software?

Innovation, the Internet, gadgets, and more.
Feb. 16 2010 4:03 PM

I'm Sorry, Dave, I'm Afraid I Can't Make a U-Turn

Should we be worried that our cars are controlled by software?

Also in Slate, Tom Vanderbilt explains why bad drivers are more dangerous than bum Toyotas.

(Continued from Page 1)

Software is also inevitably buggy. In very complex systems, engineers regard errors as inevitable. At Microsoft, an OS is considered ready for sale when engineers determine it has fewer than 500 known bugs. And those are just the bugs we know about. Software is hard to test, and errors are sometimes impossible to find in advance. Computers can do so many things at the same time—and so many different things in response to various inputs—that we usually have no idea what they'll do in a given real-world situation. Toyota has hired an independent engineering firm to examine the electronic throttle in its cars. But in the same way that it's often impossible to reproduce the combination of errors that just crashed your PC, these analysts won't be able to go through every situation that might cause the throttle to fail on the road. That's just the price of adding software to cars. Computers make vehicles more complex, and uncertainty is an inevitable cost of complexity. As Donald Rumsfeld might say, you get a lot more unknown unknowns.

But are we human beings much better? We fail in certain predictable, repeatable, and easily preventable ways. We drive too fast or too slowly for certain road conditions. We drive while distracted, intoxicated, or sleepy. We let people drive when they're too young and too old. Our sensory perception is limited—we have blind spots, we can't process simultaneous stimuli, and we can't accurately judge changing road conditions. We're also given to irrationality, letting our emotions take over while we're driving a dangerous machine.


There have been lots of studies looking into the causes of traffic accidents. They all come to the same conclusion—the overwhelming reason we get in crashes is driver error. The best thing about the computerization of cars, then, is precisely the thing we find most terrifying: Software is beginning to override human control. We are the most dangerous parts of the cars we drive. The less driving people do, the fewer people will die on the roads.

Software is already starting to step in for human beings who fail on the road. Many cars now come equipped with autonomous cruise control, systems that use laser or radar to determine if your car is getting too close to other vehicles and automatically slow you down if you are. We've also got electronic stability control—a computer constantly monitors your wheels to determine if you're skidding and steers you back on course if necessary.

Is it scary that we're putting in systems that let computers override human judgment? Only if you believe that human judgment is infallible. I don't. Sure, it's unnerving that a computer is now running my car. But I'm sure glad it's running yours.

Become a fan of Farhad Manjoo on Facebook.



Blacks Don’t Have a Corporal Punishment Problem

Americans do. But when blacks exhibit the same behaviors as others, it becomes part of a greater black pathology. 

I Bought the Huge iPhone. I’m Already Thinking of Returning It.

Scotland Is Just the Beginning. Expect More Political Earthquakes in Europe.

Lifetime Didn’t Think the Steubenville Rape Case Was Dramatic Enough

So they added a little self-immolation.

Two Damn Good, Very Different Movies About Soldiers Returning From War

Medical Examiner

The Most Terrifying Thing About Ebola 

The disease threatens humanity by preying on humanity.

Students Aren’t Going to College Football Games as Much Anymore, and Schools Are Getting Worried

The Good Wife Is Cynical, Thrilling, and Grown-Up. It’s Also TV’s Best Drama.

  News & Politics
Sept. 19 2014 9:15 PM Chris Christie, Better Than Ever
Business Insider
Sept. 20 2014 6:30 AM The Man Making Bill Gates Richer
Sept. 20 2014 7:27 AM How Do Plants Grow Aboard the International Space Station?
  Double X
The XX Factor
Sept. 19 2014 4:58 PM Steubenville Gets the Lifetime Treatment (And a Cheerleader Erupts Into Flames)
  Slate Plus
Slate Picks
Sept. 19 2014 12:00 PM What Happened at Slate This Week? The Slatest editor tells us to read well-informed skepticism, media criticism, and more.
Brow Beat
Sept. 19 2014 4:48 PM You Should Be Listening to Sbtrkt
Future Tense
Sept. 19 2014 6:31 PM The One Big Problem With the Enormous New iPhone
  Health & Science
Bad Astronomy
Sept. 20 2014 7:00 AM The Shaggy Sun
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.