Should the sports world replace human umpires with computers?

Innovation, the Internet, gadgets, and more.
Sept. 2 2008 4:48 PM

Hey, Robot Ref! Are You Blind?

Should the sports world replace human umpires with computers?

(Continued from Page 1)

It isn't terrible that Hawk-Eye is sometimes wrong—after all, humans often make mistakes. What is odd, though, is that the system's designer, Hawk-Eye Innovations, has never explained these failures or how the system arrives at its decisions. Hawk-Eye uses up to six cameras placed around the court, but the graphic that it shows to judges and to viewers on TV does not include actual footage from any of those cameras. Instead, the system creates a composite of what it thinks happened to the ball. Collins and Evans argue that these composites subtly trick viewers. The simulation takes on an air of reality, even infallibility, when in fact it is only a statistical estimate. At the very least, the researchers say, Hawk-Eye should report its confidence—that it is X percent sure of its ruling. They also push for a more general "health warning": When CBS broadcasts Hawk-Eye simulations on TV, it should remind viewers: "This is only a virtual representation of reality. It's not what actually happened."

Those who call for increased use of instant replay in sports often point to major mistakes by umps. Every sport has its signal event, the blown call that proves that refs would do better with video backup. In baseball, it's Game 1 of the 1996 American League Championship Series between the Yankees and the Orioles. In the bottom of the eighth with the Yankees trailing, Derek Jeter hit a fly ball to right field. Richie Garcia, the right-field ump, watched Baltimore outfielder Tony Tarasco leap to make the catch. When Tarasco missed the ball, Garcia thought it was clear that the ball had gone over the fence—if it wasn't in Tarasco's glove, where else could it be? But everyone at home saw something else on that play: A 12-year-old kid named Jeffrey Maier had reached over the fence with his glove and deflected the ball into the stands. Garcia watched the replay after the game—which the Yankees went on to win—and was shocked at the sight of the kid. "Where did he come from?" Garcia said later. "I didn't see him standing there. I never saw that."

Advertisement

The replay system that baseball just installed probably would've gotten that call right. But why stop there? As instant replay becomes a generally accepted part of the game, players and fans are sure to press for more reviews. A system of sensors and cameras could conceivably be used to decide whether a runner is safe at first, for instance. Given that a blown call at first base once decided the World Series, you can imagine that fans might soon be calling for software to make those calls, too.

Stray too far beyond that simple case, though, and it's difficult to imagine software taking over. Tennis—with its two players, small field of play, and bright-line demarcation between balls that are in and balls that are out—is a comparatively easy sport for computers to umpire. In other sports, refs have to take into account many more variables before making a call. To be able to tell whether a football runner is down before he fumbled, for example, a computer would have to somehow keep track of every player, which one has the ball, when the player with the ball gets hit, and when and how the ball comes loose. That task would likely require an array of sensors and sophisticated image-processing techniques—probably not yet a possibility.

Beyond the technological obstacles, the age of Hawk-Eye presents a larger philosophical problem. Sometimes the computer makes a call that no human—not the fans, not the umps, not the players—can quite understand. Late in the 2007 Wimbledon final between Rafael Nadal and Roger Federer, Nadal hit a deep ball that Federer let go, thinking it was out. The umpire thought so, too, and TV replays showing the ball from Federer's side seemed to confirm it—the ball looked a good half-inch out. But when Nadal challenged the call, Hawk-Eye called the ball in. On the Hawk-Eye Innovations Web site, the company's representatives posted an explanation (PDF) that blames the dispute on the limited perceptive capacities of TV cameras and human eyeballs. When a tennis ball smashes into grass at high speeds, it compresses, skids for 10 centimeters or so, and then takes off, the company said. Hawk-Eye's fast cameras were sensitive enough to see the ball just clip the base line, while TV cameras and viewers caught only a blur while the ball skidded away from the line, making them think the ball was out.

Got that, then? Because it's so perceptive, Hawk-Eye makes obsolete every assessment tool that humans have ever used to adjudicate sports disputes: our eyes, our TV cameras, even perceptible marks on the ground. In their paper, Collins and Evans argue that this is too precise. By erasing all of tennis' ties to human perception, Hawk-Eye renders the game interpretable only to computers. That's fairly ridiculous: After all, computers aren't paying to see two human beings hit a ball over a net. People are.

TODAY IN SLATE

History

The Self-Made Man

The story of America’s most pliable, pernicious, irrepressible myth.

The GOP Senate Candidate in Iowa Doesn’t Want Voters to Know Just How Conservative She Really Is

Does Your Child Have “Sluggish Cognitive Tempo”? Or Is That Just a Disorder Made Up to Scare You?

Naomi Klein Is Wrong

Multinational corporations are doing more than governments to halt climate change.

The Strange History of Wives Gazing at Their Husbands in Political Ads

Television

See Me

Transparent is the fall’s only great new show.

Doublex

Lena Dunham, the Book

More shtick than honesty in Not That Kind of Girl.

Rehtaeh Parsons Was the Most Famous Victim in Canada. Now, Journalists Can’t Even Say Her Name.

Parents, Get Your Teenage Daughters the IUD

The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
Moneybox
Sept. 30 2014 12:04 PM John Hodgman on Why He Wore a Blue Dress to Impersonate Ayn Rand
  News & Politics
Politics
Sept. 30 2014 1:38 PM Mad About Modi
 Why the controversial Indian prime minister drew 19,000 cheering fans to Madison Square Garden.

  Business
Building a Better Workplace
Sept. 30 2014 1:16 PM You Deserve a Pre-cation The smartest job perk you’ve never heard of.
  Life
Education
Sept. 30 2014 1:48 PM Thrashed Florida State’s new president is underqualified and mistrusted. But here’s how he can turn it around.
  Double X
The XX Factor
Sept. 30 2014 12:34 PM Parents, Get Your Teenage Daughters the IUD
  Slate Plus
Slate Picks
Sept. 30 2014 11:42 AM Listen to Our September Music Roundup Hot tracks from a cooler month, exclusively for Slate Plus members.
  Arts
Brow Beat
Sept. 30 2014 12:42 PM How to Save Broken Mayonnaise
  Technology
Future Tense
Sept. 30 2014 11:55 AM The Justice Department Is Cracking Down on Sales of Spyware Used in Stalking
  Health & Science
Bad Astronomy
Sept. 30 2014 7:30 AM What Lurks Beneath the Methane Lakes of Titan?
  Sports
Sports Nut
Sept. 28 2014 8:30 PM NFL Players Die Young. Or Maybe They Live Long Lives. Why it’s so hard to pin down the effects of football on players’ lives.