Bill James urges his colleagues to boycott the BCS.

Previously published Slate articles made new.
Jan. 6 2010 4:11 PM

Boycott the BCS!

A statistical analyst takes a stand against college football's perverse, irrational Bowl Championship Series.

(Continued from Page 1)

This is reflected in the fact that the rankings are routinely described as "computer" rankings. Computers, like automobiles and airplanes, do only what people tell them to do. If you're driving to Cleveland and you get lost and wind up in Youngstown, you don't blame your car. If you're doing a ranking system and you wind up with Murray State in western Kentucky as the national football champion, you don't blame the computer.

There are several things that a ranking system could do. It could rank teams based on their accomplishments over the course of the season—whom they played and whom they beat—or it could rank them based on the probability that they would win against a given opponent. It could rank teams based on how they have played over the course of the season, including perhaps in some early-season games against teams that were not quite sure who their quarterback was, or it could rank them based on how strong they are at the end of the season. It could rank the teams based on consistency, or it could rank them based on dominance.


Which of these is the goal of the BCS system?

Nobody has any idea. It's never been debated. There is a perception among the people who are in charge of this monkey that if you just turn the rankings over to a computer, the computer will figure those things out. The reality is that it can't. It is very difficult to objectively measure anything if you don't know what it is you are measuring.

2. There is no genuine interest here in using statistical analysis to figure out how the teams compare with one another. The real purpose is to create some gobbledygook math to endorse the coaches' and sportswriters' vote.

Throughout the 11 years of the BCS, whenever the "computer" rankings have diverged markedly from the polls, the consensus reaction has been, we have to do something about those computers. And they have; whenever the computer rankings don't jibe with the "human polls," they fix the computers. In 2000, the computers didn't pick Miami as one of the top two teams. The coaches and sportswriters thought Miami should have been there, so they changed the computer system.

In 2001, according to Stern, "the BCS selected once-beaten Nebraska over once-beaten Oregon despite the fact that Nebraska had lost badly in their last regular season game. Popular perception this time was that the computer ratings paid too much attention to the large margin of victory in Nebraska's early season triumphs while not putting enough value on Oregon's steady but unspectacular performances." What did they do? Fix the computers. In 2003, the computer rankings once more disagreed with the coaches' and the fans' and the writers' perceptions, and so, once more, the computer rankings were fixed to prevent a recurrence of whatever the problem was.

3. The ground rules of the calculations are irrational and prevent the statisticians from making any meaningful contribution.

One of the polls used in the BCS system is the Peter Wolfe rankings—no Prokofiev jokes, please. According to Wolfe's Web site, "A significant but hard-to-measure factor in comparing teams is sportsmanship. Running up the score is generally looked on as evidence of bad sportsmanship, behavior which should not be encouraged or rewarded. With this in mind, the BCS has chosen computer systems that use only won/loss data (and not scoring margin) to compute ratings. We have developed such a system that provides reasonable results."

I don't question that Wolfe is a good man doing the best he can within the BCS strictures, but this is childish pablum. The prohibition against using point differentials to rank teams, of course, dates from the Nebraska-in-2001 experience, when those dirty Cornhuskers beat Troy State, Rice, Missouri, Iowa State, Baylor, and Kansas all by 28 points or more. The BCS reacted to this by requiring the computer rankings to treat a 56-7 victory the same as a 20-17 contest.

This is very much like a situation in which a surgeon leaves a scalpel in a patient, and the hospital reacts by prohibiting surgeons from using scalpels. I understand that the point of the game is to win, not to score as many points as possible, and I certainly can understand football coaches saying, "We want a system that emphasizes winning and diminishes the importance of the score." That's reasonable.

But saying, "We're not going to pay any attention to the score of the game, and, by the way, you can't pay any attention to whether it is a home game or a road game, either"—that's just stupid, Gomer. For football coaches to impose a rule like that on the statistical analysts is very much like the AD, frustrated by seeing long passes intercepted, telling the football coach he can't throw passes longer than 10 yards.

Look, guys, none of us are claiming that the statistical analysts understand the game of football as well as the football coaches do, or that our analysis should take precedence over the informed opinions of experts. I'm not saying that at all.

But at the same time, statistical analysts are professional people. Heck, some of us are almost as smart as football coaches—high-school football coaches, anyway. There is no point in our participating in the process if you're going to tell us how to do the analysis based on your ignorant, backward-looking prejudices. Run your own damned computers.


Sports Nut

Grandmaster Clash

One of the most amazing feats in chess history just happened, and no one noticed.

The Extraordinary Amicus Brief That Attempts to Explain the Wu-Tang Clan to the Supreme Court Justices

Amazon Is Officially a Gadget Company. Here Are Its Six New Devices.

How Much Should You Loathe NFL Commissioner Roger Goodell?

Here are the facts.

Amazon Is Officially a Gadget Company


The Human Need to Find Connections in Everything

It’s the source of creativity and delusions. It can harm us more than it helps us.


How to Order Chinese Food

First, stop thinking of it as “Chinese food.”

Scotland Is Inspiring Secessionists Across America

You Shouldn’t Spank Anyone but Your Consensual Sex Partner

Sept. 17 2014 5:10 PM The Most Awkward Scenario in Which a Man Can Hold a Door for a Woman
  News & Politics
Sept. 18 2014 10:42 AM Scalia’s Liberal Streak The conservative justice’s most brilliant—and surprisingly progressive—moments on the bench.
Business Insider
Sept. 17 2014 1:36 PM Nate Silver Versus Princeton Professor: Who Has the Right Models?
Sept. 18 2014 11:25 AM Gays on TV: From National Freakout to Modern Family Fun
  Double X
The XX Factor
Sept. 18 2014 12:03 PM The NFL Opines on “the Role of the Female”
  Slate Plus
Slate Fare
Sept. 17 2014 9:37 AM Is Slate Too Liberal?  A members-only open thread.
Brow Beat
Sept. 18 2014 11:48 AM Watch the Hilarious First Sketch From Season 4 of Key & Peele
Future Tense
Sept. 18 2014 10:07 AM “The Day It All Ended” A short story from Hieroglyph, a new science fiction anthology.
  Health & Science
Bad Astronomy
Sept. 18 2014 7:30 AM Red and Green Ghosts Haunt the Stormy Night
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.