The case against peer review.

Health and medicine explained.
April 5 2005 2:03 PM

Quality Control

The case against peer review.

(Continued from Page 1)

More sweeping changes have also been suggested. Well-trained, full-time editors and professional statisticians might be able to perform the functions of peer review on their own. Or scientists en masse might be recruited: Paul Ginsparg, who runs a digital archive for unpublished physics papers, has suggested that putting "preprints" of scientific papers on the Web could let the community as a whole decide which papers are most useful. Unpublished work could be tracked by an objective measure—like how often it's cited or downloaded—and then passed along for formal publication. Government funders like the NIH could hire professional reviewers to evaluate grants, or they could replace grants with cash prizes for successful research.

When journal editors are asked about these ideas, they often quote Winston Churchill's line, "Democracy is the worst form of government except all those other forms that have been tried from time to time." Or rather, they quote other journal editors quoting that line. But it's a poor analogy, since few alternatives to peer review have been tried in modern times. And democracy isn't really a good description of peer review, either. Sure, peer review allows scientists to participate in a system of self-governance. But wouldn't BMJ's policy of open review or Ginsparg's proposal for Web-published preprints be far more democratic?

Advertisement

So far, though, the Churchill quoters are winning. A good study of peer review will take more than a small band of outsiders working part time with little money. We need a coordinated effort by scientific journals, funding agencies, and research scientists. It wouldn't be that expensive. But the funds have not been forthcoming. Instead, the federal government recently proposed using peer review "to improve the quality, objectivity, utility, and integrity of information" that it gives to the publicfor things like FDA drug requirements and HHS dietary guidelines. Ironically, most scientists hated the idea  when it was first presented; the original version of the proposal stated that only researchers from private industry, who don't receive federal funding, would get to participate. (That provision has since been eliminated. *) But forget arguing over the details of peer review. Let's first figure out whether it works.

Correc tion, April 8, 2005: The original version of this column missated a provision of the federal government's proposal on peer review. The revised version of the proposal would allow federally funded scientists to participate.

TODAY IN SLATE

Justice Ginsburg’s Crucial Dissent in the Texas Voter ID Case

Even When They Go to College, the Poor Sometimes Stay Poor

Here’s Just How Far a Southern Woman May Have to Drive to Get an Abortion

The Most Ingenious Teaching Device Ever Invented

Marvel’s Civil War Is a Far-Right Paranoid Fantasy

It’s also a mess. Can the movies do better?

Behold

Sprawl, Decadence, and Environmental Ruin in Nevada

Space: The Next Generation

An All-Female Mission to Mars

As a NASA guinea pig, I verified that women would be cheaper to launch than men.

Watching Netflix in Bed. Hanging Bananas. Is There Anything These Hooks Can’t Solve?

The Procedural Rule That Could Prevent Gay Marriage From Reaching SCOTUS Again

  News & Politics
Politics
Oct. 20 2014 3:53 PM Smash and Grab Will competitive Senate contests in Kansas and South Dakota lead to more late-breaking races in future elections?
  Business
Continuously Operating
Oct. 20 2014 3:40 PM Keeping It in the Family Why are so many of the world’s oldest companies in Japan?
  Life
Outward
Oct. 20 2014 3:16 PM The Catholic Church Is Changing, and Celibate Gays Are Leading the Way
  Double X
The XX Factor
Oct. 20 2014 1:10 PM Women Are Still Losing Jobs for Getting Pregnant
  Slate Plus
Tv Club
Oct. 20 2014 7:15 AM The Slate Doctor Who Podcast: Episode 9 A spoiler-filled discussion of "Flatline."
  Arts
Brow Beat
Oct. 20 2014 5:03 PM Marcel the Shell Is Back and as Endearing as Ever
  Technology
Future Tense
Oct. 20 2014 4:59 PM Canadian Town Cancels Outdoor Halloween Because Polar Bears
  Health & Science
Medical Examiner
Oct. 20 2014 11:46 AM Is Anybody Watching My Do-Gooding? The difference between being a hero and being an altruist.
  Sports
Sports Nut
Oct. 20 2014 5:09 PM Keepaway, on Three. Ready—Break! On his record-breaking touchdown pass, Peyton Manning couldn’t even leave the celebration to chance.