Forensic science is badly in need of reform. Here are some suggestions.

The law, lawyers, and the court.
Aug. 12 2008 12:43 PM


Forensic science is badly in need of reform. Here are some suggestions.

A forensic scientist.
How should forensic science be reformed?

Last week, the state of Mississippi terminated its 20-year relationship with medical examiner Dr. Steven Hayne. Hayne has come under fire from fellow medical examiners, criminal justice groups like the Innocence Project, and one of the authors of this article for his impossible workload, sloppy procedures, and questionable court testimony. In the early 1990s, Hayne and his frequent collaborator, now-disgraced forensic odontologist Dr. Michael West, helped secure murder convictions for Kennedy Brewer and Levon Brooks, both later proven innocent through DNA testing. The two were released from prison earlier this year.

Mississippi is hardly alone when it comes to bad forensic science. It now appears that Washington, D.C., may have to retry Angela O'Brien for the 2000 killing of her 2-year-old goddaughter, Brianna Blackmond, after revelations that the prosecution's star forensic witness, a physicist named Saami Shaibani, lied about his credentials in a Wisconsin murder case. These are only the most recent and dramatic examples of forensics fraud to make the headlines. Over the years, there have been plenty of other hucksters and charlatans happy to take advantage of the ignorance of juries, prosecutors, judges, and defense attorneys in very complicated and difficult-to-understand disciplines.


But the charlatans are only half the story. Courts have also missed plenty of mistakes from well-intentioned, conscientious scientists, too. In fact, these may be even more common—and harder to catch. Studies show that crime lab fiber, paint, and body fluid analyses, for example,  may consistently have error rates of 10 percent or higher. The error rate in fingerprint analysis is possibly between 1 percent  and 4 percent. And bite mark evidence is notoriously unreliable though still widely used. The Chicago Tribune reported in July that L. Thomas Johnson—one of forensic odontology's pioneers—has been attempting to use statistical models to shore up the reliability of this discredited field. But Johnson's efforts have been hampered by new DNA testing in a 1984 murder, which concluded that the man convicted of the crime was not the source of saliva found on the victim's sweater. Johnson testified for the prosecution in that case.

The use of forensic science in criminal trials is critically important. But reforms of the system are also desperately needed. It's not enough to weed out the incompetent scientists. We need to begin to monitor even the good ones. One major barrier to improving forensic evidence in criminal trials is that in most jurisdictions, the state has a monopoly on experts. Crime lab analysts and medical examiners (and to a lesser extent DNA technicians) typically work for the government and are generally seen as part of the prosecution's "team," much like the police and investigators. Yes, science is science, and it would be nice to believe that scientists will always get at the truth no matter whom they report to. But studies have consistently shown that even conscientious scientists can be affected by cognitive bias.

A scientist whose job performance is evaluated by a senior official in the district attorney or state attorney general's office may feel subtle pressure to return results that produce convictions. In cases in which district attorneys' offices contract work out to private labs, the labs may feel pressure—even if it's not explicit (though sometimes it is)—to produce favorable results in order to continue the relationship.

Cognitive bias can be even subtler. For some experts, merely knowing the details of a crime or discussing it with police or prosecutors beforehand can introduce significant bias to a lab technician's analysis.

A research team led by Seton Hall law professor Michael Risinger published a study in the January 2002 California Law Review identifying five stages of scientific analysis in which bias can affect even the most professional expert's opinion. The study was careful to note that these biases were unintentional and not the result of outright fraud. But according to the study, cognitive bias can factor into the ways in which a scientist observes the initial data, records that data, and makes calculations and also how he remembers and reinterprets his notes when preparing for trial—a problem that looms larger as time elapses between the lab work and trial testimony.

Most jurors aren't aware of any of these biases; in fact, most give enormous weight to expert witnesses. Even out-and-out frauds like West and Shaibani can persuade jurors if they're presented in court as reputable experts, appear likeable, and can testify with conviction. A study of the first 86 DNA exonerations garnered by the Innocence Project estimated that faulty forensic science played a role in more than 50 percent of the wrongful convictions. While it's obviously not possible to completely eradicate bias and scientific error from the courtroom, a few simple and relatively inexpensive reforms could go a long way toward reducing it. Here are a few more recommendations:


Sports Nut

Grandmaster Clash

One of the most amazing feats in chess history just happened, and no one noticed.

The Extraordinary Amicus Brief That Attempts to Explain the Wu-Tang Clan to the Supreme Court Justices

Amazon Is Officially a Gadget Company. Here Are Its Six New Devices.

Do the Celebrities Whose Nude Photos Were Stolen Have a Case Against Apple?

The NFL Explains How It Sees “the Role of the Female”

Future Tense

Amazon Is Now a Gadget Company


How to Order Chinese Food

First, stop thinking of it as “Chinese food.”

Scotland Is Inspiring Secessionists Across America

The Country Where Women Aren’t Allowed to Work Once They’re 36 Weeks’ Pregnant

The XX Factor
Sept. 18 2014 11:40 AM The Country Where Women Aren’t Allowed to Work Once They’re 36 Weeks’ Pregnant
Sept. 17 2014 5:10 PM The Most Awkward Scenario in Which a Man Can Hold a Door for a Woman
  News & Politics
Sept. 18 2014 3:19 PM In Defense of Congress Leaving Town Without a New War Vote
Business Insider
Sept. 18 2014 3:31 PM What Europe Would Look Like If All the Separatist Movements Got Their Way
Sept. 18 2014 3:24 PM Symantec Removes Its “Sexual Orientation” Filter
  Double X
The XX Factor
Sept. 18 2014 3:30 PM How Crisis Pregnancy Centers Trick Women
  Slate Plus
Behind the Scenes
Sept. 18 2014 1:23 PM “It’s Not Every Day That You Can Beat the World Champion” An exclusive interview with chess grandmaster Fabiano Caruana.
Brow Beat
Sept. 18 2014 3:04 PM Pogo Returns With Another Utterly Catchy Disney Remix
Future Tense
Sept. 18 2014 2:39 PM Here's How to Keep Apple From Sharing Your iPhone Data With the Police
  Health & Science
Sept. 18 2014 3:35 PM Do People Still Die of Rabies? And how do you know if an animal is rabid?
Sports Nut
Sept. 18 2014 11:42 AM Grandmaster Clash One of the most amazing feats in chess history just happened, and no one noticed.