American Kids Whiffed the PISA Exam. What Should That Mean for School Reform?

What women really think about news, politics, and culture.
Dec. 3 2013 2:21 PM

The PISA Puzzle

The lessons of the big test for our school reform movement aren’t as simple as they might seem.

Teens taking a test
American students are especially bad at math problems in which they are not provided with a formula, but have to figure out how to manipulate the numbers on their own.

Photo by Shutterstock

On Tuesday the Organization for Economic Cooperation and Development released the 2012 scores for the Program for International Student Assessment, commonly known as PISA, the international reading, math, and science exam of 15-year-olds. The United States did not do well: Compared with their peers in the 33 other OECD nations around the world, American teens ranked 17th in reading, 21st in science, and 26th in math. The top-performing region was Shanghai.

While these results always make news, this year there is an added tempest in the teapot of the education policy world: The OECD and the Obama administration worked in advance with a selected group of advocacy organizations to launch a media campaign called PISA Day. Which organizations? The College Board, ACT, America Achieves, and the Business Roundtable—all key architects of the Common Core, the new national curriculum standards whose increased rigor and standardized tests have led to a much-publicized protest movement among some parents, teachers, and kids. Groups that support the Core have an interest in calling attention to low American test scores, which today they will use to argue that the Core is the solution not only to our academic woes, but also to reviving the American economy. Happy PISA Day!

But the truth is that the lessons of PISA for our school reform movement are not as simple as they are often made out to be. PISA results aren’t just about K12 test scores and curricula—they are also about academic ability tracking, income inequality, health care, child care, and how schools are organized as workplaces for adults.

Advertisement

To figure out what PISA results really tell us, let’s first look at what’s on the test. PISA is quite different from the mostly multiple-choice, fact-driven state exams American kids take annually. The idea of PISA is to test students’ ability to handle words and numbers in real-world situations. One math activity asked students to compare the value of four cars, using a chart showing the mileage, engine capacity, and price of each one. American kids were especially bad at problems like this, in which they were not provided with a formula, but had to figure out how to manipulate the numbers on their own.

A reading activity asked test takers to read a short play, and then write about what the characters were doing before the curtain went up. The challenge is that the question prompts students to envision and describe a scene not actually included in the text itself. These are good questions that most of our kids should be able to tackle—we want analytical, creative children, not just kids who are good at memorization.

Yet we shouldn’t be surprised that our 15-year-olds are stagnant on PISA. Our best American exam, the National Assessment of Educational Progress, already shows that the performance of our older teenagers has been flat since 1971, even as our elementary school kids—especially poor kids—have improved. Our kids do OK when they’re young, but then stall in high school, time and time again. This fact is backed by two other big international exams that get less airtime, TIMSS and PIRLS, which show that American fourth- and eighth-graders are improving in math, science, and reading, and are actually above average internationally.

Why do our little kids do better than our older ones? Ability tracking may have something to do with it. The PISA results show that in higher-performing nations, all students younger than 15 are exposed to the most challenging math concepts. Nations that track their math instruction by ability, like the U.S., do worse on these tests, because fewer kids—especially poor kids—are exposed to the deeper conceptual thinking that becomes more important as the grades progress and tests get harder. This helps to account for why, despite the vast privilege of our most affluent students, only 9 percent of American students perform in the top two categories in math, compared with the global average of 13 percent.

There’s another PISA result that should be heeded just as much as, if not more than, the rankings themselves: The OECD found that school systems with greater teacher leadership opportunities, like Canada’s, outperform those like ours, in which administrators and policymakers exert more top-down control over the classroom, through scripted lessons or teacher evaluation systems that heavily weigh student test scores. Yet you won’t hear about that much on PISA Day, because those have both become popular interventions during the Obama era of education reform.

TODAY IN SLATE

Justice Ginsburg’s Crucial Dissent in the Texas Voter ID Case

The Jarring Experience of Watching White Americans Speak Frankly About Race

Here’s Just How Far a Southern Woman May Have to Drive to Get an Abortion

The Most Ingenious Teaching Device Ever Invented

Marvel’s Civil War Is a Far-Right Paranoid Fantasy

It’s also a mess. Can the movies do better?

Behold

Sprawl, Decadence, and Environmental Ruin in Nevada

Space: The Next Generation

An All-Female Mission to Mars

As a NASA guinea pig, I verified that women would be cheaper to launch than men.

Watching Netflix in Bed. Hanging Bananas. Is There Anything These Hooks Can’t Solve?

The 2014 Kansas City Royals Show the Value of Building a Mediocre Baseball Team

  News & Politics
The World
Oct. 20 2014 1:50 PM Why We Shouldn’t be Too Sure About the Supposed Deal to Return the Abducted Nigerian Schoolgirls
  Business
Moneybox
Oct. 20 2014 12:37 PM The Fed Will Probably Stop Injecting Huge Sums of Money Into the Economy This Month
  Life
Atlas Obscura
Oct. 20 2014 1:43 PM Chouara: A Striking 11th-Century Tannery in Morocco
  Double X
The XX Factor
Oct. 20 2014 1:10 PM Women Are Still Losing Jobs for Getting Pregnant
  Slate Plus
Tv Club
Oct. 20 2014 7:15 AM The Slate Doctor Who Podcast: Episode 9 A spoiler-filled discussion of "Flatline."
  Arts
Brow Beat
Oct. 20 2014 1:26 PM This $248 Denim Jumpsuit Is the Latest Example of a Horrible Fashion Tradition
  Technology
Future Tense
Oct. 20 2014 1:51 PM Will Amazon Lead Us to the Golden Age of Books? A Future Tense Event.
  Health & Science
Medical Examiner
Oct. 20 2014 11:46 AM Is Anybody Watching My Do-Gooding? The difference between being a hero and being an altruist.
  Sports
Sports Nut
Oct. 20 2014 10:23 AM Where I Was Wrong About the Royals I underestimated the value of building a team that’s just barely better than mediocre.