American Kids Whiffed the PISA Exam. What Should That Mean for School Reform?

What women really think about news, politics, and culture.
Dec. 3 2013 2:21 PM

The PISA Puzzle

The lessons of the big test for our school reform movement aren’t as simple as they might seem.

Teens taking a test
American students are especially bad at math problems in which they are not provided with a formula, but have to figure out how to manipulate the numbers on their own.

Photo by Shutterstock

On Tuesday the Organization for Economic Cooperation and Development released the 2012 scores for the Program for International Student Assessment, commonly known as PISA, the international reading, math, and science exam of 15-year-olds. The United States did not do well: Compared with their peers in the 33 other OECD nations around the world, American teens ranked 17th in reading, 21st in science, and 26th in math. The top-performing region was Shanghai.

While these results always make news, this year there is an added tempest in the teapot of the education policy world: The OECD and the Obama administration worked in advance with a selected group of advocacy organizations to launch a media campaign called PISA Day. Which organizations? The College Board, ACT, America Achieves, and the Business Roundtable—all key architects of the Common Core, the new national curriculum standards whose increased rigor and standardized tests have led to a much-publicized protest movement among some parents, teachers, and kids. Groups that support the Core have an interest in calling attention to low American test scores, which today they will use to argue that the Core is the solution not only to our academic woes, but also to reviving the American economy. Happy PISA Day!

But the truth is that the lessons of PISA for our school reform movement are not as simple as they are often made out to be. PISA results aren’t just about K12 test scores and curricula—they are also about academic ability tracking, income inequality, health care, child care, and how schools are organized as workplaces for adults.

Advertisement

To figure out what PISA results really tell us, let’s first look at what’s on the test. PISA is quite different from the mostly multiple-choice, fact-driven state exams American kids take annually. The idea of PISA is to test students’ ability to handle words and numbers in real-world situations. One math activity asked students to compare the value of four cars, using a chart showing the mileage, engine capacity, and price of each one. American kids were especially bad at problems like this, in which they were not provided with a formula, but had to figure out how to manipulate the numbers on their own.

A reading activity asked test takers to read a short play, and then write about what the characters were doing before the curtain went up. The challenge is that the question prompts students to envision and describe a scene not actually included in the text itself. These are good questions that most of our kids should be able to tackle—we want analytical, creative children, not just kids who are good at memorization.

Yet we shouldn’t be surprised that our 15-year-olds are stagnant on PISA. Our best American exam, the National Assessment of Educational Progress, already shows that the performance of our older teenagers has been flat since 1971, even as our elementary school kids—especially poor kids—have improved. Our kids do OK when they’re young, but then stall in high school, time and time again. This fact is backed by two other big international exams that get less airtime, TIMSS and PIRLS, which show that American fourth- and eighth-graders are improving in math, science, and reading, and are actually above average internationally.

Why do our little kids do better than our older ones? Ability tracking may have something to do with it. The PISA results show that in higher-performing nations, all students younger than 15 are exposed to the most challenging math concepts. Nations that track their math instruction by ability, like the U.S., do worse on these tests, because fewer kids—especially poor kids—are exposed to the deeper conceptual thinking that becomes more important as the grades progress and tests get harder. This helps to account for why, despite the vast privilege of our most affluent students, only 9 percent of American students perform in the top two categories in math, compared with the global average of 13 percent.

There’s another PISA result that should be heeded just as much as, if not more than, the rankings themselves: The OECD found that school systems with greater teacher leadership opportunities, like Canada’s, outperform those like ours, in which administrators and policymakers exert more top-down control over the classroom, through scripted lessons or teacher evaluation systems that heavily weigh student test scores. Yet you won’t hear about that much on PISA Day, because those have both become popular interventions during the Obama era of education reform.

TODAY IN SLATE

Politics

The Democrats’ War at Home

How can the president’s party defend itself from the president’s foreign policy blunders?

Why Time Is on Our Side in the Fight Against Ebola

The Religious Right Is Not Happy With Republicans  

The XX Factor
Oct. 1 2014 4:58 PM The Religious Right Is Not Happy With Republicans  

Catacombs Where You Can Stroll Down Hallways Lined With Corpses

Homeland Is Good Again! For Now.

Crime

Operation Backbone

How White Boy Rick, a legendary Detroit cocaine dealer, helped the FBI uncover brazen police corruption.

Music

How Even an Old Hipster Can Age Gracefully

On their new albums, Leonard Cohen, Robert Plant, and Loudon Wainwright III show three ways.

The U.S. Has a New Problem in Syria: The Moderate Rebels Feel Like We’ve Betrayed Them

Piper Kerman on Why She Dressed Like a Hitchcock Heroine for Her Prison Sentencing

Trending News Channel
Oct. 1 2014 1:25 PM Japanese Cheerleader Robots Balance and Roll Around on Balls
  News & Politics
Crime
Oct. 1 2014 4:15 PM The Trials of White Boy Rick A Detroit crime legend, the FBI, and the ugliness of the war on drugs.
  Business
Moneybox
Oct. 1 2014 2:16 PM Wall Street Tackles Chat Services, Shies Away From Diversity Issues 
  Life
Gentleman Scholar
Oct. 1 2014 4:55 PM Blood Before Bud? Must a gentleman’s brother always be the best man at his wedding?
  Double X
The XX Factor
Oct. 1 2014 5:11 PM Celebrity Feminist Identification Has Reached Peak Meaninglessness
  Slate Plus
Behind the Scenes
Oct. 1 2014 3:24 PM Revelry (and Business) at Mohonk Photos and highlights from Slate’s annual retreat.
  Arts
Brow Beat
Oct. 1 2014 3:02 PM The Best Show of the Summer Is Getting a Second Season
  Technology
Future Tense
Oct. 1 2014 4:46 PM Ebola Is No Measles. That’s a Good Thing. Comparing this virus to scourges of the past gives us hope that we can slow it down.
  Health & Science
Science
Oct. 1 2014 4:03 PM Does the Earth Really Have a “Hum”? Yes, but probably not the one you’re thinking.
  Sports
Sports Nut
Oct. 1 2014 5:19 PM Bunt-a-Palooza! How bad was the Kansas City Royals’ bunt-all-the-time strategy in the American League wild-card game?