American Kids Whiffed the PISA Exam. What Should That Mean for School Reform?

What women really think about news, politics, and culture.
Dec. 3 2013 2:21 PM

The PISA Puzzle

The lessons of the big test for our school reform movement aren’t as simple as they might seem.

Teens taking a test
American students are especially bad at math problems in which they are not provided with a formula, but have to figure out how to manipulate the numbers on their own.

Photo by Shutterstock


While these results always make news, this year there is an added tempest in the teapot of the education policy world: The OECD and the Obama administration worked in advance with a selected group of advocacy organizations to launch a media campaign called PISA Day. Which organizations? The College Board, ACT, America Achieves, and the Business Roundtable—all key architects of the Common Core, the new national curriculum standards whose increased rigor and standardized tests have led to a much-publicized protest movement among some parents, teachers, and kids. Groups that support the Core have an interest in calling attention to low American test scores, which today they will use to argue that the Core is the solution not only to our academic woes, but also to reviving the American economy. Happy PISA Day!

But the truth is that the lessons of PISA for our school reform movement are not as simple as they are often made out to be. PISA results aren’t just about K12 test scores and curricula—they are also about academic ability tracking, income inequality, health care, child care, and how schools are organized as workplaces for adults.


To figure out what PISA results really tell us, let’s first look at what’s on the test. PISA is quite different from the mostly multiple-choice, fact-driven state exams American kids take annually. The idea of PISA is to test students’ ability to handle words and numbers in real-world situations. One math activity asked students to compare the value of four cars, using a chart showing the mileage, engine capacity, and price of each one. American kids were especially bad at problems like this, in which they were not provided with a formula, but had to figure out how to manipulate the numbers on their own.

A reading activity asked test takers to read a short play, and then write about what the characters were doing before the curtain went up. The challenge is that the question prompts students to envision and describe a scene not actually included in the text itself. These are good questions that most of our kids should be able to tackle—we want analytical, creative children, not just kids who are good at memorization.

Yet we shouldn’t be surprised that our 15-year-olds are stagnant on PISA. Our best American exam, the National Assessment of Educational Progress, already shows that the performance of our older teenagers has been flat since 1971, even as our elementary school kids—especially poor kids—have improved. Our kids do OK when they’re young, but then stall in high school, time and time again. This fact is backed by two other big international exams that get less airtime, TIMSS and PIRLS, which show that American fourth- and eighth-graders are improving in math, science, and reading, and are actually above average internationally.

Why do our little kids do better than our older ones? Ability tracking may have something to do with it. The PISA results show that in higher-performing nations, all students younger than 15 are exposed to the most challenging math concepts. Nations that track their math instruction by ability, like the U.S., do worse on these tests, because fewer kids—especially poor kids—are exposed to the deeper conceptual thinking that becomes more important as the grades progress and tests get harder. This helps to account for why, despite the vast privilege of our most affluent students, only 9 percent of American students perform in the top two categories in math, compared with the global average of 13 percent.

There’s another PISA result that should be heeded just as much as, if not more than, the rankings themselves: The OECD found that school systems with greater teacher leadership opportunities, like Canada’s, outperform those like ours, in which administrators and policymakers exert more top-down control over the classroom, through scripted lessons or teacher evaluation systems that heavily weigh student test scores. Yet you won’t hear about that much on PISA Day, because those have both become popular interventions during the Obama era of education reform.