How To Measure Teacher Quality?

A blog about business and economics.
Sept. 13 2012 11:43 AM

Value-Added Models of Teacher Quality

As I wrote earlier, the Chicago teachers' strike is not primarily about salary, but salary is relevant. Chicago teachers are well-compensated, which is appropriate, but the question facing the city of Chicago is whether it's getting high quality in exchange for its money.

There are a number of dimensions to the dispute around this, but the key one is that there's a trend in policy circles to push for more reliance on value-added models of teacher performance. The way VAM works, more or less, is that you use standardized tests to determine whether students are learning. But of course that would be much too crude. Parents' income and educational status and so forth is also going to affect how much kids learn. My dad dropped out of high school and could never help me with math homework the way my mom could. If neither of my parents had finished 10th grade, I would have done worse in math through no fault of my teachers. So the VAM models at issue apply various demographic controls.


Teachers and their unions are not big fans of these models. This epic John Ewing post at Valerie Strauss' Answer Sheet blog rounds up skeptical research. One key point the skeptics raise is that there's a lot of year-to-year instability in how teachers score on these models.

On the other hand, this paper from Raj Chetty, John N. Friedman, and Jonah E. Rockoff (PDF) is a typical example of the kind of research that's persuaded VAM fans that this is a good way to proceed:

Are teachers’ impacts on students’ test scores (“value-added”) a good measure of their quality? This question has sparked debate largely because of disagreement about (1) whether value-added (VA) provides unbiased estimates of teachers’ impacts on student achievement and (2) whether high-VA teachers improve students’ long-term outcomes. We address these two issues by analyzing school district data from grades 3-8 for 2.5 million children linked to tax records on parent characteristics and adult outcomes. We find no evidence of bias in VA estimates using previously unobserved parent characteristics and a quasi-experimental research design based on changes in teaching staff. Students assigned to high-VA teachers are more likely to attend college, attend higher-ranked colleges, earn higher salaries, live in higher SES neighborhoods, and save more for retirement. They are also less likely to have children as teenagers. Teachers have large impacts in all grades from 4 to 8. On average, a one standard deviation improvement in teacher VA in a single grade raises earnings by about 1% at age 28. Replacing a teacher whose VA is in the bottom 5% with an average teacher would increase the present value of students’ lifetime income by more than $250,000 for the average classroom in our sample. We conclude that good teachers create substantial economic value and that test score impacts are helpful in identifying such teachers.

I am basically on Team Chetty with regard to this. Others will disagree. But contrary to the impression you'll get reading blogs, it really isn't a question whose answer can be deduced from ideological first principles. My general view is that the wise politician will simply take the fact that teachers don't like being evaluated this way at face value and will offer them more money in exchange for accepting it (that's what we've done in Washington). The Rahm Emanuel approach of pushing an unpopular evaluation model concurrently with a longer school year and other teacher-unfriendly measures produces a backlash, and he seems to be losing in the court of public opinion.*

Politicians sometimes forget that "politician" is one of the least-respected professions in America, so any time there's a standoff between politicians and some better-regarded group of people—cops, firefighters, teachers, military officers, doctors—the tendency is for the politicians to lose.

Correction, Sept. 13, 2012: This post originally misspelled Rahm Emanuel's last name.



Talking White

Black people’s disdain for “proper English” and academic achievement is a myth.

Alabama’s Insane New Abortion Law Gives Fetuses Lawyers and Puts Teenage Girls on Trial

Tattoo Parlors Have Become a Great Investment

A Jaw-Dropping Political Ad Aimed at Young Women, Apparently

The XX Factor
Oct. 1 2014 4:05 PM Today in GOP Outreach to Women: You Broads Like Wedding Dresses, Right?

Big Problems With the Secret Service Were Reported Last Year. Nobody Cared.


Operation Backbone

How White Boy Rick, a legendary Detroit cocaine dealer, helped the FBI uncover brazen police corruption.

Hong Kong’s Protesters Are Ridiculously Polite. That’s What Scares Beijing So Much.

This Gargantuan Wind Farm in Wyoming Would Be the Hoover Dam of the 21st Century

Oct. 1 2014 8:34 AM This Gargantuan Wind Farm in Wyoming Would Be the Hoover Dam of the 21st Century To undertake a massively ambitious energy project, you don’t need the government anymore.
  News & Politics
Oct. 2 2014 11:01 AM It Wasn’t a Secret A 2013 inspector general report detailed all of the Secret Service’s problems. Nobody cared.
Oct. 2 2014 12:58 PM Why Can’t States Do More to Protect Patients From Surprise Medical Bills? It’s complicated.
Lexicon Valley
Oct. 2 2014 1:05 PM What's Wrong With "America's Ugliest Accent"
  Double X
The XX Factor
Oct. 2 2014 12:37 PM St. Louis Study Confirms That IUDs Are the Key to Lowering Teen Pregnancy Rates
  Slate Plus
Behind the Scenes
Oct. 1 2014 3:24 PM Revelry (and Business) at Mohonk Photos and highlights from Slate’s annual retreat.
Oct. 2 2014 1:09 PM Are You Enjoying a Picnic on a Dumpsite?
Future Tense
Oct. 2 2014 12:56 PM My Year Without Flying I’ve stayed on the ground, to help fight climate change. Here’s what happened.
  Health & Science
Oct. 2 2014 12:53 PM The Panic Virus How public health officials are keeping Americans calm about the Ebola threat.
Sports Nut
Oct. 1 2014 5:19 PM Bunt-a-Palooza! How bad was the Kansas City Royals’ bunt-all-the-time strategy in the American League wild-card game?