It is the education debate of the Trump era. With the president and Education Secretary Betsy DeVos using policy and the bully pulpit to champion private school vouchers, supporters and critics have tangled over the question:
Do low-income, public school students perform better when they're given a voucher to attend a private school?
For years, the answer from researchers has been a muddle, while a handful of recent studies have clearly shown voucher students backsliding academically. But no one has studied the largest, single statewide program in the nation ...
More than 34,000 students are enrolled in Indiana's Choice Scholarship Program. That's 3 percent of students statewide. In a recent investigation of the program, NPR found some private schools turning away children with disabilities and LGBTQ students, but it was impossible to say, at the time, whether those students who are using vouchers are any better off academically.
Researchers Mark Berends of the University of Notre Dame and R. Joseph Waddington of the University of Kentucky have spent years studying this question, and they've given NPR an early look at their findings.
In their unpublished research, which is now being peer-reviewed, Waddington and Berends studied the standardized test scores of low-income, public school students (grades 3-8) who qualified for free or reduced-price lunch and who used a voucher to switch to a private school.
When comparing these students' achievement after the switch to their test scores the previous year, the researchers found:
- Voucher students experienced "modest annual achievement losses" in math, especially in the first two years after leaving public school.
- In English/language arts, voucher students showed no benefits.
- These results echo what other researchers have found: that voucher students often backslide academically after switching to private school.
When students stick around, they improve
The researchers studied student data for the program's first four years and noticed an interesting pattern. If students stayed in their voucher schools long enough, the backslide stopped and their performance began to improve.
"The longer that a student is enrolled in a private school receiving a voucher, their achievement begins to turn positive in magnitude — to the degree that they're making up ground that they initially lost in their first couple of years in private school," Waddington tells NPR. "It's like they're getting back to where they started" before they enrolled in a private school.
New voucher students fell statistically significantly behind their public school peers in math after switching. On average, those losses continued for two years in private school before students began making up ground. In the fourth year, those who were still enrolled in a voucher school appeared to catch up.
In ELA, voucher students also lost ground but, ultimately, surpassed their public school peers by the fourth year.
This pattern may give new hope to voucher supporters, but it comes with an important caveat: Many students did not stay in the system long enough to see this improvement, instead bouncing back to public schools, especially the lowest-achieving voucher students.
This isn't a study of all voucher students ...
It's a study of roughly 3,300 low-income students in grades 3-8 who used a voucher to switch from their public school to a private school and were then matched by the researchers to similar students who remained in public schools. That's another important caveat because, in 2017, more than half of Indiana's voucher students had never attended a public school.
In other words, these results may not be representative of the program as a whole.
Private schools aren't cream-skimming
It's a common refrain among voucher critics: Private schools that are allowed to pick and choose voucher students often accept high-achievers and turn away low-achievers. Not so, say Waddington and Berends, at least not among the students they studied in Indiana.
The state's low-income voucher students "appear to be lower-achieving students from the public sector," they write, "and enter private schools substantially behind their private school peers."
The researchers conducted dozens of interviews with principals, teachers, parents and students in 13 voucher-accepting private schools and found a common theme: Children who came from public schools often struggled to meet new homework expectations and found the first year in a private school particularly challenging. The fact that voucher students' academic performance gradually improved over multiple years suggests that they had to adjust to those demands and that their private schools had to adjust as well.
Waddington believes many private schools struggled to adapt quickly to Indiana's voucher program and that teachers and administrators had to scramble to meet the needs of students who were "largely low-achieving and more demographically diverse than the students already enrolled in these private schools ... It's important to be able to have the time and systematically think about how these students can be best served," Waddington says.
"Our hope is that this research can inform." Berends says. "That voucher programs can be more nuanced. There might be some losses but then, over time, there may not be losses forever."
Waddington and Berends are the first to admit that their work, which is still being revised, will not end the debate over vouchers' effectiveness, but it does offer new clarity for Indiana policymakers.
Earlier this year, Jennifer McCormick, the state superintendent, told NPR she was eager for such clarity.
"You know, we're spending roughly $146 million on a program and not really reviewing it," McCormick said. "That is irresponsible."
McCormick's office declined to comment on the research results until after the peer review process is complete.