hechingerreport.org
A leading school shootings researcher says he was wrong
This story also appeared in Mind/Shift
School purchasing can seem like an administrative backwater, far removed from the heart of teaching and learning. But the way schools buy products and services like educational software or tutoring programs can influence whether students actually learn, some policymakers argue.
Instead of paying vendors simply for delivering these tools, school districts are experimenting with a new approach to purchasing, called outcomes-based contracting, in which part of a vendor’s payment depends on whether students actually use the service and meet agreed-upon academic goals. The idea is to share risk between schools and vendors — and create incentives for both sides to pay closer attention to whether an intervention is working.
Outcomes-based contracts have long been used in the healthcare industry. For example, insurers often pay drug companies less if patients don’t improve. Since the pandemic, the method has spread rapidly in education, particularly for tutoring and educational technology. A new Michigan law requires schools to use this type of contract to tap into a $50 million fund for online or virtual tutoring. School districts in Florida, Texas, California and more than 20 other states are also experimenting with the approach, according to the Center for Outcomes Based Contracting, a nonprofit organization that promotes the practice.
**Related:We have tried paying teachers based on how much students learn. Now schools are expanding that idea to contractors and vendors**
The first independent evaluation of outcomes-based contracts offers reasons for optimism, but also for caution. Researchers from WestEd, a San Francisco-based nonprofit research organization, studied tutoring and educational technology programs in eight early-adopter districts in California, Florida, Mississippi and Texas between August 2024 and March 2026. Three of the interventions produced measurable academic gains for students. But the study stops short of proving that the contracts themselves deserve the credit.
Researchers faced a common challenge in education: How to determine whether a particular intervention actually caused students to learn more. Student achievement depends on so many things, from classroom instruction and curriculum to family circumstances. To isolate the effect of tutoring or educational software delivered under an outcomes-based contract, WestEd compared students who had scored just below an eligibility cutoff and received the intervention with statistically similar students who had scored just above the cutoff and did not.
Of the 10 interventions the researchers hoped to evaluate, only four could be analyzed using this rigorous approach. Three showed positive academic effects. The fourth, an online tutoring program, was intended to run for most of the school year but lasted only about two months, too short to expect measurable gains.
#### **Student performance improved in three interventions covered by outcomes-based contracts**
Source: Center for Outcomes Based Contracting, summary table of causal impact findings
For the other six interventions, researchers couldn’t make clean comparisons between similar students because schools did what schools often do: They filled empty tutoring seats with higher achieving students who weren’t supposed to get tutoring, or they failed to get eligible students to attend after-school tutoring programs, for example. One district allowed all its first graders to use reading software if they posted anything less than a perfect score on a kindergarten assessment.
**Targeting interventions to the right students**
One of the more intriguing results involved instructional reading software powered by artificial intelligence. Second graders who used the AI tutor were substantially more likely to reach proficiency on the state’s reading assessment than similar students who did not. The same program, however, did not produce benefits for older elementary students.
“That’s a really important finding,” said Brittany Miller, executive director of the Center for Outcomes Based Contracting, which commissioned the WestEd study. “Because that tells us what’s working for whom and under what conditions.”
Most schools, Miller said, were “paying for services, and we have no idea whether or not they were working for kids, or even if kids got the services.”
## Education research, condensed
The free Proof Points newsletter delivers one digestible research story to your inbox every Monday.
Email(Required)
Δ
The mixed results that outcomes-based contracts can produce — good, bad or neutral — are equally important, Miller argues, so that schools can more precisely target the right interventions to the right kids.
“Because guess what? Not every kid needs 30 minutes of every ed tech product every week,” she said.
**Attending to implementation**
WestEd researchers said they observed notable changes in day-to-day implementation. Schools and vendors met regularly to review data, monitored whether students were actually attending tutoring sessions and tracked their progress toward goals. Teachers and school leaders put more energy into making sure students showed up.
But there’s a caveat. The evaluation cannot determine whether those implementation improvements stemmed from the financial incentives built into the contracts or from the extensive support the districts received from the Center for Outcomes Based Contracting. Each participating district got roughly $80,000 worth of coaching and technical assistance from the center to help design the contracts, establish outcome measures, monitor progress and troubleshoot implementation problems.
In other words, the evaluation tested outcomes-based contracting plus intensive implementation support — not the contracts in isolation. It’s possible that the coaching and technical assistance alone could have prompted schools to monitor tutoring attendance more closely, hold regular data meetings and make mid-course corrections.
**Cutting costs**
The center is now experimenting with less expensive models that reduce the assistance to under $10,000 per district. Researchers hope future evaluations will help determine whether districts can achieve similar results with far less outside support — and whether the contracts themselves are driving the improvements.
##### Since reading Hechinger reporting, have you…
Since reading Hechinger reporting, have you…
Changed how you think about an education issue
Looked for more information on the topic
Talked to others about it
Taken some kind of action (policy, program, classroom, etc.)
Δ
Researchers also observed unexpected spillover effects. Once districts built data systems to monitor tutoring attendance and student progress for outcomes-based contracts, they began using those same systems to track other interventions that weren’t covered by the contracts.
“Certain interventions are not going to work with or without an outcomes-based contract,” said Sean Tanner, a researcher at WestEd on the evaluation team. “What’s really important for continual improvement is that the districts can learn really rigorously whether something is working. As a researcher, I find the OBC [outcomes-based contracting] model really compelling because it builds natural experiments into the process.”
Outcomes-based contracting can’t replace academic research. But it could help schools understand better which interventions are working in real time, instead of waiting for a multi-year randomized controlled trial to be conducted.
The evaluation didn’t find that outcomes-based contracting saved schools money. WestEd did not conduct a formal cost-effectiveness analysis, but its interviews with participating districts suggested that overall spending was similar to traditional contracts. Some districts absorbed costs when they failed to meet their own responsibilities, such as making sure students attended tutoring sessions. At the same time, some vendors reported losing money.
Whether outcomes-based contracting ultimately fulfills its promise remains an open question. Resource-strained districts are likely to have a much harder time doing it, the WestEd researchers observed. And while the researchers found positive academic results in three interventions, they still cannot determine whether those gains stemmed from the contracts themselves, the intensive coaching districts received or both. What the study does point to is that contracts can do more than enforce payments. They can change how districts monitor, manage and learn from the programs they buy.
__Contact staff_ writer Jill Barshay at 212-678-3595, jillbarshay.35 on Signal, or barshay@hechingerreport.org_.
_This story about anevaluation of outcomes-based contracting was produced by _The Hechinger Report _, a nonprofit, independent news organization that covers education. Sign up for_ _Proof Points_ _and other_ _Hechinger newsletters_ _._
## More Proof Points
### A leading school shootings researcher says he was wrong
### Education researchers warn political review of federal grants could reshape what gets studied
### Teachers save time with AI. Their students may pay the price
**Was this story helpful? Leave a tip to support your education reporters**.
**$5.00**
**$10.00**
**$15.00**
**No tip**
_The Hechinger Report is a nonprofit newsroom powered by reader support_
Republish This Story
Republish our articles for free, online or in print, under a Creative Commons license.
Close window
## Republish this article
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
We offer all nonexclusive stories under a noncommercial Creative Commons license. You are allowed to repost or reprint our stories as long as you use the guidelines below. See here for more details. If you have questions or would like to discuss commercial use, please contact us. If you would like to republish the photos that accompanied this story, please contact us.
# Paying vendors for student results
by Jill Barshay, The Hechinger Report
August 10, 2026
<h1>Paying vendors for student results</h1> <p class="byline">by Jill Barshay, The Hechinger Report <br />August 10, 2026</p> <p class="has-drop-cap">School purchasing can seem like an administrative backwater, far removed from the heart of teaching and learning. But the way schools buy products and services like educational software or tutoring programs can influence whether students actually learn, some policymakers argue.</p> <p>Instead of paying vendors simply for delivering these tools, school districts are experimenting with a new approach to purchasing, called outcomes-based contracting, in which part of a vendor's payment depends on whether students actually use the service and meet agreed-upon academic goals. The idea is to share risk between schools and vendors — and create incentives for both sides to pay closer attention to whether an intervention is working.</p> <p>Outcomes-based contracts have long been used in the healthcare industry. For example, insurers often pay drug companies less if patients don’t improve. Since the pandemic, the method has spread rapidly in education, particularly for tutoring and educational technology. A new Michigan law requires schools to use this type of contract to tap into a $50 million fund for online or virtual tutoring. School districts in Florida, Texas, California and more than 20 other states are also experimenting with the approach, according to the <a href="https://obc.southerneducation.org/">Center for Outcomes Based Contracting</a>, a nonprofit organization that promotes the practice.</p> <p><strong>Related: <a href="https://hechingerreport.org/proof-points-outcomes-based-contracting/">We have tried paying teachers based on how much students learn. Now schools are expanding that idea to contractors and vendors</a></strong></p> <p>The first independent <a href="https://www.wested.org/resource/evaluation-of-outcomes-based-contracting/">evaluation of outcomes-based contracts</a> offers reasons for optimism, but also for caution. Researchers from WestEd, a San Francisco-based nonprofit research organization, studied tutoring and educational technology programs in eight early-adopter districts in California, Florida, Mississippi and Texas between August 2024 and March 2026. Three of the interventions produced measurable academic gains for students. But the study stops short of proving that the contracts themselves deserve the credit.</p> <p>Researchers faced a common challenge in education: How to determine whether a particular intervention actually caused students to learn more. Student achievement depends on so many things, from classroom instruction and curriculum to family circumstances. To isolate the effect of tutoring or educational software delivered under an outcomes-based contract, WestEd compared students who had scored just below an eligibility cutoff and received the intervention with statistically similar students who had scored just above the cutoff and did not.</p> <p>Of the 10 interventions the researchers hoped to evaluate, only four could be analyzed using this rigorous approach. Three showed positive academic effects. The fourth, an online tutoring program, was intended to run for most of the school year but lasted only about two months, too short to expect measurable gains. </p> <h4 id="h-student-performance-improved-in-three-interventions-covered-by-outcomes-based-contracts" class="wp-block-heading"><strong>Student performance improved in three interventions covered by outcomes-based contracts</strong></h4> <!-- RTT removed image (117446) --> <p>For the other six interventions, researchers couldn’t make clean comparisons between similar students because schools did what schools often do: They filled empty tutoring seats with higher achieving students who weren’t supposed to get tutoring, or they failed to get eligible students to attend after-school tutoring programs, for example. One district allowed all its first graders to use reading software if they posted anything less than a perfect score on a kindergarten assessment.</p> <p><strong>Targeting interventions to the right students</strong></p> <p>One of the more intriguing results involved instructional reading software powered by artificial intelligence. Second graders who used the AI tutor were substantially more likely to reach proficiency on the state's reading assessment than similar students who did not. The same program, however, did not produce benefits for older elementary students. </p> <p>“That’s a really important finding,” said Brittany Miller, executive director of the Center for Outcomes Based Contracting, which commissioned the WestEd study. “Because that tells us what’s working for whom and under what conditions.” </p> <p>Most schools, Miller said, were “paying for services, and we have no idea whether or not they were working for kids, or even if kids got the services.”</p> <p>The mixed results that outcomes-based contracts can produce — good, bad or neutral — are equally important, Miller argues, so that schools can more precisely target the right interventions to the right kids. </p> <p>“Because guess what? Not every kid needs 30 minutes of every ed tech product every week,” she said. </p> <p><strong>Attending to implementation</strong></p> <p>WestEd researchers said they observed notable changes in day-to-day implementation. Schools and vendors met regularly to review data, monitored whether students were actually attending tutoring sessions and tracked their progress toward goals. Teachers and school leaders put more energy into making sure students showed up.</p> <p>But there's a caveat. The evaluation cannot determine whether those implementation improvements stemmed from the financial incentives built into the contracts or from the extensive support the districts received from the Center for Outcomes Based Contracting. Each participating district got roughly $80,000 worth of coaching and technical assistance from the center to help design the contracts, establish outcome measures, monitor progress and troubleshoot implementation problems.</p> <p>In other words, the evaluation tested outcomes-based contracting plus intensive implementation support — not the contracts in isolation. It’s possible that the coaching and technical assistance alone could have prompted schools to monitor tutoring attendance more closely, hold regular data meetings and make mid-course corrections. </p> <p><strong>Cutting costs</strong></p> <p>The center is now experimenting with less expensive models that reduce the assistance to under $10,000 per district. Researchers hope future evaluations will help determine whether districts can achieve similar results with far less outside support — and whether the contracts themselves are driving the improvements.</p> <p>Researchers also observed unexpected spillover effects. Once districts built data systems to monitor tutoring attendance and student progress for outcomes-based contracts, they began using those same systems to track other interventions that weren't covered by the contracts.</p> <p>“Certain interventions are not going to work with or without an outcomes-based contract,” said Sean Tanner, a researcher at WestEd on the evaluation team. “What's really important for continual improvement is that the districts can learn really rigorously whether something is working. As a researcher, I find the OBC [outcomes-based contracting] model really compelling because it builds natural experiments into the process.”</p> <p>Outcomes-based contracting can’t replace academic research. But it could help schools understand better which interventions are working in real time, instead of waiting for a multi-year randomized controlled trial to be conducted. </p> <p>The evaluation didn’t find that outcomes-based contracting saved schools money. WestEd did not conduct a formal cost-effectiveness analysis, but its interviews with participating districts suggested that overall spending was similar to traditional contracts. Some districts absorbed costs when they failed to meet their own responsibilities, such as making sure students attended tutoring sessions. At the same time, some vendors reported losing money.</p> <p>Whether outcomes-based contracting ultimately fulfills its promise remains an open question. Resource-strained districts are likely to have a much harder time doing it, the WestEd researchers observed. And while the researchers found positive academic results in three interventions, they still cannot determine whether those gains stemmed from the contracts themselves, the intensive coaching districts received or both. What the study does point to is that contracts can do more than enforce payments. They can change how districts monitor, manage and learn from the programs they buy.</p> <p><em><em>Contact staff</em> writer <a href="https://hechingerreport.org/author/jill-barshay/">Jill Barshay</a> at 212-678-3595, jillbarshay.35 on Signal, or <a href="mailto:barshay@hechingerreport.org">barshay@hechingerreport.org</a></em>.</p> <p><em>This story about an <a href="https://hechingerreport.org/proof-points-outcomes-based-contracting-evaluation/">evaluation of outcomes-based contracting</a> was produced by </em><a href="https://hechingerreport.org/special-reports/higher-education/" target="_blank" rel="noreferrer noopener">The Hechinger Report</a><em>, a nonprofit, independent news organization that covers education. Sign up for </em><a href="https://hechingerreport.org/proofpoints/" target="_blank" rel="noreferrer noopener"><em>Proof Points</em></a><em> and other </em><a href="https://hechingerreport.org/newsletters/" target="_blank" rel="noreferrer noopener"><em>Hechinger newsletters</em></a><em>.</em></p></p> <p>This <a target="_blank" href="https://hechingerreport.org/proof-points-outcomes-based-contracting-evaluation/">article</a> first appeared on <a target="_blank" href="https://hechingerreport.org">The Hechinger Report</a> and is republished here under a <a target="_blank" href="https://creativecommons.org/licenses/by-nc-nd/4.0/">Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License</a>.<img src="https://i0.wp.com/hechingerreport.org/wp-content/uploads/2018/06/cropped-favicon.jpg?fit=150%2C150&ssl=1" style="width:1em;height:1em;margin-left:10px;"></p> <img id="republication-tracker-tool-source" src="https://hechingerreport.org/?republication-pixel=true&post=117435&ga4=G-03KPHXDF3H" style="width:1px;height:1px;"><script> PARSELY = { autotrack: false, onload: function() { PARSELY.beacon.trackPageView({ url: "https://hechingerreport.org/proof-points-outcomes-based-contracting-evaluation/", urlref: window.location.href }); } } </script> <script id="parsely-cfg" src="//cdn.parsely.com/keys/hechingerreport.org/p.js"></script>
Copy to Clipboard