Implementation Outcomes

Implementation outcomes are measures of how well and how often contingency management is being implemented. Health outcomes are measures of whether contingency management works. Click the buttons on the left to read more about implementation outcomes and health outcomes that have been measured for contingency management, as well as to consider some potential research questions. In addition, view the RASC guide Integrating Implementation Outcomes into Effectiveness Studies for practical guidance on how to include implementation outcomes in your studies.

Prior studies have shown that Contingency Management training and implementation support improve implementation outcomes such as acceptability, fidelity, adoption, implementation, and sustainment.

Acceptability is the perception that providing Contingency Management (CM) from that particular setting is agreeable. Increasing exposure to contingency management (CM) has been shown to enhance providers' positive perceptions of CM and its suitability for patients. 

Measures of feasibility assess whether CM can be delivered in a specific setting or context. Studies have found that the feasibility of implementation has increased when using strategies such as interactive training involving leadership, external facilitation, and technology-assisted CM. 

Fidelity of CM delivery consists of two complementary aspects: CM adherence (whether it was delivered as intended) and CM competence (whether it was delivered well). A recent study found that some aspects of CM delivery that are easily verified (such as whether the provider discussed reinforcement) can be reliably measured via provider self-report, whereas less tangible aspects (such as whether the provider discussed the patient’s recovery goals) should ideally be measured with an observer rated scale such as the CM Competence Scale. Fidelity is sometimes measured to evaluate the implementation strategy, and at other times, it is measured as part of the implementation strategy. As an example, in the Veterans Health Administration rollout, fidelity of CM delivery was measured as part of the implementation strategy to help ensure providers' readiness for CM delivery: providers practiced delivering CM using standardized role plays during the didactic training and observers gave immediate feedback on their fidelity using the CM Competence Scale.

Adoption is commonly defined as the proportion of clinics or providers within a given setting that deliver any CM. A prior study found that the combination of didactic training, performance feedback, and ongoing consultation was associated with 13 times greater odds of CM adoption than didactic training alone. 

A key measure of CM implementation is the proportion or number of patients within a given setting that receive CM. In the Veterans Health Administration’s rollout, which utilized didactic training, performance feedback, and ongoing coaching calls, 2,844 patients received CM across 90 health systems from 2018 to 2022. 

Once training and implementation support are removed, there is often a decline in CM use. Qualitative studies have found that factors influencing sustainability include the availability of funding for CM, compatibility with clinic workflow, staff turnover and retention, and the ability to engage patients remotely (via video conference or phone) during the COVID-19 pandemic.