Skip to main content

Advertisement

Springer Nature Link
Log in

What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Mental health clinicians and administrators are increasingly asked to collect and report treatment outcome data despite numerous challenges to select and use instruments in routine practice. Measurement-based care (MBC) is an evidence-based practice for improving patient care. We propose that data collected from MBC processes with patients can be strategically leveraged by agencies to also support clinicians and respond to accountability requirements. MBC data elements are outlined using the Precision Mental Health Framework (Bickman et al. in Adm Policy Mental Health Mental Health Serv Res 43:271–276, 2016), practical guidance is provided for agency administrators, and conceptual examples illustrate strategic applications of one or more instruments to meet various needs throughout the organization.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

Notes

  1. Quality improvement refers to “systematic and continuous actions that lead to measurable improvement in health care services and the health status of targeted patient groups” (pp. 1, (U.S. Department of Health and Human Services Health Resources and Services Administration, April 2011).

  2. For the sake of consistency, we use the term MBC although many sources use other terms such as progress monitoring and feedback. Widespread differences in terms referring to MBC are noted by Lewis et al. (2019), who recommend the term MBC to ensure explicit emphasis on routine measurement at each clinical encounter, practitioner and patient review of the data, and collaborative decision-making about the treatment plan.

  3. The precision mental health approach is applicable for prevention and intervention. However, we focus primarily on “intervention” or “treatment” services provided by mental health agencies (terms used interchangeably).

References

  • Agency for Healthcare Research and Quality. (September 2018). Quality improvement in primary care. Retrieved from https://www.ahrq.gov/research/findings/factsheets/quality/qipc/index.html.

  • Alberti, P. M., Bonham, A. C., & Kirch, D. G. (2013). Making equity a value in value-based health care. Academic Medicine, 88(11), 1619–1623.

    PubMed  Google Scholar 

  • American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents. (2008). Disseminating evidence-based practice for children & adolescents: A systems approach to enhancing care. Washington, DC: American Psychological Association.

    Google Scholar 

  • Ashworth, M., Evans, C., & Clement, S. (2009). Measuring psychological outcomes after cognitive behaviour therapy in primary care: A comparison between a new patient-generated measure “PSYCHLOPS” (psychological outcome profiles) and “HADS”(hospital anxiety and depression scale). Journal of Mental Health, 18(2), 169–177.

    Google Scholar 

  • Ashworth, M., Guerra, D., & Kordowicz, M. (2019). Individualised or standardised outcome measures: A co-habitation? Administration and Policy in Mental Health and Mental Health Services Research, 46, 425–428.

    PubMed  Google Scholar 

  • Baumhauer, J. F., & Bozic, K. J. (2016). Value-based healthcare: Patient-reported outcomes in clinical decision making. Clinical Orthopaedics and Related Research, 474(6), 1375–1378.

    PubMed  PubMed Central  Google Scholar 

  • Becker-Haimes, E. M., Tabachnick, A. R., Last, B. S., Stewart, R. E., Hasan-Granier, A., & Beidas, R. S. (2020). Evidence base update for brief, free, and accessible youth mental health measures. Journal of Clinical Child & Adolescent Psychology, 49(1), 1–17.

    Google Scholar 

  • Beidas, R. S., Stewart, R. E., Walsh, L., Lucas, S., Downey, M. M., Jackson, K., et al. (2015). Free, brief, and validated: Standardized instruments for low-resource mental health settings. Cognitive and Behavioral Practice, 22(1), 5–19.

    PubMed  PubMed Central  Google Scholar 

  • Bergman, H., Kornør, H., Nikolakopoulou, A., Hanssen-Bauer, K., Soares-Weiser, K., Tollefsen, T. K., et al. (2018). Client feedback in psychological therapy for children and adolescents with mental health problems. Cochrane Database of Systematic Reviews, 8, CD011729.

    Google Scholar 

  • Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child & Adolescent Psychiatry, 47(10), 1114.

    Google Scholar 

  • Bickman, L., Athay, M., Riemer, M., Lambert, E., Kelley, S., Breda, C., et al. (2010). Manual of the peabody treatment progress battery. Nashville, TN: Vanderbilt University.

    Google Scholar 

  • Bickman, L., Kelley, S. D., & Athay, M. (2012). The technology of measurement feedback systems. Couple and Family Psychology: Research and Practice, 1(4), 274.

    PubMed  Google Scholar 

  • Bickman, L., Lyon, A. R., & Wolpert, M. (2016). Achieving precision mental health through effective assessment, monitoring, and feedback processes: Introduction to the special issue. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 271–276.

    PubMed  Google Scholar 

  • Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., et al. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31(1), 70.

    Google Scholar 

  • Borntrager, C., & Lyon, A. R. (2015). Client progress monitoring and feedback in school-based mental health. Cognitive and Behavioral Practice, 22(1), 74–86.

    PubMed  Google Scholar 

  • Bruns, E. J., Parker, E. M., Hensley, S., Pullmann, M. D., Benjamin, P. H., Lyon, A. R., et al. (2019). The role of the outer setting in implementation: Associations between state demographic, fiscal, and policy factors and use of evidence-based treatments in mental healthcare. Implementation Science, 14(1), 96.

    PubMed  Google Scholar 

  • Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18(1), 104–110.

    PubMed  Google Scholar 

  • Centers for Medicare & Medicaid Services. (2016). Better care. Smarter spending. Healthier people: Improving quality and paying for what works. Retrieved from https://www.cms.gov/newsroom/fact-sheets/better-care-smarter-spending-healthier-people-paying-providers-value-not-volume.

  • Chambers, D. A., Feero, W. G., & Khoury, M. J. (2016). Convergence of implementation science, precision medicine, and the learning health care system: A new model for biomedical research. JAMA, 315(18), 1941–1942.

    CAS  PubMed  PubMed Central  Google Scholar 

  • Chambers, D. A., & Norton, W. E. (2016). The adaptome: Advancing the science of intervention adaptation. American Journal of Preventive Medicine, 51(4), S124–S131.

    PubMed  PubMed Central  Google Scholar 

  • Chorpita, B. F., Bernstein, A., Daleiden, E. L., & Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 114–123.

    PubMed  Google Scholar 

  • Christon, L. M., McLeod, B. D., & Jensen-Doss, A. (2015). Evidence-based assessment meets evidence-based treatment: An approach to science-informed case conceptualization. Cognitive and Behavioral Practice, 22(1), 36–48.

    Google Scholar 

  • Coalition for the Advancement and Application of Psychological Science. (2018). Evidence-based practice decision-making for mental and behavioral health care. Retrieved from https://adaa.org/sites/default/files/CAAPS%2520Statement%2520September%25202018.pdf.

  • Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2016). Treating trauma and traumatic grief in children and adolescents. New York: Guilford Publications.

    Google Scholar 

  • Cone, J. D., & Hoier, T. S. (1986). Assessing children: The radical behavioral perspective. In R. Prinz (Ed.), Advances in behavioral assessment of children & families. New York: JAI.

    Google Scholar 

  • Connors, E. H., Arora, P., Curtis, L., & Stephan, S. H. (2015). Evidence-based assessment in school mental health. Cognitive and Behavioral Practice, 22, 60–73.

    Google Scholar 

  • Daleiden, E. L., & Chorpita, B. F. (2005). From data to wisdom: Quality improvement strategies supporting large-scale implementation of evidence-based services. Child and Adolescent Psychiatric Clinics of North America, 14(2), 329–349.

    PubMed  Google Scholar 

  • de Beurs, E., Warmerdam, L., & Twisk, J. (2019). Bias through selective inclusion and attrition: Representativeness when comparing provider performance with routine outcome monitoring data. Clinical Psychology & Psychotherapy, 26(4), 430–439.

    Google Scholar 

  • deJong, K. (2017). Effectiveness of progress monitoring: A meta-analysis. Toronto, CA: Paper presented at the 48th International Annual Meeting for the Society for Psychotherapy Research.

  • deJong, K., Barkham, M., Wolpert, M., Douglas, S., & Delgadillo, J. (2019). The impact of progress feedback on outcomes of psychological interventions: An overview of the literature and a roadmap for future research. Lancet Psychiatry.

  • Delgadillo, J., Overend, K., Lucock, M., Groom, M., Kirby, N., McMillan, D., et al. (2017). Improving the efficiency of psychological treatment using outcome feedback technology. Behaviour Research and Therapy, 99, 89–97.

    PubMed  Google Scholar 

  • Donabedian, A. (2002). An introduction to quality assurance in health care. Oxford: Oxford University Press.

    Google Scholar 

  • Doss, B. D., Thum, Y. M., Sevier, M., Atkins, D. C., & Christensen, A. (2005). Improving relationships: Mechanisms of change in couple therapy. Journal of Consulting and Clinical Psychology, 73(4), 624.

    PubMed  Google Scholar 

  • Douglas, S., Button, S., & Casey, S. E. (2016). Implementing for sustainability: Promoting use of a measurement feedback system for innovation and quality improvement. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 286–291.

    PubMed  Google Scholar 

  • Douglas, S., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy Research, 25(6), 678–693.

    PubMed  PubMed Central  Google Scholar 

  • Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., et al. (2009). Patients’ and doctors’ views on depression severity questionnaires incentivised in UK quality and outcomes framework: Qualitative study. BMJ, 338, b663.

    PubMed  Google Scholar 

  • Edbrooke-Childs, J., Jacob, J., Law, D., Deighton, J., & Wolpert, M. (2015). Interpreting standardized and idiographic outcome measures in CAMHS: What does change mean and how does it relate to functioning and experience? Child and Adolescent Mental Health, 20(3), 142–148.

    PubMed  Google Scholar 

  • Eisen, S. V., Dickey, B., & Sederer, L. I. (2000). A self-report symptom and problem rating scale to increase inpatients' involvement in treatment. Psychiatric Services, 51(3), 349–353.

    CAS  PubMed  Google Scholar 

  • Fortney, J. C., Unützer, J., Wrenn, G., Pyne, J. M., Smith, G. R., Schoenbaum, M., et al. (2017). A tipping point for measurement-based care. Psychiatric Services, 68, 179–188.

    PubMed  Google Scholar 

  • Garland, A. F., Bickman, L., & Chorpita, B. F. (2010). Change what? Identifying quality improvement targets by investigating usual mental health care. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 15–26.

    PubMed  Google Scholar 

  • Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routinely administered questionnaires for depression and anxiety: Systematic review. London: British Medical Association.

    Google Scholar 

  • Glasgow, R. E., & Riley, W. T. (2013). Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine, 45(2), 237–243.

    PubMed  Google Scholar 

  • Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., et al. (2016). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 426–440.

    PubMed  Google Scholar 

  • Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J. L., et al. (2016). Creating a climate for therapist improvement: A case study of an agency focused on outcomes and deliberate practice. Psychotherapy, 53(3), 367–375.

    PubMed  Google Scholar 

  • Gondek, D., Edbrooke-Childs, J., Fink, E., Deighton, J., & Wolpert, M. (2016). Feedback from outcome measures and treatment effectiveness, treatment efficiency, and collaborative practice: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 325–343.

    PubMed  Google Scholar 

  • Hafstad, G. S., Dyb, G., Jensen, T. K., Steinberg, A. M., & Pynoos, R. S. (2014). PTSD prevalence and symptom structure of DSM-5 criteria in adolescents and young adults surviving the 2011 shooting in norway. Journal of Affective Disorders, 169, 40–46.

    PubMed  Google Scholar 

  • Hall, C., Moldavsky, M., Taylor, J., Sayal, K., Marriott, M., Batty, M., et al. (2014). Implementation of routine outcome measurement in child and adolescent mental health services in the united kingdom: A critical perspective. European Child & Adolescent Psychiatry, 23(4), 239–242.

    CAS  Google Scholar 

  • Hawkins, E. J., Baer, J. S., & Kivlahan, D. R. (2008). Concurrent monitoring of psychological distress and satisfaction measures as predictors of addiction treatment retention. Journal of Substance Abuse Treatment, 35(2), 207–216.

    PubMed  Google Scholar 

  • Health Resources and Services Administration. (2019). Collaborative improvement and innovation networks (CoIINs). Retrieved from https://mchb.hrsa.gov/maternal-child-health-initiatives/collaborative-improvement-innovation-networks-coiins.

  • Hermann, R. C., Rollins, C. K., & Chan, J. A. (2007). Risk-adjusting outcomes of mental health and substance-related care: A review of the literature. Harvard Review of Psychiatry, 15(2), 52–69.

    PubMed  Google Scholar 

  • Higa-McMillan, C. K., Powell, C., Daleiden, E. L., & Mueller, C. W. (2011). Pursuing an evidence-based culture through contextualized feedback: Aligning youth outcomes and practices. Professional Psychology: Research and Practice, 42(2), 137.

    Google Scholar 

  • Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51.

    PubMed  Google Scholar 

  • Jensen-Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C. F., et al. (2018a). Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration and Policy in Mental Health and Mental Health Services Research, 45(1), 48–61. https://doi.org/10.1007/s10488-016-0763-0

    Article  PubMed  Google Scholar 

  • Jensen-Doss, A., Smith, A. M., Becker-Haimes, E. M., Ringle, V. M., Walsh, L. M., Nanda, M., et al. (2018b). Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. Administration and Policy in Mental Health and Mental Health Services Research, 45(3), 392–403.

    PubMed  Google Scholar 

  • Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368.

    PubMed  PubMed Central  Google Scholar 

  • Kelley, S. D., de Andrade, A., Vides, R., Sheffer, E., & Bickman, L. (2010). Exploring the black box: Measuring youth treatment process and progress in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 287–300.

    PubMed  Google Scholar 

  • Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., et al. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews. https://doi.org/10.1002/14651858.CD011119.pub2.

    Article  Google Scholar 

  • Kiresuk, T. J., Stelmachers, Z. T., & Schultz, S. K. (1982). Quality assurance and goal attainment scaling. Professional Psychology, 13(1), 145.

    Google Scholar 

  • Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15–22.

    PubMed  Google Scholar 

  • Kotte, A., Hill, K. A., Mah, A. C., Korathu-Larson, P. A., Au, J. R., Izmirian, S., et al. (2016). Facilitators and barriers of implementing a measurement feedback system in public youth mental health. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 861–878.

    PubMed  Google Scholar 

  • Krageloh, C., Czuba, K., Billington, R., Kersten, P., & Siegert, R. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 563–570.

    Google Scholar 

  • Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301.

    Google Scholar 

  • Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537.

    PubMed  Google Scholar 

  • Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., et al. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry, 76(3), 324–335.

    PubMed  Google Scholar 

  • Lewis, C. C., Puspitasari, A., Boyd, M. R., Scott, K., Marriott, B. R., Hoffman, M., et al. (2018). Implementing measurement based care in community mental health: A description of tailored and standardized methods. BMC Research Notes, 11(1), 76.

    PubMed  PubMed Central  Google Scholar 

  • Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., et al. (2015). Implementing measurement-based care (iMBC) for depression in community mental health: A dynamic cluster randomized trial study protocol. Implementation Science, 10(1), 127.

    PubMed  Google Scholar 

  • Lindhiem, O., Bennett, C. B., Orimoto, T. E., & Kolko, D. J. (2016). A meta-analysis of personalized treatment goals in psychotherapy: A preliminary report and call for more studies. Clinical Psychology: Science and Practice, 23(2), 165–176.

    Google Scholar 

  • Lloyd, C. E., Duncan, C., & Cooper, M. (2019). Goal measures for psychotherapy: A systematic review of self-report, idiographic instruments. Clinical Psychology: Science and Practice, 26, e12281.

    Google Scholar 

  • Lyon, A. R., Borntrager, C., Nakamura, B., & Higa-McMillan, C. (2013). From distal to proximal: Routine educational data monitoring in school-based mental health. Advances in School Mental Health Promotion, 6(4), 263–279.

    Google Scholar 

  • Lyon, A. R., Connors, E., Jensen-Doss, A., Landes, S. J., Lewis, C. C., McLeod, B. D., et al. (2017). Intentional research design in implementation science: Implications for the use of nomothetic and idiographic assessment. Translational Behavioral Medicine, 7(3), 567–580.

    PubMed  PubMed Central  Google Scholar 

  • Lyon, A. R., & Lewis, C. C. (2016). Designing health information technologies for uptake: Development and implementation of measurement feedback systems in mental health service delivery. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 344–349.

    PubMed  Google Scholar 

  • Lyon, A. R., Lewis, C. C., Boyd, M. R., Hendrix, E., & Liu, F. (2016). Capabilities and characteristics of digital measurement feedback systems: Results from a comprehensive review. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 441–466.

    PubMed  Google Scholar 

  • Martin, A., Fishman, R., Baxter, L., & Ford, T. (2011). Practitioners’ attitudes towards the use of standardized diagnostic assessment in routine practice: A qualitative study in two child and adolescent mental health services. Clinical Child Psychology and Psychiatry, 16(3), 407–420.

    PubMed  Google Scholar 

  • McGuire, M. K., Scheyer, E. T., & Gwaltney, C. (2014). Commentary: Incorporating patient-reported outcomes in periodontal clinical trials. Journal of Periodontology, 85(10), 1313–1319.

    PubMed  Google Scholar 

  • McLeod, B. D., Jensen-Doss, A., & Ollendick, T. H. (2013). Diagnostic and behavioral assessment in children and adolescents: A clinical guide. London: Guilford Press.

    Google Scholar 

  • Meehan, T., McIntosh, W., & Bergen, H. (2006). Aggressive behaviour in the high-secure forensic setting: The perceptions of patients. Journal of Psychiatric and Mental Health Nursing, 13(1), 19–25.

    CAS  PubMed  Google Scholar 

  • Mellor-Clark, J., Cross, S., Macdonald, J., & Skjulsvik, T. (2016). Leading horses to water: Lessons from a decade of helping psychological therapy services use routine outcome measurement to improve practice. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 279–285.

    PubMed  Google Scholar 

  • Nakamura, B. J., Daleiden, E. L., & Mueller, C. W. (2007). Validity of treatment target progress ratings as indicators of youth improvement. Journal of Child and Family Studies, 16(5), 729–741.

    Google Scholar 

  • Nakamura, B. J., Higa-McMillan, C., & Chorpita, B. F. (2012). Sustaining hawaii’s evidence-based service system in children’s mental health. In R. K. McHugh & D. H. Barlow (Eds.), Dissemination and implementation of evidence-based psychological interventions. Oxford: Oxford University Press.

    Google Scholar 

  • National Center for School Mental Health. (2019). School Health Services National Quality Initiative. Retrieved from https://www.schoolmentalhealth.org/Our-Work/Training--Technical-Assistance/.

  • National Governors Association. (2019). Measuring Student Health. Webinar for state leaders hosted by the National Governors Association: Wellbeing and Safety.

    Google Scholar 

  • National Health Service England. (2019, February). Adult Improvement Access to Psychological Therapies programme. Retrieved from https://www.england.nhs.uk/mental-health/adults/iapt/.

  • Pomerantz, A. S., Kearney, L. K., Wray, L. O., Post, E. P., & McCarthy, J. F. (2014). Mental health services in the medical home in the Department of Veterans Affairs: Factors for successful integration. Psychological Services, 11(3), 243.

    PubMed  Google Scholar 

  • Porter, M. E., Larsson, S., & Lee, T. H. (2016). Standardizing patient outcomes measurement. New England Journal of Medicine, 374(6), 504–506.

    CAS  Google Scholar 

  • Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46(4), 418.

    Google Scholar 

  • Resnick, S. G., & Hoff, R. A. (2019). Observations from the national implementation of Measurement Based Care in Mental Health in the Department of Veterans Affairs. Psychological services. https://doi.org/10.1037/ser0000351.

    Article  PubMed  Google Scholar 

  • Riemer, M., Athay, M. M., Bickman, L., Breda, C., Kelley, S. D., Andrade, De, et al. (2012). The peabody treatment progress battery: History and methods for developing a comprehensive measurement battery for youth mental health. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 3–12.

    PubMed  Google Scholar 

  • Ruble, L. A., & McGrew, J. H. (2015). COMPASS practice outcome: Idiographic assessment and development of a measure. COMPASS and implementation science (pp. 27–32). New York: Springer.

    Google Scholar 

  • Sales, C., & Alves, P. C. (2012). Individualized patient-progress systems: Why we need to move towards a personalized evaluation of psychological treatments. Canadian Psychology/Psychologie Canadienne, 53(2), 115.

    Google Scholar 

  • Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22, 49–59.

    PubMed  PubMed Central  Google Scholar 

  • Sheidow, A. J., Schoenwald, S. K., Wagner, H. R., Allred, C. A., & Burns, B. J. (2007). Predictors of workforce turnover in a transported treatment program. Administration and Policy in Mental Health and Mental Health Services Research, 34(1), 45–56.

    PubMed  Google Scholar 

  • Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78(3), 298.

    PubMed  Google Scholar 

  • Steinfeld, B. I., & Keyes, J. A. (2011). Electronic medical records in a multidisciplinary health care setting: A clinical perspective. Professional Psychology: Research and Practice, 42(6), 426.

    Google Scholar 

  • Steinfeld, B., Scott, J., Vilander, G., Marx, L., Quirk, M., Lindberg, J., et al. (2015). The role of lean process improvement in implementation of evidence-based practices in behavioral health care. The Journal of Behavioral Health Services & Research, 42(4), 504–518.

    Google Scholar 

  • Stout, R. L., Rubin, A., Zwick, W., Zywiak, W., & Bellino, L. (1999). Optimizing the cost-effectiveness of alcohol treatment: A rationale for extended case monitoring. Addictive Behaviors, 24(1), 17–35.

    CAS  PubMed  Google Scholar 

  • Tabak, N. T., Link, P. C., Holden, J., & Granholm, E. (2015). Goal attainment scaling: Tracking goal achievement in consumers with serious mental illness. American Journal of Psychiatric Rehabilitation, 18(2), 173–186.

    Google Scholar 

  • The Joint Commission. (2011). Comprehensive accreditation manual for behavioral health care. Oakbrook Terrace, Illinois: Joint Commission Resources.

    Google Scholar 

  • The Joint Commission. (2018). New outcome measures standard. Retrieved from https://www.jointcommission.org/accreditation/bhc_new_outcome_measures_standard.aspx.

  • The National Quality Forum. (2018). Improving healthcare quality. Retrieved from https://www.qualityforum.org/Setting_Priorities/Improving_Healthcare_Quality.aspx.

  • Trauer, T., Gill, L., Pedwell, G., & Slattery, P. (2006). Routine outcome measurement in public mental health—What do clinicians think? Australian Health Review, 30(2), 144–147.

    PubMed  Google Scholar 

  • Trujols, J., Solà, I., Iraurgi, I., Campins, M. J., Ribalta, E., & Duran-Sindreu, S. (2020). Individualized and standardized outcome measures: Further arguments in favor of cohabitation. Administration and Policy in Mental Health and Mental Health Services Research, 47(3), 339–343.

    PubMed  Google Scholar 

  • Turner-Stokes, L. (2009). Goal attainment scaling (GAS) in rehabilitation: A practical guide. Clinical Rehabilitation, 23(4), 362–370.

    PubMed  Google Scholar 

  • U.S. Department of Health and Human Services Health Resources and Services Administration. (April 2011). Quality improvement. DHHS. Retrieved from https://www.hrsa.gov/sites/default/files/quality/toolbox/508pdfs/qualityimprovement.pdf.

  • Unützer, J., Chan, Y. F., Hafer, E., Knaster, J., Shields, A., Powers, D., et al. (2012). Quality improvement with pay-for-performance incentives in integrated behavioral health care. American Journal of Public Health, 102(6), e41–e45.

    PubMed  PubMed Central  Google Scholar 

  • Valla, B., & Prescott, D. S. (2019). Beyond best practice: How mental health services can be better. New York, NY: Routledge.

    Google Scholar 

  • VanLare, J. M., Blum, J. D., & Conway, P. H. (2012). Linking performance with payment: Implementing the physician value-based payment modifier. JAMA, 308(20), 2089–2090.

    CAS  PubMed  Google Scholar 

  • Vermeersch, D. A., Lambert, M. J., & Burlingame, G. M. (2000). Outcome questionnaire: Item sensitivity to change. Journal of Personality Assessment, 74(2), 242–261.

    CAS  PubMed  Google Scholar 

  • Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144.

    PubMed  Google Scholar 

  • Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., et al. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369.

    PubMed  Google Scholar 

  • Weisz, J., Chorpita, B., Palinkas, L., Schoenwald, S., Miranda, J., Bearman, S., et al. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69(3), 274–282.

    PubMed  Google Scholar 

Download references

Funding

Funding was provided by National Institute of Mental Health (Grant No. K08 MH116119).

Author information

Authors and Affiliations

  1. Department of Psychiatry, Yale University, 389 Whitney Avenue, Office 106, New Haven, CT, 06511, USA

    Elizabeth H. Connors

  2. Department of Leadership, Policy and Organizations, Vanderbilt University, 230 Appleton Place, Nashville, TN, 37203, USA

    Susan Douglas

  3. Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33124, USA

    Amanda Jensen-Doss

  4. VISN 16 Mental Illness Research, Education, and Clinical Center (MIRECC), Central Arkansas Veterans Healthcare System, 2200 Fort Roots Drive, North Little Rock, AR, 72114, USA

    Sara J. Landes

  5. Department of Psychiatry, University of Arkansas for Medical Sciences, 4301 W. Markham St, Little Rock, AR, 72205, USA

    Sara J. Landes

  6. Kaiser Permanente Washington Health Research Institute, 1730 Minor Ave, Suite 1600, Seattle, WA, 98101-1466, USA

    Cara C. Lewis

  7. Department of Psychiatry and Behavioral Sciences, University of Washington, School of Medicine, 6200 NE 74th Street, Suite 100, Seattle, WA, 98115, USA

    Cara C. Lewis & Aaron R. Lyon

  8. Department of Psychology, Virginia Commonwealth University, 806 W. Franklin Street, PO Box 842018, Richmond, VA, 23284, USA

    Bryce D. McLeod

  9. Clinical Practice, Training, and Research and Evaluation, Hathaway-Sycamores Child and Family Services, 100 W. Walnut Street, Ste #375, Pasadena, CA, 91124, USA

    Cameo Stanick

Authors
  1. Elizabeth H. Connors
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susan Douglas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amanda Jensen-Doss
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sara J. Landes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Cara C. Lewis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Bryce D. McLeod
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Cameo Stanick
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Aaron R. Lyon
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elizabeth H. Connors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Connors, E.H., Douglas, S., Jensen-Doss, A. et al. What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals. Adm Policy Ment Health 48, 250–265 (2021). https://doi.org/10.1007/s10488-020-01063-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-020-01063-w

Keywords