Routine outcome monitoring (ROM) has become an increasingly utilized tool in therapeutic practice that has the potential to improve therapy outcomes. This study aimed to synthesize the findings of existing qualitative studies investigating how clinicians use ROM in their work with clients. A systematic search of qualitative studies on clinicians' experience with the use of ROM in mental health services was conducted via PsycInfo, PsycArticles, Medline, Web of Science, and Scopus databases. Qualitative meta-analysis was used to synthesize the finding of the primary studies. Forty-seven studies met the inclusion criteria. The analysis resulted in 21 meta-categories organized into six clusters, namely (1) obtaining clinically relevant information, (2) adapting treatment, (3) facilitating communication, (4) enhancing the therapeutic relationship, (5) facilitating change in clients, and (6) personalized usage of ROM. The meta-analysis revealed that clinicians utilized ROM in diverse ways, including both informational and communicational functions. From the clinicians' perspective, ROM was an element that, on the one hand, introduced additional structure and standardization in treatment and, on the other hand, allowed for greater flexibility and tailoring of treatment.

Department of Psychology Faculty of Social Studies Masaryk University Joštova 10 602 00 Brno Czech Republic

Zobrazit více v PubMed

Aafjes-van Doorn, K., & de Jong, K. (2022). How to make the most of routine outcome monitoring (ROM): A multitude of clinical decisions and nuances to consider. Journal of Clinical Psychology,78(10), 2054–2065. 10.1002/jclp.23438 PubMed

*Antunes, R. P., Sales, C. M. D., & Elliott, R. (2020). The clinical utility of the personal questionnaire (PQ): A mixed methods study. Counselling Psychology Quarterly,33(1), 25–45. 10.1080/09515070.2018.1439451

Barber, J., & Resnick, S. G. (2022). Collect, share, act: A transtheoretical clinical model for doing measurement-based care in mental health treatment. Psychological Services. 10.1037/ser0000629 PubMed

Barkham, M., De Jong, K., Delgadillo, J., & Lutz, W. (2023). Routine outcome monitoring (ROM) and feedback: Research review and recommendations. Psychotherapy Research,33(7), 1–15. 10.1080/10503307.2023.2181114 PubMed

Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services,62(12), 1423–1429. 10.1176/appi.ps.002052011 PubMed

Boswell, J. F., Hepner, K. A., Lysell, K., Rothrock, N. E., Bott, N., Childs, A. W., Douglas, S., Owings-Fonner, N., Wright, C. V., Stephens, K. A., Bard, D. E., Aajmain, S., & Bobbitt, B. L. (2023). The need for a measurement-based care professional practice guideline. Psychotherapy,60(1), 1–16. 10.1037/pst0000439 PubMed

*Bowens, M., & Cooper, M. (2012). Development of a client feedback tool: A qualitative study of therapists’ experiences of using the therapy personalisation forms. European Journal of Psychotherapy and Counselling,14(1), 47–62. 10.1080/13642537.2012.652392

Boyce, M. B., Browne, J. P., & Greenhalgh, J. (2014). The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: A systematic review of qualitative research. BMJ Quality and Safety,23(6), 508–518. 10.1136/bmjqs-2013-002524 PubMed

Brattland, H., Koksvik, J. M., Burkeland, O., Klöckner, C. A., Lara-Cabrera, M. L., Miller, S. D., Wampold, B., Ryum, T., & Iversen, V. C. (2019). Does the working alliance mediate the effect of routine outcome monitoring (ROM) and alliance feedback on psychotherapy outcomes? A secondary analysis from a randomized clinical trial. Journal of Counseling Psychology,66(2), 234–246. 10.1037/cou0000320 PubMed

*Brooks Holliday, S., Hepner, K. A., Farmer, C. M., Ivany, C., Iyiewuare, P., McGee-Vincent, P., McCaslin, S., & Rosen, C. S. (2020). A qualitative evaluation of veterans health administration’s implementation of measurement-based care in behavioral health. Psychological Services,17(3), 271–281. 10.1037/ser0000390 PubMed PMC

*Brooks Holliday, S., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R., Smith, B. N., & Rosen, C. (2021). Discussing measurement-based care with patients: An analysis of clinician-patient dyads. Psychotherapy Research,31(2), 211–223. 10.1080/10503307.2020.1776413 PubMed

*Callaly, T., & Hallebone, A. P. E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. Australian Health Review,24(1), 43–50. 10.1071/AH010043 PubMed

*Callaly, T., Hyland, M., Coombs, T., & Trauer, T. (2006). Routine outcome measurement in public mental health: Results of a clinician survey. Australian Health Review,30(2), 164–173. 10.1071/ah060164 PubMed

Carlier, I. V. E., Meuldijk, D., van Vliet, I. M., van Fenema, E., van der Wee, N. J. A., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice,18(1), 104–110. 10.1111/j.1365-2753.2010.01543.x PubMed

Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (pp. 85–133). Wiley.

*Coombs, T., Stapley, K., & Pirkis, J. (2011). The multiple uses of routine mental health outcome measures in Australia and New Zealand: Experiences from the field. Australasian Psychiatry,19(3), 247–253. 10.3109/10398562.2011.562507 PubMed

Cooper, M., Norcross, J. C., Raymond-Barker, B., & Hogan, T. P. (2019). Psychotherapy preferences of laypersons and mental health professionals: Whose therapy is it? Psychotherapy,56(2), 205–216. 10.1037/pst0000226 PubMed

*Dayton, D. (2011). Let me see my feedback: A phenomenological exploration of the feedback-receiving process at a university counseling center. Doctoral dissertation, Brigham Young University. https://scholarsarchive.byu.edu/etd/2602

*De Beurs, E., den Hollander, G. M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E., & Zitman, F. G. (2011). Routine outcome monitoring in the Netherlands: Practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology and Psychotherapy,18(1), 1–12. 10.1002/cpp.696 PubMed

De Jong, K., & Aafjes-van Doorn, K. (2022). Routine outcome monitoring: The need for case examples. Journal of Clinical Psychology,78(10), 1963–1972. 10.1002/jclp.23441 PubMed

De Jong, K., Conijn, J. M., Gallagher, R. A., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review. 10.1016/j.cpr.2021.102002 PubMed

De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research,22(4), 464–474. 10.1080/10503307.2012.673023 PubMed

*De Wilde Brand, O., Clarke, S., & Arntz, A. (2022). The use of borderline personality disorder severity index-iv feedback in adjusting borderline personality disorder treatment: Therapists and patients perspectives. BMC Psychiatry,22(1), 469. 10.1186/s12888-022-04104-w PubMed PMC

*Delgadillo, J., Overend, K., Lucock, M., Groom, M., Kirby, N., McMillan, D., Gilbody, S., Lutz, W., Rubel, J. A., & De Jong, K. (2017). Improving the efficiency of psychological treatment using outcome feedback technology. Behaviour Research and Therapy,99, 89–97. 10.1016/j.brat.2017.09.011 PubMed

Dias, P., Lima, V. S., Machado, B. C., Campos, J., Teixeira, L., Torres, N., Lopes, L., & Veiga, E. (2016). Viabilidade da monitorização da intervenção psicoterapêutica com adolescentes com recurso a aplicações móveis. Análise Psicológica,34(1), 1–14. 10.14417/ap.1047

Douglas, S. R., Jonghyuk, B., de Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy Research,25(6), 678–693. 10.1080/10503307.2015.1059966 PubMed PMC

Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy,3(1), 3–12.

*Errázuriz, P., & Zilcha-Mano, S. (2018). In psychotherapy with severe patients discouraging news may be worse than no news: The impact of providing feedback to therapists on psychotherapy outcome, session attendance, and the alliance. Journal of Consulting and Clinical Psychology,86(2), 125–139. 10.1037/ccp0000277.supp PubMed

*Esmiol-Wilson, E., Partridge, R., Brandon, M., Kollar, S., & Benning-Cho, S. (2017). From resistance to buy-in: Experiences of clinicians in training using feedback-informed treatment. Journal of Couple and Relationship Therapy,16(1), 20–41. 10.1080/15332691.2016.1178615

*Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? Journal of Behavioral Health Services and Research,30(4), 393–405. 10.1007/BF02287427 PubMed

*Gleacher, A. A., Olin, S. S., Nadeem, E., Pollock, M., Ringle, V., Bickman, L., Douglas, S., & Hoagwood, K. (2016). Implementing a measurement feedback system in community mental health clinics: A case study of multilevel barriers and facilitators. Administration and Policy in Mental Health and Mental Health Services Research,43(3), 426–440. 10.1007/s10488-015-0642-0 PubMed PMC

*Hall, C. L., Taylor, J., Moldavsky, M., Marriott, M., Pass, S., Newell, K., Goodman, R., Sayal, K., & Hollis, C. (2014). A qualitative process evaluation of electronic session-by-session outcome measurement in child and adolescent mental health services. BMC Psychiatry. 10.1186/1471-244X-14-113 PubMed PMC

Harden, A., Garcia, J., Oliver, S., Rees, R., Shepherd, J., Brunton, G., & Oakley, A. (2004). Applying systematic review methods to studies of people’s views: An example from public health research. Journal of Epidemiology and Community Health,58(9), 794–800. 10.1136/jech.2003.014829 PubMed PMC

Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 37–69). Oxford University Press.

*Hovland, R. T., & Moltu, C. (2019). Making way for a clinical feedback system in the narrow space between sessions: Navigating competing demands in complex healthcare settings. International Journal of Mental Health Systems,13(1), 1–11. 10.1186/s13033-019-0324-5 PubMed PMC

*Hovland, R. T., Ytrehus, S., Mellor, C. J., & Moltu, C. (2023). How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice. Journal of Clinical Psychology,79, 711–728. 10.1002/jclp.22992Ionita PubMed

Ionita, G., & Fitzpatrick, M. (2014). Bringing science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology,55(3), 187–196.

*Ionita, G., Fitzpatrick, M., Tomaro, J., Chen, V. V., & Overington, L. (2016). Challenges of using progress monitoring measures: insights from practicing clinicians. Journal of Counseling Psychology,63(2), 173–182. 10.1037/cou0000122 PubMed

*James, K., Elgie, S., Adams, J., Henderson, T., & Salkovskis, P. (2015). Session-by-session outcome monitoring in CAMHS: Clinicians’ beliefs. Cognitive Behaviour Therapist,8, 1–19. 10.1017/S1754470X15000653

Janse, P. D., Veerkamp, C., De Jong, K., Van Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2023). Exploring therapist characteristics as potential moderators of the effects of client feedback on treatment outcome. Clinical Psychology and Psychotherapy,30(3), 690–701. 10.1002/cpp.2828 PubMed

Jensen-Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C. F., & Hawley, K. M. (2018). Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration and Policy in Mental Health,45(1), 48–61. 10.1007/s10488-016-0763-0 PubMed PMC

Jensen-Doss, A., & Hawley, K. M. (2010). Understanding barriers to evidence-based assessment: Clinician attitudes toward standardized assessment tools. Journal of Clinical Child and Adolescent Psychology,39(6), 885–896. 10.1080/15374416.2010.517169 PubMed PMC

Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A., De Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews. 10.1002/14651858.CD011119.pub2 PubMed PMC

*Koementas-de Vos, M. M. W., van Dijk, M., Tiemens, B., De Jong, K., Witteman, C. L. M., & Nugter, M. A. (2022). Feedback-informed group treatment: A qualitative study of the experiences and needs of patients and therapists. International Journal of Group Psychotherapy,72(3), 193–227. 10.1080/00207284.2022.2086557 PubMed

Krägeloh, C. U., Czuba, K. J., Billington, D. R., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services,66(3), 224–241. 10.1176/appi.ps.201400141 PubMed

Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association. 10.1037/12141-000

Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy,55(4), 520–537. 10.1037/pst0000167 PubMed

Langer, D. A., & Jensen-Doss, A. (2018). Shared decision-making in youth mental health care: Using the evidence to plan treatments collaboratively. Journal of Clinical Child and Adolescent Psychology,47(5), 821–831. 10.1080/15374416.2016.1247358 PubMed PMC

*Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health,2(3), 105–113. 10.1007/s12310-010-9038-1 PubMed PMC

Låver, J., McAleavey, A., Valaker, I., Castonguay, L. G., & Moltu, C. (2023). Therapists’ and patients’ experiences of using patients’ self-reported data in ongoing psychotherapy processes—A systematic review and meta-analysis of qualitative studies. Psychotherapy Research. Advance online publication. 10.1080/10503307.2023.2222896 PubMed

*Lavik, K. O., Veseth, M., Frøysa, H., Stefansen, J., Nøtnes, J. C., & Moltu, C. (2020). This is what i need a clinical feedback system to do for me: A qualitative inquiry into perspectives of adolescents and their therapists. Journal of Clinical Psychology,79(3), 729–747. 10.1002/jclp.23100 PubMed

Levitt, H. M. (2018). How to conduct a qualitative meta-analysis: Tailoring methods to enhance methodological integrity. Psychotherapy Research,28(3), 367–378. 10.1080/10503307.2018.1447708 PubMed

*Lucock, M., Halstead, J., Leach, C., Barkham, M., Tucker, S., Randal, C., Middleton, J., Khan, W., Catlow, H., Waters, E., & Saxon, D. (2015). A mixed-method investigation of patient monitoring and enhanced feedback in routine practice: Barriers and facilitators. Psychotherapy Research,25(6), 633–646. 10.1080/10503307.2015.1051163 PubMed PMC

Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A.-K. (2019). Towards integrating personalized feedback research into clinical practice: Development of the trier treatment navigator (TTN). Behaviour Research and Therapy,120, 103438. 10.1016/j.brat.2019.103438 PubMed

Lutz, W., Schwartz, B., & Delgadillo, J. (2022). Measurement-based and data-informed psychological therapy. Annual Review of Clinical Psychology,18(1), 1–28. 10.1146/annurev-clinpsy-071720-014821 PubMed

Lyon, A. R., Lewis, C. C., Boyd, M. R., Hendrix, E., & Liu, F. (2016). Capabilities and characteristics of digital measurement feedback systems: Results from a comprehensive review. Administration and Policy in Mental Health,43(3), 441–466. 10.1007/s10488-016-0719-4 PubMed PMC

Macdonald, J., & Mellor-Clark, J. (2015). Correcting psychotherapists’ blindsidedness: Formal feedback as a means of overcoming the natural limitations of therapists. Clinical Psychology and Psychotherapy,22(3), 249–257. 10.1002/cpp.1887 PubMed

*MacMurray, W. J. (2019). Routine outcome measure implementation in graduate training programs for mental health professionals. Doctoral dissertation, The Chicago School of Professional Psychology. https://www.proquest.com/dissertations-theses/routine-outcome-measure-implementation-graduate/docview/2239982887/se-2

*Martin, A. M., Fishman, R., Baxter, L., & Ford, T. (2011). Practitioners’ attitudes towards the use of standardized diagnostic assessment in routine practice: A qualitative study in two child and adolescent mental health services. Clinical Child Psychology and Psychiatry,16(3), 407–420. 10.1177/1359104510366284 PubMed

*Meehan, T., McCombes, S., Hatzipetrou, L., & Catchpoole, R. (2006). Introduction of routine outcome measures: Staff reactions and issues for consideration. Journal of Psychiatric and Mental Health Nursing,13(5), 581–587. 10.1111/j.1365-2850.2006.00985.x PubMed

Meier, S. T. (2015). Incorporating progress monitoring and outcome assessment into counseling and psychotherapy: A primer. Oxford University Press.

Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy,52(4), 449–457. 10.1037/pst0000031 PubMed

*Moltu, C., Veseth, M., Stefansen, J., Nøtnes, J. C., Skjølberg, Å., Binder, P. E., Castonguay, L. G., & Nordberg, S. S. (2018). This is what i need a clinical feedback system to do for me: A qualitative inquiry into therapists’ and patients’ perspectives. Psychotherapy Research,28(2), 250–263. 10.1080/10503307.2016.1189619 PubMed

Norcross, J. C., & Wampold, B. E. (Eds.). (2019). Psychotherapy relationships that work. Oxford University Press.

*Norman, S., Dean, S., Hansford, L., & Ford, T. (2014). Clinical practitioner’s attitudes towards the use of routine outcome monitoring within child and adolescent mental health services: A qualitative study of two child and adolescent mental health services. Clinical Child Psychology and Psychiatry,19(4), 576–595. 10.1177/1359104513492348 PubMed

Poston, J. M., & Hanson, W. E. (2010). Meta-analysis of psychological assessment as a therapeutic intervention. Psychological Assessment,22(2), 203–212. 10.1037/a0018679 PubMed

Prescott, D. S. (2017). Feedback-informed treatment: An overview of the basics and core competencies. In D. S. Prescott, C. L. Maeschalck, & S. D. Miller (Eds.), Feedback-informed treatment in clinical practice: Reaching for excellence (pp. 37–52). American Psychological Association. 10.1037/0000039-003

Rennie, D. L., Phillips, J. R., & Quartaro, G. K. (1988). Grounded theory: A promising approach to conceptualization in psychology? Canadian Psychology,29, 139–150.

Rognstad, K., Wentzel-Larsen, T., Neumer, S.-P., & Kjøbli, J. (2023). A systematic review and meta-analysis of measurement feedback systems in treatment for common mental health disorders. Administration and Policy in Mental Health and Mental Health Services Research,50(2), 269–282. 10.1007/s10488-022-01236-9 PubMed PMC

*Savic, M., & Fomiatti, R. (2016). Producing progress through the implementation of outcome monitoring in alcohol and other drug treatment. Contemporary Drug Problems,43(2), 169–187. 10.1177/0091450916641979

*Sharples, E., Qin, C., Goveas, V., Gondek, D., Deighton, J., Wolpert, M., & Edbrooke-Childs, J. (2017). A qualitative exploration of attitudes towards the use of outcome measures in child and adolescent mental health services. Clinical Child Psychology and Psychiatry,22(2), 219–228. 10.1177/1359104516652929 PubMed

Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology,78, 298–311. 10.1037/a0019247 PubMed

*Sichel, C. E., & Connors, E. H. (2022). Measurement feedback system implementation in public youth mental health treatment services: A mixed methods analysis. Implementation Science Communications,3(1), 1–16. 10.1186/s43058-022-00356-5 PubMed PMC

Solstad, S. M., Castonguay, L. G., & Moltu, C. (2019). Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature. Psychotherapy Research,29(2), 157–170. 10.1080/10503307.2017.1326645 PubMed

*Southwick, J. S. (2022). Therapist utilization of evidence-based treatment monitoring. Doctoral dissertation, Brigham Young University. https://scholarsarchive.byu.edu/etd/3080

*Stefancic, A., Rogers, R. T., Styke, S., Xu, X., Buchsbaum, R., Nossel, I., Cabassa, L. J., Stroup, T. S., & Kimhy, D. (2022). Development of the first episode digital monitoring mHealth intervention for people with early psychosis: Qualitative interview study with clinicians. JMIR Mental Health,9(11), 1–16. 10.2196/41482 PubMed PMC

*Sundet, R. (2012). Therapist perspectives on the use of feedback on process and outcome: Patient-focused research in practice. Canadian Psychology,53(2), 122–130. 10.1037/a0027776

*Sundram, F., Hawken, S. J., Stasiak, K., Lucassen, M. F. G., Fleming, T., Shepherd, M., Greenwood, A., Osborne, R., & Merry, S. N. (2017). Tips and traps: Lessons from codesigning a clinician e-monitoring tool for computerized cognitive behavioral therapy. JMIR Mental Health,4(1), 1–14. 10.2196/mental.5878 PubMed PMC

*Tarp, K., Holmberg, T. T., Moeller, A. M., & Lichtenstein, M. B. (2022). Patient and therapist experiences of using a smartphone application monitoring anxiety symptoms. International Journal of Qualitative Studies on Health and Well-Being,17(1), 1–14. 10.1080/17482631.2022.2044981 PubMed PMC

*Teruya, C., Hardy, M., Hser, Y.-I., & Evans, E. (2006). Implementation of a statewide outcome monitoring system: lessons learned from substance abuse treatment provider staff. Qualitative Health Research,16(3), 337–352. 10.1177/1049732305279137 PubMed

Timulak, L. (2009). Meta-analysis of qualitative studies: A tool for reviewing qualitative research findings in psychotherapy. Psychotherapy Research,19(4–5), 591–600. 10.1080/10503300802477989 PubMed

Timulak, L. (2013). Qualitative meta-analysis. In U. Flick (Ed.), The SAGE handbook of qualitative data analysis (pp. 481–495). Sage.

Timulak, L., & Creaner, M. (2023). Meta-analysis in qualitative research: A descriptive-interpretative approach. In U. Flick (Ed.), The SAGE handbook of qualitative research design. Sage.

Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012). Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Medical Research Methodology,12, 181. 10.1186/1471-2288-12-181 PubMed PMC

*Trauer, T., Pedwell, G., & Gill, L. (2009). The effect of guidance in the use of routine outcome measures in clinical meetings. Australian Health Review,33(1), 144–151. 10.1071/ah090144 PubMed

Tryon, G. S. (2018). Goals and psychotherapy research. In M. Cooper & D. Law (Eds.), Working with goals in psychotherapy and counselling (pp. 87–109). Oxford University Press. 10.1093/med-psych/9780198793687.003.0005

*Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research,12(1), 71–80. 10.1080/14733145.2011.565125

*Van Wert, M. J., Malik, M., Memel, B., Moore, R., Buccino, D., Hackerman, F., Kumari, S., Everett, A., & Narrow, W. (2021). Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project. Journal of Evaluation in Clinical Practice,27(4), 767–775. 10.1111/jep.13457 PubMed

Wampold, B. E., & Miller, S. D. (2023). Measurement-based care professional practice guideline: Fine, but guidelines do not make good therapy. Psychotherapy,60(1), 17–19. 10.1037/pst0000450 PubMed

*Whitcomb, K. E., Woodland, S. C., & Burlingame, G. M. (2018). Do clinicians really use feedback-monitoring systems? A qualitative analysis of 16 group leaders. Psychotherapy,55(2), 132–143. 10.1037/pst0000141.supp PubMed

*Winkeljohn Black, S., Owen, J., Chapman, N., Lavin, K., Drinane, J. M., & Kuo, P. (2017). Feedback informed treatment: An empirically supported case study of psychodynamic treatment. Journal of Clinical Psychology,73(11), 1499–1509. 10.1002/jclp.22529 PubMed

*Wolpert, M., Curtis-Tyler, K., & Edbrooke-Childs, J. (2016). A qualitative exploration of patient and clinician views on patient reported outcome measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research,43(3), 309–315. 10.1007/s10488-014-0586-9 PubMed PMC

*Woodland, S. C. (2015). Process Feedback in Group Psychotherapy: A Qualitative Inquiry into Leader Implementation of GQ/OQ Feedback. Doctoral dissertation, Brigham Young University. https://scholarsarchive.byu.edu/etd/5606

Youn, S. J., Kraus, D. R., & Castonguay, L. G. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy,49(2), 115–122. 10.1037/a0027932 PubMed

*Zhou, H., Hanson, W. E., Jacobson, R., Allan, A., Armstrong, D., Dykshoorn, K. L., & Pott, T. (2020). Psychological test feedback: Canadian clinicians’ perceptions and practices. Canadian Journal of Counselling and Psychotherapy,54(4), 691–714. 10.47634/cjcp.v54i4.61217