BACKGROUND: Optimal management of outpatients with heart failure (HF) requires serially updating the estimates of their risk for adverse clinical outcomes to guide treatment. Patient-reported outcomes (PROs) are becoming increasingly used in clinical care. The purpose of this study was to determine whether the inclusion of PROs can improve the risk prediction for HF hospitalization and death in ambulatory patients with HF. METHODS AND RESULTS: We included consecutive patients with HF with reduced ejection fraction (HFrEF) and HF with preserved EF (HFpEF) seen in a HF clinic between 2015 and 2019 who completed PROs as part of routine care. Cox regression with a least absolute shrinkage and selection operator regularization and gradient boosting machine analyses were used to estimate risk for a combined outcome of HF hospitalization, heart transplant, left ventricular assist device implantation, or death. The performance of the prediction models was evaluated with the time-dependent concordance index (Cτ). Among 1165 patients with HFrEF (mean age 59.1 ± 16.1, 68% male), the median follow-up was 487 days. Among 456 patients with HFpEF (mean age 64.2 ± 16.0 years, 55% male) the median follow-up was 494 days. Gradient boosting regression that included PROs had the best prediction performance - Cτ 0.73 for patients with HFrEF and 0.74 in patients with HFpEF, and showed very good stratification of risk by time to event analysis by quintile of risk. The Kansas City Cardiomyopathy Questionnaire overall summary score, visual analogue scale and Patient Reported Outcomes Measurement Information System dimensions of satisfaction with social roles and physical function had high variable importance measure in the models. CONCLUSIONS: PROs improve risk prediction in both HFrEF and HFpEF, independent of traditional clinical factors. Routine assessment of PROs and leveraging the comprehensive data in the electronic health record in routine clinical care could help more accurately assess risk and support the intensification of treatment in patients with HF.

Department of Cardiology Institute of Clinical and Experimental Medicine Prague Czech Republic

Division of Cardiothoracic Surgery Department of Surgery University of Utah School of Medicine Salt Lake City Utah

Division of Cardiovascular Medicine Department of Internal Medicine Intermountain Medical Center Heart Institute Salt Lake City Utah

Division of Cardiovascular Medicine Department of Internal Medicine University of Missouri Kansas City Missouri

Division of Cardiovascular Medicine Department of Internal Medicine University of Utah School of Medicine Salt Lake City Utah

Division of Epidemiology Department of Internal Medicine University of Utah Salt Lake City Utah

See more in PubMed

Levy WC, Mozaffarian D, Linker DT et al. The Seattle Heart Failure Model. 2006;113:1424–1433. PubMed

Sartipy U, Dahlström U, Edner M, Lund LH. Predicting survival in heart failure: validation of the MAGGIC heart failure risk score in 51,043 patients from the Swedish heart failure registry. European journal of heart failure 2014;16:173–9. PubMed

Pocock SJ, Ariti CA, McMurray JJ et al. Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies. European heart journal 2013;34:1404–13. PubMed

Greene SJ, Butler J, Spertus JA et al. Comparison of New York Heart Association Class and Patient-Reported Outcomes for Heart Failure With Reduced Ejection Fraction. JAMA cardiology 2021;6:522–531. PubMed PMC

Spertus JA, Jones PG. Development and Validation of a Short Version of the Kansas City Cardiomyopathy Questionnaire. Circulation Cardiovascular quality and outcomes 2015;8:469–76. PubMed PMC

Pokharel Y, Khariton Y, Tang Y et al. Association of Serial Kansas City Cardiomyopathy Questionnaire Assessments With Death and Hospitalization in Patients With Heart Failure With Preserved and Reduced Ejection Fraction: A Secondary Analysis of 2 Randomized Clinical Trials. JAMA cardiology 2017;2:1315–1321. PubMed PMC

Stehlik J, Rodriguez-Correa C, Spertus JA et al. Implementation of Real-Time Assessment of Patient-Reported Outcomes in a Heart Failure Clinic: A Feasibility Study. J Card Fail 2017;23:813–816. PubMed

Lu CW, Wang JK, Yang HL et al. Heart Failure and Patient-Reported Outcomes in Adults With Congenital Heart Disease from 15 Countries. J Am Heart Assoc 2022;11:e024993. PubMed PMC

Nassif M, Fine JT, Dolan C et al. Validation of the Kansas City Cardiomyopathy Questionnaire in Symptomatic Obstructive Hypertrophic Cardiomyopathy. JACC Heart Fail 2022;10:531–539. PubMed

Kelkar AA, Spertus J, Pang P et al. Utility of Patient-Reported Outcome Instruments in Heart Failure. JACC Heart Fail 2016;4:165–75. PubMed

Spertus JA, Jones PG, Sandhu AT, Arnold SV. Interpreting the Kansas City Cardiomyopathy Questionnaire in Clinical Trials and Clinical Care: JACC State-of-the-Art Review. J Am Coll Cardiol 2020;76:2379–2390. PubMed

Schalet BD, Pilkonis PA, Yu L et al. Clinical validity of PROMIS Depression, Anxiety, and Anger across diverse clinical samples. J Clin Epidemiol 2016;73:119–27. PubMed PMC

Wohlfahrt P, Nativi-Nicolau J, Zhang M et al. Quality of Life in Patients With Heart Failure With Recovered Ejection Fraction. JAMA cardiology 2021;6:957–962. PubMed PMC

Brodke DJ, Saltzman CL, Brodke DS. PROMIS for Orthopaedic Outcomes Measurement. J Am Acad Orthop Surg 2016;24:744–749. PubMed

Carlsson AM. Assessment of chronic pain. I. Aspects of the reliability and validity of the visual analogue scale. Pain 1983;16:87–101. PubMed

Medicine NUsFSo. PROMIS® (Patient-Reported Outcomes Measurement Information System). Northwestern University’s Feinberg School of Medicine, 2023.

Charlson ME, Carrozzino D, Guidi J, Patierno C. Charlson Comorbidity Index: A Critical Review of Clinimetric Properties. Psychother Psychosom 2022;91:8–35. PubMed

Kowarik A, Templ M. Imputation with the R Package VIM. Journal of Statistical Software 2016;74:1 – 16.

Gower JC. A General Coefficient of Similarity and Some of Its Properties. Biometrics 1971;27:857–871.

Simon N, Friedman J, Hastie T, Tibshirani R. Regularization Paths for Cox’s Proportional Hazards Model via Coordinate Descent. J Stat Softw 2011;39:1–13. PubMed PMC

van Houwelingen HC, Bruinsma T, Hart AA, Van’t Veer LJ, Wessels LF. Cross-validated Cox regression on microarray gene expression data. Stat Med 2006;25:3201–16. PubMed

Ridgeway G Generalized Boosted Models: A guide to the gbm package. Update 2007;1:2007.

Heagerty PJ, Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics 2005;61:92–105. PubMed

Adler ED, Voors AA, Klein L et al. Improving risk prediction in heart failure using machine learning. European journal of heart failure 2020;22:139–147. PubMed

Wolfe A Institute of Medicine Report: Crossing the Quality Chasm: A New Health Care System for the 21st Century. Policy, Politics, & Nursing Practice 2001;2:233–235.

Rumsfeld JS, Alexander KP, Goff DC et al. Cardiovascular Health: The Importance of Measuring Patient-Reported Health Status. A Scientific Statement From the American Heart Association 2013;127:2233–2249. PubMed

Rumsfeld JS, Alexander KP, Goff DC et al. Cardiovascular Health: The Importance of Measuring Patient-Reported Health Status. Circulation 2013;127:2233–2249. PubMed

Jurgens CY, Lee CS, Aycock DM et al. State of the Science: The Relevance of Symptoms in Cardiovascular Disease and Research: A Scientific Statement From the American Heart Association. Circulation 2022;146:e173–e184. PubMed

Heidenreich PA, Spertus JA, Jones PG et al. Health status identifies heart failure outpatients at risk for hospitalization or death. J Am Coll Cardiol 2006;47:752–6. PubMed

Johansson I, Joseph P, Balasubramanian K et al. Health-Related Quality of Life and Mortality in Heart Failure: The Global Congestive Heart Failure Study of 23 000 Patients From 40 Countries. Circulation 2021;143:2129–2142. PubMed

Ravera A, Santema BT, Sama IE et al. Quality of life in men and women with heart failure: association with outcome, and comparison between the Kansas City Cardiomyopathy Questionnaire and the EuroQol 5 dimensions questionnaire. European journal of heart failure 2021;23:567–577. PubMed PMC

Ambrosy AP, Cerbin LP, DeVore AD et al. Aerobic exercise training and general health status in ambulatory heart failure patients with a reduced ejection fraction-Findings from the Heart Failure and A Controlled Trial Investigating Outcomes of Exercise Training (HF-ACTION)trial. Am Heart J 2017;186:130–138. PubMed

Hahn EA, Beaumont JL, Pilkonis PA et al. The PROMIS satisfaction with social participation measures demonstrated responsiveness in diverse clinical populations. J Clin Epidemiol 2016;73:135–41. PubMed PMC

Schalet BD, Hays RD, Jensen SE, Beaumont JL, Fries JF, Cella D. Validity of PROMIS physical function measured in diverse clinical samples. J Clin Epidemiol 2016;73:112–8. PubMed PMC

Flynn KE, Dew MA, Lin L et al. Reliability and construct validity of PROMIS(R) measures for patients with heart failure who undergo heart transplant. Qual Life Res 2015;24:2591–9. PubMed PMC

Hahn EA, Walsh MN, Allen LA et al. Validity of Patient-Reported Outcomes Measurement Information System Physical, Mental, and Social Health Measures After Left Ventricular Assist Device Implantation and Implications for Patient Care. Circulation Cardiovascular quality and outcomes 2023;16:e008690. PubMed PMC

Freedland KE, Steinmeyer BC, Carney RM, Rubin EH, Rich MW. Use of the PROMIS(R) Depression scale and the Beck Depression Inventory in patients with heart failure. Health Psychol 2019;38:369–375. PubMed PMC

Mortazavi BJ, Downing NS, Bucholz EM et al. Analysis of Machine Learning Techniques for Heart Failure Readmissions. Circulation Cardiovascular quality and outcomes 2016;9:629–640. PubMed PMC

Angraal S, Mortazavi BJ, Gupta A et al. Machine Learning Prediction of Mortality and Hospitalization in Heart Failure With Preserved Ejection Fraction. JACC Heart Fail 2020;8:12–21. PubMed

Golas SB, Shibahara T, Agboola S et al. A machine learning model to predict the risk of 30-day readmissions in patients with heart failure: a retrospective analysis of electronic medical records data. BMC Med Inform Decis Mak 2018;18:44. PubMed PMC

Ahmad T, Desai NR, Yamamoto Y et al. Alerting Clinicians to 1-Year Mortality Risk in Patients Hospitalized With Heart Failure: The REVEAL-HF Randomized Clinical Trial. JAMA cardiology 2022;7:905–912. PubMed PMC

Sandhu AT, Zheng J, Kalwani NM et al. Impact of Patient-Reported Outcome Measurement in Heart Failure Clinic on Clinician Health Status Assessment and Patient Experience: A Substudy of the PRO-HF Trial. Circ Heart Fail 2023;16:e010280. PubMed PMC