OBJECTIVE: To compare several methods of missing data imputation for function (Health Assessment Questionnaire) and for disease activity (Disease Activity Score-28 and Clinical Disease Activity Index) in rheumatoid arthritis (RA) patients. METHODS: One thousand RA patients from observational cohort studies with complete data for function and disease activity at baseline, 6, 12 and 24 months were selected to conduct a simulation study. Values were deleted at random or following a predicted attrition bias. Three types of imputation were performed: (1) methods imputing forward in time (last observation carried forward; linear forward extrapolation); (2) methods considering data both forward and backward in time (nearest available observation-NAO; linear extrapolation; polynomial extrapolation); and (3) methods using multi-individual models (linear mixed effects cubic regression-LME3; multiple imputation by chained equation-MICE). The performance of each estimation method was assessed using the difference between the mean outcome value, the remission and low disease activity rates after imputation of the missing values and the true value. RESULTS: When imputing missing baseline values, all methods underestimated equally the true value, but LME3 and MICE correctly estimated remission and low disease activity rates. When imputing missing follow-up values at 6, 12, or 24 months, NAO provided the least biassed estimate of the mean disease activity and corresponding remission rate. These results were not affected by the presence of attrition bias. CONCLUSION: When imputing function and disease activity in large registers of active RA patients, researchers can consider the use of a simple method such as NAO for missing follow-up data, and the use of mixed-effects regression or multiple imputation for baseline data.

Centre for Rheumatology and Spine Diseases Rigshospitalet Glostrup Glostrup Denmark

Department of Clinical Medicine University of Copenhagen Copenhagen Denmark

Department of Emergency and Transplantation Rheumatology Unit GISEA University Hospital of Bari Bari Italy

Department of Internal Medicine Lund University Lund Sweden

Department of Rheumatology Diakonhjemmet Hospital Oslo Norway

Department of Rheumatology Hospital Garcia de Orta Almada Portugal

Department of Rheumatology Skåne University Hospital Malmö Sweden

Division of Rheumatology Geneva University Hospitals Geneva Switzerland

Institute of Rheumatology and Clinic of Rheumatology Charles University Prague Czech Republic

Zobrazit více v PubMed

Gill J, Prasad V. Improving observational studies in the era of big data. The Lancet 2018;392:716–7. 10.1016/S0140-6736(18)31619-2 PubMed DOI

Sherman RE, Anderson SA, Dal Pan GJ, et al. . Real-World evidence — what is it and what can it tell us? N Engl J Med 2016;375:2293–7. 10.1056/NEJMsb1609216 PubMed DOI

Finckh A, Courvoisier D. Lessons learned from rheumatoid arthritis registries. Joint Bone Spine 2018;85:271–4. 10.1016/j.jbspin.2017.12.005 PubMed DOI

Gabay C, Riek M, Hetland ML, et al. . Effectiveness of tocilizumab with and without synthetic disease-modifying antirheumatic drugs in rheumatoid arthritis: results from a European collaborative study. Ann Rheum Dis 2016;75:1336–42. 10.1136/annrheumdis-2015-207760 PubMed DOI PMC

Alemao E, Litman HJ, Connolly SE, et al. . Do poor prognostic factors in rheumatoid arthritis affect treatment choices and outcomes? analysis of a US rheumatoid arthritis registry. J Rheumatol 2018;45:1353–60. 10.3899/jrheum.171050 PubMed DOI

Soliman MM, Hyrich KL, Lunt M, et al. . Effectiveness of rituximab in patients with rheumatoid arthritis: observational study from the British Society for rheumatology biologics register. J Rheumatol 2012;39:240–6. 10.3899/jrheum.110610 PubMed DOI

Jinoos Y, Nick B, Megan C, et al. . Rheumatology informatics system for effectiveness: a national Informatics-Enabled Registry for quality improvement. Arthritis Care Res 2016;68:1866–73. PubMed PMC

Gottenberg JE, Courvoisier DS, Hernandez MV, et al. . Brief report: association of rheumatoid factor and Anti-Citrullinated protein antibody positivity with better effectiveness of abatacept: results from the pan-European registry analysis. Arthritis Rheumatol 2016;68:1346–52. 10.1002/art.39595 PubMed DOI

Rubin DB. Inference and missing data. Biometrika 1976;63:581–92. 10.1093/biomet/63.3.581 DOI

Schafer JL, Graham JW. Missing data: our view of the state of the art. Psychol Methods 2002;7:147–77. 10.1037/1082-989X.7.2.147 PubMed DOI

Baron G, Ravaud P, Samson A, et al. . Missing data in randomized controlled trials of rheumatoid arthritis with radiographic outcomes: a simulation study. Arthritis Rheum 2008;59:25–31. 10.1002/art.23253 PubMed DOI

Bell ML, Fairclough DL. Practical and statistical issues in missing data for longitudinal patient-reported outcomes. Stat Methods Med Res 2014;23:440–59. 10.1177/0962280213476378 PubMed DOI

England BR, Sokolove J, Robinson WH, et al. . Associations of circulating cytokines and chemokines with cancer mortality in men with rheumatoid arthritis. Arthritis Rheumatol 2016;68:2394–402. 10.1002/art.39735 PubMed DOI

Bergstra SA, Branco JC, Vega-Morales D, et al. . Inequity in access to bDMARD care and how it influences disease outcomes across countries worldwide: results from the METEOR-registry. Ann Rheum Dis 2018;77:1413–20. PubMed

Hayati Rezvan P, Lee KJ, Simpson JA. The rise of multiple imputation: a review of the reporting and implementation of the method in medical research. BMC Med Res Methodol 2015;15:30 10.1186/s12874-015-0022-1 PubMed DOI PMC

Azur MJ, Stuart EA, Frangakis C, et al. . Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res 2011;20:40–9. 10.1002/mpr.329 PubMed DOI PMC

Eekhout I, de Boer RM, Twisk JWR, et al. . Missing data: a systematic review of how they are reported and handled. Epidemiol Camb Mass 2012;23:729–32. PubMed

DeSouza CM, Legedza ATR, Sankoh AJ. An overview of practical approaches for handling missing data in clinical trials. J Biopharm Stat 2009;19:1055–73. 10.1080/10543400903242795 PubMed DOI

Wong WK, Boscardin WJ, Postlethwaite AE, et al. . Handling missing data issues in clinical trials for rheumatic diseases. Contemp Clin Trials 2011;32:1–9. 10.1016/j.cct.2010.09.001 PubMed DOI

van der Heijde D, Fleischmann R, Wollenhaupt J, et al. . Effect of different imputation approaches on the evaluation of radiographic progression in patients with psoriatic arthritis: results of the RAPID-PsA 24-week phase III double-blind randomised placebo-controlled study of certolizumab pegol. Ann Rheum Dis 2014;73:233–7. 10.1136/annrheumdis-2013-203697 PubMed DOI PMC

Markusse IM, Landewé R, Wolterbeek R, et al. . Linear extrapolation of missing radiographic change scores in clinical trials does not spuriously overestimate group radiographic changes in rheumatoid arthritis. Rheumatology 2016;55:1295–300. 10.1093/rheumatology/kew030 PubMed DOI

Song J, Boscardin WJ, Furst DE, et al. . A cautionary tale: dealing with missing data in clinical trials for rheumatic diseases. Clin Exp Rheumatol 2014;32:S-122–126. PubMed

MÁ D, Garcia VV, González-Alvaro I, et al. . Tackling missing radiographic progression data: multiple imputation technique compared with inverse probability weights and complete case analysis. Rheumatology 2013;52:331–6. PubMed

Iannone F, Courvoisier DS, Gottenberg JE, et al. . Body mass does not impact the clinical response to intravenous abatacept in patients with rheumatoid arthritis. Analysis from the “pan-European registry collaboration for abatacept (PANABA). Clin Rheumatol 2017;36:773–9. 10.1007/s10067-016-3505-5 PubMed DOI

Engels J, Diehr P. Imputation of missing longitudinal data: a comparison of methods. J Clin Epidemiol 2003;56:968–76. 10.1016/S0895-4356(03)00170-7 PubMed DOI

Zhang Z. Missing data imputation: focusing on single imputation. Ann Transl Med 2016;4. PubMed PMC

Rubin DB. Multiple Imputation for Nonresponse in Surveys. John Wiley & Sons, 2004.

Schafer JL. Multiple imputation: a primer. Stat Methods Med Res 1999;8:3-15 10.1177/096228029900800102 PubMed DOI

Rodwell L, Lee KJ, Romaniuk H, et al. . Comparison of methods for imputing limited-range variables: a simulation study. BMC Med Res Methodol 2014;14:57 10.1186/1471-2288-14-57 PubMed DOI PMC

R Core Team R: a language and environment for statistical computing. R foundation for statistical computing, 2017. Available: https://www.R-project.org/

Finckh A, et al. Evidence for differential acquired drug resistance to anti-tumour necrosis factor agents in rheumatoid arthritis. Ann Rheum Dis 2006;65:746–52. 10.1136/ard.2005.045062 PubMed DOI PMC

Cruyssen B, Van Looy S, Wyns B, et al. . Four-Year follow-up of infliximab therapy in rheumatoid arthritis patients with long-standing refractory disease: attrition and long-term evolution of disease activity. Arthritis Res Ther 2006;8 10.1186/ar2001 PubMed DOI PMC

Gottenberg J-E, Brocq O, Perdriger A, et al. . Non–TNF-Targeted biologic vs a second anti-TNF drug to treat rheumatoid arthritis in patients with insufficient response to a first anti-TNF drug. JAMA 2016;316:1172–80. 10.1001/jama.2016.13512 PubMed DOI

Rubbert-Roth A, Finckh A. Treatment options in patients with rheumatoid arthritis failing initial TNF inhibitor therapy: a critical review. Arthritis Res Ther 2009;11 10.1186/ar2666 PubMed DOI PMC

Finckh A, Möller B, Dudler J, et al. . Evolution of radiographic joint damage in rituximab-treated versus TNF-treated rheumatoid arthritis cases with inadequate response to TNF antagonists. Ann Rheum Dis 2012;71:1680.2–5. 10.1136/annrheumdis-2011-201016 PubMed DOI PMC

van BS. Flexible Imputation of Missing Data, Second Edition. 2 edition Boca Raton: Chapman and Hall/CRC, 2018.

Lydersen S. Last observation carried forward. Tidsskr Den Nor Legeforening. [Epub ahead of print: 23 May 2019]. PubMed

Cummings P. Missing data and multiple imputation. JAMA Pediatr 2013;167:656–61. 10.1001/jamapediatrics.2013.1329 PubMed DOI

Sterne JAC, White IR, Carlin JB, et al. . Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 2009;338:b2393 10.1136/bmj.b2393 PubMed DOI PMC

White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med 2011;30:377–99. 10.1002/sim.4067 PubMed DOI

Berchtold A, Surís J-C. Imputation of repeatedly observed multinomial variables in longitudinal surveys. Commun Stat Simul Comput 2017;46:3267–83. 10.1080/03610918.2015.1082588 DOI

Marston L, Carpenter JR, Walters KR, et al. . Issues in multiple imputation of missing data for large general practice clinical databases. Pharmacoepidemiol Drug Saf 2010;19:618–26. 10.1002/pds.1934 PubMed DOI

De Silva AP, Moreno-Betancur M, De Livera AM, et al. . A comparison of multiple imputation methods for handling missing values in longitudinal data in the presence of a time-varying covariate with a non-linear association with time: a simulation study. BMC Med Res Methodol 2017;17 10.1186/s12874-017-0372-y PubMed DOI PMC

Donders ART, van der Heijden GJMG, Stijnen T, et al. . Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006;59:1087–91. 10.1016/j.jclinepi.2006.01.014 PubMed DOI

Keogh RH, White IR. Using full-cohort data in nested case-control and case-cohort studies by multiple imputation. Stat Med 2013;32:4021–43. 10.1002/sim.5818 PubMed DOI

Kristensen LE, Saxne T, Geborek P. The LUNDEX, a new index of drug efficacy in clinical practice: results of a five-year observational study of treatment with infliximab and etanercept among rheumatoid arthritis patients in southern Sweden. Arthritis Rheum 2006;54:600–6. 10.1002/art.21570 PubMed DOI

Challenge of missing data in observational studies: investigating cross-sectional imputation methods for assessing disease activity in axial spondyloarthritis

Effectiveness of TNF-inhibitors, abatacept, IL6-inhibitors and JAK-inhibitors in 31 846 patients with rheumatoid arthritis in 19 registers from the 'JAK-pot' collaboration