BACKGROUND: Disability progression is a key milestone in the disease evolution of people with multiple sclerosis (PwMS). Prediction models of the probability of disability progression have not yet reached the level of trust needed to be adopted in the clinic. A common benchmark to assess model development in multiple sclerosis is also currently lacking. METHODS: Data of adult PwMS with a follow-up of at least three years from 146 MS centers, spread over 40 countries and collected by the MSBase consortium was used. With basic inclusion criteria for quality requirements, it represents a total of 15, 240 PwMS. External validation was performed and repeated five times to assess the significance of the results. Transparent Reporting for Individual Prognosis Or Diagnosis (TRIPOD) guidelines were followed. Confirmed disability progression after two years was predicted, with a confirmation window of six months. Only routinely collected variables were used such as the expanded disability status scale, treatment, relapse information, and MS course. To learn the probability of disability progression, state-of-the-art machine learning models were investigated. The discrimination performance of the models is evaluated with the area under the receiver operator curve (ROC-AUC) and under the precision recall curve (AUC-PR), and their calibration via the Brier score and the expected calibration error. All our preprocessing and model code are available at https://gitlab.com/edebrouwer/ms_benchmark, making this task an ideal benchmark for predicting disability progression in MS. FINDINGS: Machine learning models achieved a ROC-AUC of 0⋅71 ± 0⋅01, an AUC-PR of 0⋅26 ± 0⋅02, a Brier score of 0⋅1 ± 0⋅01 and an expected calibration error of 0⋅07 ± 0⋅04. The history of disability progression was identified as being more predictive for future disability progression than the treatment or relapses history. CONCLUSIONS: Good discrimination and calibration performance on an external validation set is achieved, using only routinely collected variables. This suggests machine-learning models can reliably inform clinicians about the future occurrence of progression and are mature for a clinical impact study.
- Publikační typ
- časopisecké články MeSH
BACKGROUND: Simultaneous comparisons of multiple disease-modifying therapies for relapsing-remitting multiple sclerosis (RRMS) over an extended follow-up are lacking. Here we emulate a randomised trial simultaneously comparing the effectiveness of six commonly used therapies over 5 years. METHODS: Data from 74 centres in 35 countries were sourced from MSBase. For each patient, the first eligible intervention was analysed, censoring at change/discontinuation of treatment. The compared interventions included natalizumab, fingolimod, dimethyl fumarate, teriflunomide, interferon beta, glatiramer acetate and no treatment. Marginal structural Cox models (MSMs) were used to estimate the average treatment effects (ATEs) and the average treatment effects among the treated (ATT), rebalancing the compared groups at 6-monthly intervals on age, sex, birth-year, pregnancy status, treatment, relapses, disease duration, disability and disease course. The outcomes analysed were incidence of relapses, 12-month confirmed disability worsening and improvement. RESULTS: 23 236 eligible patients were diagnosed with RRMS or clinically isolated syndrome. Compared with glatiramer acetate (reference), several therapies showed a superior ATE in reducing relapses: natalizumab (HR=0.44, 95% CI=0.40 to 0.50), fingolimod (HR=0.60, 95% CI=0.54 to 0.66) and dimethyl fumarate (HR=0.78, 95% CI=0.66 to 0.92). Further, natalizumab (HR=0.43, 95% CI=0.32 to 0.56) showed a superior ATE in reducing disability worsening and in disability improvement (HR=1.32, 95% CI=1.08 to 1.60). The pairwise ATT comparisons also showed superior effects of natalizumab followed by fingolimod on relapses and disability. CONCLUSIONS: The effectiveness of natalizumab and fingolimod in active RRMS is superior to dimethyl fumarate, teriflunomide, glatiramer acetate and interferon beta. This study demonstrates the utility of MSM in emulating trials to compare clinical effectiveness among multiple interventions simultaneously.
- MeSH
- dimethyl fumarát terapeutické užití MeSH
- fingolimod hydrochlorid terapeutické užití MeSH
- glatiramer acetát terapeutické užití MeSH
- imunosupresiva terapeutické užití MeSH
- interferon beta terapeutické užití MeSH
- lidé MeSH
- natalizumab terapeutické užití MeSH
- recidiva MeSH
- relabující-remitující roztroušená skleróza * farmakoterapie MeSH
- roztroušená skleróza * farmakoterapie MeSH
- těhotenství MeSH
- Check Tag
- lidé MeSH
- těhotenství MeSH
- ženské pohlaví MeSH
- Publikační typ
- časopisecké články MeSH
- randomizované kontrolované studie MeSH
BACKGROUND: The prognostic significance of non-disabling relapses in people with relapsing-remitting multiple sclerosis (RRMS) is unclear. OBJECTIVE: To determine whether early non-disabling relapses predict disability accumulation in RRMS. METHODS: We redefined mild relapses in MSBase as 'non-disabling', and moderate or severe relapses as 'disabling'. We used mixed-effects Cox models to compare 90-day confirmed disability accumulation events in people with exclusively non-disabling relapses within 2 years of RRMS diagnosis to those with no early relapses; and any early disabling relapses. Analyses were stratified by disease-modifying therapy (DMT) efficacy during follow-up. RESULTS: People who experienced non-disabling relapses within 2 years of RRMS diagnosis accumulated more disability than those with no early relapses if they were untreated (n = 285 vs 4717; hazard ratio (HR) = 1.29, 95% confidence interval (CI) = 1.00-1.68) or given platform DMTs (n = 1074 vs 7262; HR = 1.33, 95% CI = 1.15-1.54), but not if given high-efficacy DMTs (n = 572 vs 3534; HR = 0.90, 95% CI = 0.71-1.13) during follow-up. Differences in disability accumulation between those with early non-disabling relapses and those with early disabling relapses were not confirmed statistically. CONCLUSION: This study suggests that early non-disabling relapses are associated with a higher risk of disability accumulation than no early relapses in RRMS. This risk may be mitigated by high-efficacy DMTs. Therefore, non-disabling relapses should be considered when making treatment decisions.
- MeSH
- lidé MeSH
- prognóza MeSH
- recidiva MeSH
- relabující-remitující roztroušená skleróza * farmakoterapie MeSH
- roztroušená skleróza * MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
BACKGROUND: In the absence of evidence from randomised controlled trials, observational data can be used to emulate clinical trials and guide clinical decisions. Observational studies are, however, susceptible to confounding and bias. Among the used techniques to reduce indication bias are propensity score matching and marginal structural models. OBJECTIVE: To use the comparative effectiveness of fingolimod vs natalizumab to compare the results obtained with propensity score matching and marginal structural models. METHODS: Patients with clinically isolated syndrome or relapsing remitting MS who were treated with either fingolimod or natalizumab were identified in the MSBase registry. Patients were propensity score matched, and inverse probability of treatment weighted at six monthly intervals, using the following variables: age, sex, disability, MS duration, MS course, prior relapses, and prior therapies. Studied outcomes were cumulative hazard of relapse, disability accumulation, and disability improvement. RESULTS: 4608 patients (1659 natalizumab, 2949 fingolimod) fulfilled inclusion criteria, and were propensity score matched or repeatedly reweighed with marginal structural models. Natalizumab treatment was associated with a lower probability of relapse (PS matching: HR 0.67 [95% CI 0.62-0.80]; marginal structural model: 0.71 [0.62-0.80]), and higher probability of disability improvement (PS matching: 1.21 [1.02 -1.43]; marginal structural model 1.43 1.19 -1.72]). There was no evidence of a difference in the magnitude of effect between the two methods. CONCLUSIONS: The relative effectiveness of two therapies can be efficiently compared by either marginal structural models or propensity score matching when applied in clearly defined clinical contexts and in sufficiently powered cohorts.
- MeSH
- fingolimod hydrochlorid terapeutické užití MeSH
- imunologické faktory terapeutické užití MeSH
- imunosupresiva terapeutické užití MeSH
- lidé MeSH
- natalizumab terapeutické užití MeSH
- recidiva MeSH
- relabující-remitující roztroušená skleróza * farmakoterapie MeSH
- roztroušená skleróza * farmakoterapie MeSH
- tendenční skóre MeSH
- výsledek terapie MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
BACKGROUND AND PURPOSE: This study assessed the effect of patient characteristics on the response to disease-modifying therapy (DMT) in multiple sclerosis (MS). METHODS: We extracted data from 61,810 patients from 135 centers across 35 countries from the MSBase registry. The selection criteria were: clinically isolated syndrome or definite MS, follow-up ≥ 1 year, and Expanded Disability Status Scale (EDSS) score ≥ 3, with ≥1 score recorded per year. Marginal structural models with interaction terms were used to compare the hazards of 12-month confirmed worsening and improvement of disability, and the incidence of relapses between treated and untreated patients stratified by their characteristics. RESULTS: Among 24,344 patients with relapsing MS, those on DMTs experienced 48% reduction in relapse incidence (hazard ratio [HR] = 0.52, 95% confidence interval [CI] = 0.45-0.60), 46% lower risk of disability worsening (HR = 0.54, 95% CI = 0.41-0.71), and 32% greater chance of disability improvement (HR = 1.32, 95% CI = 1.09-1.59). The effect of DMTs on EDSS worsening and improvement and the risk of relapses was attenuated with more severe disability. The magnitude of the effect of DMT on suppressing relapses declined with higher prior relapse rate and prior cerebral magnetic resonance imaging activity. We did not find any evidence for the effect of age on the effectiveness of DMT. After inclusion of 1985 participants with progressive MS, the effect of DMT on disability mostly depended on MS phenotype, whereas its effect on relapses was driven mainly by prior relapse activity. CONCLUSIONS: DMT is generally most effective among patients with lower disability and in relapsing MS phenotypes. There is no evidence of attenuation of the effect of DMT with age.
- MeSH
- chronicko-progresivní roztroušená skleróza * MeSH
- imunoterapie MeSH
- lidé MeSH
- proporcionální rizikové modely MeSH
- recidiva MeSH
- relabující-remitující roztroušená skleróza * MeSH
- roztroušená skleróza * terapie MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
Geographical variations in the incidence and prevalence of multiple sclerosis have been reported globally. Latitude as a surrogate for exposure to ultraviolet radiation but also other lifestyle and environmental factors are regarded as drivers of this variation. No previous studies evaluated geographical variation in the risk of secondary progressive multiple sclerosis, an advanced form of multiple sclerosis that is characterized by steady accrual of irreversible disability. We evaluated differences in the risk of secondary progressive multiple sclerosis in relation to latitude and country of residence, modified by high-to-moderate efficacy immunotherapy in a geographically diverse cohort of patients with relapsing-remitting multiple sclerosis. The study included relapsing-remitting multiple sclerosis patients from the global MSBase registry with at least one recorded assessment of disability. Secondary progressive multiple sclerosis was identified as per clinician diagnosis. Sensitivity analyses used the operationalized definition of secondary progressive multiple sclerosis and the Swedish decision tree algorithm. A proportional hazards model was used to estimate the cumulative risk of secondary progressive multiple sclerosis by country of residence (latitude), adjusted for sex, age at disease onset, time from onset to relapsing-remitting phase, disability (Multiple Sclerosis Severity Score) and relapse activity at study inclusion, national multiple sclerosis prevalence, government health expenditure, and proportion of time treated with high-to-moderate efficacy disease-modifying therapy. Geographical variation in time from relapsing-remitting phase to secondary progressive phase of multiple sclerosis was modelled through a proportional hazards model with spatially correlated frailties. We included 51 126 patients (72% female) from 27 countries. The median survival time from relapsing-remitting phase to secondary progressive multiple sclerosis among all patients was 39 (95% confidence interval: 37 to 43) years. Higher latitude [median hazard ratio = 1.21, 95% credible interval (1.16, 1.26)], higher national multiple sclerosis prevalence [1.07 (1.03, 1.11)], male sex [1.30 (1.22, 1.39)], older age at onset [1.35 (1.30, 1.39)], higher disability [2.40 (2.34, 2.47)] and frequent relapses [1.18 (1.15, 1.21)] at inclusion were associated with increased hazard of secondary progressive multiple sclerosis. Higher proportion of time on high-to-moderate efficacy therapy substantially reduced the hazard of secondary progressive multiple sclerosis [0.76 (0.73, 0.79)] and reduced the effect of latitude [interaction: 0.95 (0.92, 0.99)]. At the country-level, patients in Oman, Tunisia, Iran and Canada had higher risks of secondary progressive multiple sclerosis relative to the other studied regions. Higher latitude of residence is associated with a higher probability of developing secondary progressive multiple sclerosis. High-to-moderate efficacy immunotherapy can mitigate some of this geographically co-determined risk.
- MeSH
- chronicko-progresivní roztroušená skleróza * epidemiologie MeSH
- lidé MeSH
- lokální recidiva nádoru MeSH
- progrese nemoci MeSH
- relabující-remitující roztroušená skleróza * epidemiologie MeSH
- roztroušená skleróza * epidemiologie diagnóza MeSH
- ultrafialové záření MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
BACKGROUND AND PURPOSE: The prevention of disability over the long term is the main treatment goal in multiple sclerosis (MS); however, randomized clinical trials evaluate only short-term treatment effects on disability. This study aimed to define criteria for 6-month confirmed disability progression events of MS with a high probability of resulting in sustained long-term disability worsening. METHODS: In total, 14,802 6-month confirmed disability progression events were identified in 8741 patients from the global MSBase registry. For each 6-month confirmed progression event (13,321 in the development and 1481 in the validation cohort), a sustained progression score was calculated based on the demographic and clinical characteristics at the time of progression that were predictive of long-term disability worsening. The score was externally validated in the Cladribine Tablets Treating Multiple Sclerosis Orally (CLARITY) trial. RESULTS: The score was based on age, sex, MS phenotype, relapse activity, disability score and its change from baseline, number of affected functional system domains and worsening in six of the domains. In the internal validation cohort, a 61% lower chance of improvement was estimated with each unit increase in the score (hazard ratio 0.39, 95% confidence interval 0.29-0.52; discriminatory index 0.89). The proportions of progression events sustained at 5 years stratified by the score were 1: 72%; 2: 88%; 3: 94%; 4: 100%. The results of the CLARITY trial were confirmed for reduction of disability progression that was >88% likely to be sustained (events with score ˃1.5). CONCLUSIONS: Clinicodemographic characteristics of 6-month confirmed disability progression events identify those at high risk of sustained long-term disability. This knowledge will allow future trials to better assess the effect of therapy on long-term disability accrual.
- MeSH
- kladribin terapeutické užití MeSH
- kohortové studie MeSH
- lidé MeSH
- posuzování pracovní neschopnosti * MeSH
- progrese nemoci MeSH
- randomizované kontrolované studie jako téma MeSH
- relabující-remitující roztroušená skleróza MeSH
- roztroušená skleróza * farmakoterapie patologie MeSH
- Check Tag
- lidé MeSH
- mužské pohlaví MeSH
- ženské pohlaví MeSH
- Publikační typ
- časopisecké články MeSH
BACKGROUND AND PURPOSE: Reaching Expanded Disability Status Scale (EDSS) ≥7.0 represents the requirement for a wheelchair. Here we (i) assess the effect of ocrelizumab on time to EDSS ≥7.0 over the ORATORIO (NCT01194570) double-blind and extended controlled periods (DBP+ECP), (ii) quantify likely long-term benefits by extrapolating results, and (iii) assess the plausibility of extrapolations using an independent real-world cohort (MSBase registry; ACTRN12605000455662). METHODS: Post hoc analyses assessing time to 24-week confirmed EDSS ≥7.0 in two cohorts of patients with primary progressive multiple sclerosis (baseline EDSS 3.0-6.5) were investigated in ORATORIO and MSBase. RESULTS: In the ORATORIO DBP+ECP, ocrelizumab reduced the risk of 24-week confirmed EDSS ≥7.0 (hazard ratio = 0.54, 95% confidence interval [CI]: 0.31-0.92; p = 0.022). Extrapolated median time to 24-week confirmed EDSS ≥7.0 was 12.1 and 19.2 years for placebo and ocrelizumab, respectively (7.1-year delay [95% CI: -4.3 to 18.4]). In MSBase, the median time to 24-week confirmed EDSS ≥7.0 was 12.4 years. CONCLUSIONS: Compared with placebo, ocrelizumab significantly delayed time to 24-week confirmed wheelchair requirement in ORATORIO. The plausibility of the extrapolated median time to reach this milestone in the placebo group was supported by observed real-world data from MSBase. Extrapolated benefits for ocrelizumab over placebo could represent a truly meaningful delay in loss of ambulation and independence.
- MeSH
- chronicko-progresivní roztroušená skleróza * farmakoterapie MeSH
- lidé MeSH
- progrese nemoci MeSH
- registrace MeSH
- roztroušená skleróza * farmakoterapie MeSH
- vozíky pro invalidy * MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH
- práce podpořená grantem MeSH
- randomizované kontrolované studie MeSH
OBJECTIVE: To compare the effectiveness of glatiramer acetate (GA) vs intramuscular interferon beta-1a (IFN-β-1a), we applied a previously published statistical method aimed at identifying patients' profiles associated with efficacy of treatments. METHODS: Data from 2 independent multiple sclerosis datasets, a randomized study (the Combination Therapy in Patients With Relapsing-Remitting Multiple Sclerosis [CombiRx] trial, evaluating GA vs IFN-β-1a) and an observational cohort extracted from MSBase, were used to build and validate a treatment response score, regressing annualized relapse rates (ARRs) on a set of baseline predictors. RESULTS: The overall ARR ratio of GA to IFN-β-1a in the CombiRx trial was 0.72. The response score (made up of a linear combination of age, sex, relapses in the previous year, disease duration, and Expanded Disability Status Scale score) detected differential response of GA vs IFN-β-1a: in the trial, patients with the largest benefit from GA vs IFN-β-1a (lower score quartile) had an ARR ratio of 0.40 (95% confidence interval [CI] 0.25-0.63), those in the 2 middle quartiles of 0.90 (95% CI 0.61-1.34), and those in the upper quartile of 1.14 (95% CI 0.59-2.18) (heterogeneity p = 0.012); this result was validated on MSBase, with the corresponding ARR ratios of 0.58 (95% CI 0.46-0.72), 0.92 (95% CI 0.77-1.09,) and 1.29 (95% CI 0.97-1.71); heterogeneity p < 0.0001). CONCLUSIONS: We demonstrate the possibility of a criterion, based on patients' characteristics, to choose whether to treat with GA or IFN-β-1a. This result, replicated on an independent real-life cohort, may have implications for clinical decisions in everyday clinical practice.
- MeSH
- adjuvancia imunologická aplikace a dávkování MeSH
- databáze faktografické trendy MeSH
- dospělí MeSH
- glatiramer acetát aplikace a dávkování MeSH
- imunosupresiva aplikace a dávkování MeSH
- injekce intramuskulární MeSH
- interferon beta 1a aplikace a dávkování MeSH
- kohortové studie MeSH
- lidé středního věku MeSH
- lidé MeSH
- relabující-remitující roztroušená skleróza diagnóza farmakoterapie MeSH
- výsledek terapie MeSH
- Check Tag
- dospělí MeSH
- lidé středního věku MeSH
- lidé MeSH
- mužské pohlaví MeSH
- ženské pohlaví MeSH
- Publikační typ
- časopisecké články MeSH
- pozorovací studie MeSH
- práce podpořená grantem MeSH
- randomizované kontrolované studie MeSH
- Research Support, N.I.H., Extramural MeSH
BACKGROUND AND OBJECTIVES: Research in Multiple Sclerosis (MS) has recently focused on extracting knowledge from real-world clinical data sources. This type of data is more abundant than data produced during clinical trials and potentially more informative about real-world clinical practice. However, this comes at the cost of less curated and controlled data sets. In this work we aim to predict disability progression by optimally extracting information from longitudinal patient data in the real-world setting, with a special focus on the sporadic sampling problem. METHODS: We use machine learning methods suited for patient trajectories modeling, such as recurrent neural networks and tensor factorization. A subset of 6682 patients from the MSBase registry is used. RESULTS: We can predict disability progression of patients in a two-year horizon with an ROC-AUC of 0.85, which represents a 32% decrease in the ranking pair error (1-AUC) compared to reference methods using static clinical features. CONCLUSIONS: Compared to the models available in the literature, this work uses the most complete patient history for MS disease progression prediction and represents a step forward towards AI-assisted precision medicine in MS.
- MeSH
- lidé MeSH
- neuronové sítě (počítačové) MeSH
- roztroušená skleróza * MeSH
- strojové učení * MeSH
- Check Tag
- lidé MeSH
- Publikační typ
- časopisecké články MeSH