BACKGROUND: Impairment of higher language functions associated with natural spontaneous speech in multiple sclerosis (MS) remains underexplored. OBJECTIVES: We presented a fully automated method for discriminating MS patients from healthy controls based on lexical and syntactic linguistic features. METHODS: We enrolled 120 MS individuals with Expanded Disability Status Scale ranging from 1 to 6.5 and 120 age-, sex-, and education-matched healthy controls. Linguistic analysis was performed with fully automated methods based on automatic speech recognition and natural language processing techniques using eight lexical and syntactic features acquired from the spontaneous discourse. Fully automated annotations were compared with human annotations. RESULTS: Compared with healthy controls, lexical impairment in MS consisted of an increase in content words (p = 0.037), a decrease in function words (p = 0.007), and overuse of verbs at the expense of noun (p = 0.047), while syntactic impairment manifested as shorter utterance length (p = 0.002), and low number of coordinate clause (p < 0.001). A fully automated language analysis approach enabled discrimination between MS and controls with an area under the curve of 0.70. A significant relationship was detected between shorter utterance length and lower symbol digit modalities test score (r = 0.25, p = 0.008). Strong associations between a majority of automatically and manually computed features were observed (r > 0.88, p < 0.001). CONCLUSION: Automated discourse analysis has the potential to provide an easy-to-implement and low-cost language-based biomarker of cognitive decline in MS for future clinical trials.

Department of Circuit Theory Faculty of Electrical Engineering Czech Technical University Prague Prague Czech Republic

Department of Circuit Theory Faculty of Electrical Engineering Czech Technical University Prague Technická 2 160 00 Prague Czech Republic

Department of Neurology and ARTORG Center for Biomedical Engineering Research Inselspital University of Bern Bern Switzerland

Department of Neurology and Centre of Clinical Neuroscience 1st Faculty of Medicine Charles University and General University Hospital Prague Czech Republic

Zobrazit více v PubMed

Eshaghi A, Young AL, Wijeratne PA, et al.. Identifying multiple sclerosis subtypes using unsupervised machine learning and MRI data. Nat Commun 2021; 12: 2078. PubMed PMC

Bergsland N, Horakova D, Dwyer MG, et al.. Gray matter atrophy patterns in multiple sclerosis: a 10-year source-based morphometry study. Neuroimage Clin 2018; 17: 444–451. PubMed PMC

Lassmann H. Pathogenic mechanisms associated with different clinical courses of multiple sclerosis. Front Immunol 2019; 9: 3116, https://www.frontiersin.org/articles/10.3389/fimmu.2018.03116 PubMed DOI PMC

Benedict RHB, Zivadinov R. Risk factors for and management of cognitive dysfunction in multiple sclerosis. Nat Rev Neurol 2011; 7: 332–342. PubMed

Cruccu G, Deuschl G, Federico A. Scientific publications of European neurologists: a survey commissioned by the European Academy of Neurology. Eur J Neurol 2018; 25: 1128–1133. PubMed

DeLuca J, Chiaravalloti ND, Sandroff BM. Treatment and management of cognitive dysfunction in patients with multiple sclerosis. Nat Rev Neurol 2020; 16: 319–332. PubMed

McNicholas N, O’Connell K, Yap SM, et al.. Cognitive dysfunction in early multiple sclerosis: a review. QJM 2018; 111: 359–364. PubMed

Oreja-Guevara C, Ayuso Blanco T, Brieva Ruiz L, et al.. Cognitive dysfunctions and assessments in multiple sclerosis. Front Neurol 2019; 10: 581, https://www.frontiersin.org/articles/10.3389/fneur.2019.00581 PubMed DOI PMC

Rao SM, Leo GJ, Ellington L, et al.. Cognitive dysfunction in multiple sclerosis. II. Impact on employment and social functioning. Neurology 1991; 41: 692–696. PubMed

Shevil E, Finlayson M. Perceptions of persons with multiple sclerosis on cognitive changes and their impact on daily life. Disabil Rehab 2006; 28: 779–788. PubMed

Pardini M, Uccelli A, Grafman J, et al.. Isolated cognitive relapses in multiple sclerosis. J Neurol Neurosurg Psychiatry 2014; 85: 1035–1037. PubMed

Benedict RH, Morrow S, Rodgers J, et al.. Characterizing cognitive function during relapse in multiple sclerosis. Mult Scler 2014; 20: 1745–1752. PubMed

Motyl J, Friedova L, Vaneckova M, et al.. Isolated cognitive decline in neurologically stable patients with multiple sclerosis. Diagnostics 2021; 11: 464. PubMed PMC

El-Wahsh S, Ballard K, Kumfor F, et al.. Prevalence of self-reported language impairment in multiple sclerosis and the association with health-related quality of life: an international survey study. Mult Scler Relat Disord 2020; 39: 101896. PubMed

Renauld S, Mohamed-Saïd L, Macoir J. Language disorders in multiple sclerosis: a systematic review. Mult Scler Relat Disord 2016; 10: 103–111. PubMed

Ntoskou K, Messinis L, Nasios G, et al.. Cognitive and language deficits in multiple sclerosis: comparison of relapsing remitting and secondary progressive subtypes. Open Neurol J 2018; 12: 19–30. PubMed PMC

Lebkuecher AL, Chiaravalloti ND, Strober LB. The role of language ability in verbal fluency of individuals with multiple sclerosis. Mult Scler Relat Disord 2021; 50: 102846. PubMed

Sonkaya AR, Bayazit ZZ. Language aspects of patients with multiple sclerosis. EJMI 2018; 2: 133–138.

Feenaughty L. Linguistic performance during monologues and correlates of neuropsychological function for adults with multiple sclerosis. Aphasiology. Epub ahead of print 14 July 2022. DOI: 10.1080/02687038.2022.2099527. DOI

Asgari M, Kaye J, Dodge H. Predicting mild cognitive impairment from spontaneous spoken utterances. Alzheimers Dement 2017; 3: 219–228. PubMed PMC

Eyigoz E, Mathur S, Santamaria M, et al.. Linguistic markers predict onset of Alzheimer’s disease. eClinicalMedicine 2020; 28: 100583. PubMed PMC

Šubert M, Šimek M, Novotný M, et al.. Linguistic abnormalities in isolated rapid eye movement sleep behavior disorder. Mov Disord 2022; 37: 1872–1882. PubMed

Guilloton L, Camdessanche JP, Latombe D, et al.. A clinical screening tool for objective and subjective cognitive disorders in multiple sclerosis. Ann Phys Rehabil Med 2020; 63: 116–122. PubMed

Rusz J, Benova B, Ruzickova H, et al.. Characteristics of motor speech phenotypes in multiple sclerosis. Mult Scler Relat Disord 2018; 19: 62–69. PubMed

Kappos L, Wolinsky JS, Giovannoni G, et al.. Contribution of relapse-independent progression vs relapse-associated worsening to overall confirmed disability accumulation in typical relapsing multiple sclerosis in a pooled analysis of 2 randomized clinical trials. JAMA Neurol 2020; 77: 1132–1140. PubMed PMC

Giovannoni G, Popescu V, Wuerfel J, et al.. Smouldering multiple sclerosis: the ‘real MS’. Ther Adv Neurol Disord 2022; 15: 17562864211066751. PubMed PMC

Polman CH, Reingold SC, Banwell B, et al.. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Ann Neurol 2011; 69: 292–302. PubMed PMC

Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 1983; 33: 1444–1452. PubMed

Smith A. Symbol digit modalities test. Los Angeles, CA: Western Psychological Services, 1973.

Rao SM. A manual for the brief repeatable battery of neuropsychological tests in multiple sclerosis. New York: National Multiple Sclerosis Society.

Tombaugh TN. A comprehensive review of the paced auditory serial addition test (PASAT). Arch Clin Neuropsychol 2006; 21: 53–76. PubMed

Benedict RH, Amato MP, Boringa J, et al.. Brief international cognitive assessment for MS (BICAMS): international standards for validation. BMC Neurol 2012; 12: 1–7. PubMed PMC

Ciharova M, Cígler H, Dostálová V, et al.. Beck depression inventory, second edition, Czech version: demographic correlates, factor structure and comparison with foreign data. Int J Psychiatry Clin Pract 2020; 24: 371–379. PubMed

Krupp LB, LaRocca NG, Muir-Nash J, et al.. The fatigue severity scale. Application to Patients with Multiple Sclerosis and Systemic Lupus Erythematosus. Arch Neurol 1989; 46: 1121–1123. PubMed

Beltrami D, Gagliardi G, Rossini Favretti R, et al.. Speech analysis by natural language processing techniques: a possible tool for very early detection of cognitive decline? Front Aging Neurosci 2018; 10: 369, https://www.frontiersin.org/articles/10.3389/fnagi.2018.00369 PubMed DOI PMC

Google. Speech-to-text: automatic speech recognition. https://cloud.google.com/speech-to-text (accessed 30 August 2022).

Filippidou F, Moussiades L. A benchmarking of IBM, Google and Wit automatic speech recognition systems. In: Maglogiannis I, Iliadis L, Pimenidis E. (eds) Artificial intelligence applications and innovations. Vol. 583. Cham: Springer, 2020, pp. 73–82.

Straka M, Straková J. MorphoDiTa: morphological dictionary and tagger. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University, 2014. http://hdl.handle.net/11858/00-097C-0000-0023-43CD-0

Straka M, Straková J. Czech models (MorfFlex CZ 160310+ PDT 3.0) for MorphoDiTa 160310. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University, 2016. http://hdl.handle.net/11234/1-1674

Corver N, Riemsdijk H van. Semi-lexical categories: the function of content words and the content of function words. Berlin; Boston, MA: De Gruyter, Inc., 2013.

De Lira JO, Ortiz KZ, Campanha AC, et al.. Microlinguistic aspects of the oral narrative in patients with Alzheimer’s disease. Int Psychogeriatr 2011; 23: 404–412. PubMed

Covington MA, McFall JD. Cutting the gordian knot: the moving-average type–token ratio (MATTR). J Quantit Linguist 2010; 17: 94–100.

Orimaye S, Wong J, Golden K, et al.. Predicting probable Alzheimer’s disease using linguistic deficits and biomarkers. BMC Bioinform 2017; 2017: 34. PubMed PMC

Ezeizabarrena M-J, Garcia Fernandez I. Length of utterance, in morphemes or in words?: MLU3-w, a reliable measure of language development in early Basque. Front Psychol 2018; 8: 2265. PubMed PMC

Vogel AP, Rosen KM, Morgan AT, et al.. Comparability of modern recording devices for speech analysis: smartphone, landline, laptop, and hard disc recorder. Folia Phoniatr Logop 2014; 66: 244–250. PubMed

Arrondo G, Sepulcre J, Beatriz D, et al.. Narrative speech is impaired in multiple sclerosis. Eur Neurol J 2010; 2: 11–40.

Laakso KB, Brunnegård K, Hartelius L, et al.. Assessing high-level language in individuals with multiple sclerosis: a pilot study. Clin Linguist Phon 2000; 14: 329–349.

Curti E, Graziuso S, Tsantes E, et al.. Correlation between cortical lesions and cognitive impairment in multiple sclerosis. Brain Behav 2018; 8: e00955. PubMed PMC

Caplan D, Waters G, Alpert N. Effects of age and speed of processing on rCBF correlates of syntactic processing in sentence comprehension. Hum Brain Mapp 2003; 19: 112–131. PubMed PMC

Maner KJ, Smith A, Grayson L. Influences of utterance length and complexity on speech motor performance in children and adults. J Speech Lang Hear Res 2000; 43: 560–573. PubMed

Chiaravalloti ND, DeLuca J. Cognitive impairment in multiple sclerosis. Lancet Neurol 2008; 7: 1139–1151. PubMed

Uher T, Vaneckova M, Sormani MP, et al.. Identification of multiple sclerosis patients at highest risk of cognitive impairment using an integrated brain magnetic resonance imaging assessment approach. Eur J Neurol 2017; 24: 292–301. PubMed

Sateli B, Cook G, Witte R.Smarter mobile apps through integrated natural language processing services. In: Proceedings of 10th international conference, MobiWIS 2013, Paphos, Cyprus, 26–29August2013, pp. 187–202. Berlin: Springer.

Nguyen B, Nguyen VBH, Nguyen H, et al.. Fast and accurate capitalization and punctuation for automatic speech recognition using transformer and chunk merging. In: 2019 22nd conference of the oriental COCOSDA international committee for the co-ordination and standardisation of speech databases and assessment techniques (O-COCOSDA), Cebu, Philippines, 25October2019, pp. 1–5. New York: IEEE.

MacDonald B, Jiang P-P, Cattiau J, et al.. Disordered speech data collection: lessons learned at 1 million utterances from project Euphonia. In: INTERSPEECH 2021, Brno, Czechia Republic, 30August – 3September2021, pp. 4833–4837, https://www.isca-speech.org/archive/pdfs/interspeech_2021/macdonald21_interspeech.pdf

Nouza J, Zdansky J, Cerva P, et al.. Challenges in speech processing of slavic languages (case studies in speech recognition of Czech and Slovak). In: Esposito A, Campbell N, Vogel C, et al.. (eds) Development of multimodal interfaces: active listening and synchrony: second COST 2102 international training school, Dublin, 23–27March2009, revised selected papers, pp. 225–241. Berlin and Heidelberg: Springer.

Chitnis T, Gonzalez C, Healy BC, et al.. Neurofilament light chain serum levels correlate with 10-year MRI outcomes in multiple sclerosis. Ann Clin Transl Neurol 2018; 5: 1478–1491. PubMed PMC

Portaccio E, Bellinvia A, Fonderico M, et al.. Progression is independent of relapse activity in early multiple sclerosis: a real-life cohort study. Brain 2022; 145: 2796–2805. PubMed

Golan D, Doniger GM, Wissemann K, et al.. The impact of subjective cognitive fatigue and depression on cognitive function in patients with multiple sclerosis. Mult Scler 2018; 24: 196–204. PubMed

Denney DR, Sworowski LA, Lynch SG. Cognitive impairment in three subtypes of multiple sclerosis. Arch Clin Neuropsychol 2005; 20: 967–981. PubMed

Automated analysis of spoken language differentiates multiple system atrophy from Parkinson's disease