Over the past decade, neuropsychiatric fluctuations in Parkinson's disease (PD) have been increasingly recognized for their impact on patients' quality of life. Speech, a complex function carrying motor, emotional, and cognitive information, offers potential insights into these fluctuations. While previous studies have focused on acoustic analysis to assess motor speech disorders reliably, the potential of linguistic patterns associated with neuropsychiatric fluctuations in PD remains unexplored. This study analyzed the content of spontaneous speech from 33 PD patients in ON and OFF medication states, using machine learning and large language models (LLMs) to predict medication states and a neuropsychiatric state score. The top-performing model, the LLM Gemma-2 (9B), achieved 98% accuracy in differentiating ON and OFF states and its predicted scores were highly correlated with actual scores (Spearman's ρ = 0.81). These methods could provide a more comprehensive assessment of PD treatment effects, allowing remote neuropsychiatric symptom monitoring via mobile devices.

ARTORG Center for Biomedical Engineering Research AIMI University of Bern Bern Switzerland

ARTORG Center for Biomedical Engineering Research Gerontechnology and Rehabilitation Group University of Bern Bern Switzerland

Center for Networked Biomedical Research in Neurodegenerative Diseases Carlos 3 Institute of Health Madrid Spain

Department of Circuit Theory Faculty of Electrical Engineering Czech Technical University Prague Prague Czech Republic

Department of Neurology Bern University Hospital and University of Bern Bern Switzerland

Zobrazit více v PubMed

Bloem, B. R., Okun, M. S. & Klein, C. Parkinson’s disease. PubMed DOI

Weintraub, D., Matthew, M. D. & Stern, B. Psychiatric Complications in Parkinson Disease. PubMed

Santos García, D. et al. Non-motor symptoms burden, mood, and gait problems are the most significant factors contributing to a poor quality of life in non-demented Parkinson’s disease patients: results from the COPPADIS Study Cohort. PubMed DOI

Martínez-Fernández, R., Schmitt, E., Martinez-Martin, P. & Krack, P. The hidden sister of motor fluctuations in Parkinson’s disease: A review on nonmotor fluctuations. PubMed

Castrioto, A., Lhommée, E., Moro, E. & Krack, P. Review mood and behavioural eff ects of subthalamic stimulation in Parkinson’s disease. PubMed DOI

Pagonabarraga, J., Kulisevsky, J., Strafella, A. P. & Krack, P. Apathy in Parkinson’s disease: clinical features, neural substrates, diagnosis, and treatment. PubMed DOI

Amstutz, D. et al. Management of impulse control disorders with subthalamic nucleus deep brain stimulation in Parkinson’s Disease. PubMed DOI

Debove, I. et al. Management of impulse control and related disorders in Parkinson’s Disease: an expert consensus. PubMed

Connolly, B. S. & Lang, A. E. Pharmacological treatment of Parkinson disease: a review. PubMed

Rusz, J., Krack, P. & Tripoliti, E. From prodromal stages to clinical trials: the promise of digital speech biomarkers in Parkinson’s disease. PubMed DOI

Rusz, J. et al. Quantitative assessment of motor speech abnormalities in idiopathic rapid eye movement sleep behaviour disorder. PubMed DOI

Rusz, J., Tykalová, T., Novotný, M., Růžička, E. & Dušek, P. Distinct patterns of speech disorder in early-onset and late-onset de-novo Parkinson’s disease. PubMed DOI PMC

Šubert, M. et al. Spoken language alterations can predict phenoconversion in isolated rapid eye movement sleep behavior disorder: a multicenter study. PubMed DOI

Rusz, J. et al. Speech biomarkers in rapid eye movement sleep behavior disorder and Parkinson Disease. PubMed DOI PMC

Pell, M. D. & Leonard, C. L. Processing emotional tone from speech in Parkinson’s disease: a role for the basal ganglia. PubMed

Lausen, A. & Hammerschmidt, K. Emotion recognition and confidence ratings predicted by vocal stimulus type and prosodic parameters.

Cao, H., Beňuš, Š., Gur, R. C., Verma, R. & Nenkova, A. Prosodic cues for emotion: analysis with discrete characterization of intonation. in PubMed PMC

Wan, T. M., Gunawan, T. S., Qadri, S. A. A., Kartiwi, M. & Ambikairajah, E. A comprehensive review of speech emotion recognition systems.

Sechidis, K., Fusaroli, R., Orozco-Arroyave, J. R., Wolf, D. & Zhang, Y. P. A machine learning perspective on the emotional content of Parkinsonian speech. PubMed DOI

Palmirotta, C. et al. Unveiling the Diagnostic Potential of Linguistic Markers in Identifying Individuals with Parkinson’s Disease through Artificial Intelligence: A Systematic Review. PubMed PMC

García, A. M. et al. How language flows when movements don’t: an automated analysis of spontaneous discourse in Parkinson’s disease. PubMed DOI

Yokoi, K. et al. Analysis of spontaneous speech in Parkinson’s disease by natural language processing. PubMed DOI

Ash, S. et al. Longitudinal decline in speech production in Parkinson’s disease spectrum disorders. PubMed DOI PMC

Šubert, M. et al. Linguistic abnormalities in isolated rapid eye movement sleep behavior disorder. PubMed DOI

Cevik, F. & Kilimci, Z. H. Analysis of Parkinson’s Disease using Deep Learning and Word Embedding Models. DOI

Marras, C. et al. What Patients Say: Large-Scale Analyses of Replies to the Parkinson’s Disease Patient Report of Problems (PD-PROP). PubMed DOI PMC

Agarwal, C., Tanneru, S. H. & Lakkaraju, H. Faithfulness vs. plausibility: on the (Un)Reliability of explanations from large language models.

Huang, S., Mamidanna, S., Jangam, S., Zhou, Y. & Gilpin, L. H. Can large language models explain themselves? A study of LLM-generated self-explanations.

Xie, J., Chen, A. S., Lee, Y., Mitchell, E. & Finn, C. Calibrating Language Models with Adaptive Temperature Scaling. In

Schmitt, E. et al. Fluctuations in Parkinson’s disease and personalized medicine: bridging the gap with the neuropsychiatric fluctuation scale. PubMed DOI PMC

Norel, R. et al. Speech-based characterization of dopamine replacement therapy in people with Parkinson’s disease. PubMed DOI PMC

Zebaze, A., Sagot, B. & Bawden, R. In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translation.

Portillo Wightman, G., DeLucia, A. & Dredze, M.

Yang, K. et al. Towards Interpretable Mental Health Analysis with Large Language Models. In

Magalhães, A. D. et al. Subthalamic stimulation has acute psychotropic effects and improves neuropsychiatric fluctuations in Parkinson’s disease. PubMed DOI PMC

Dolev, E. L., Lutz, C. F. & Aepli, N. Does Whisper Understand Swiss German? An Automatic, Qualitative and Human Evaluation. in

Sicard, C., Zürich, E., Gillioz, V. & Pyszkowski, K. Spaiche: Extending State-of-the-Art ASR Models to Swiss German Dialects. in

Koenecke, A., Choi, A. S. G., Mei, K. X., Schellmann, H. & Sloane, M. Careless Whisper: Speech-to-Text Hallucination Harms. in

Liu, C., Zhang, W., Zhao, Y., Luu, A. T. & Bing, L. Is translation all you need? A study on solving multilingual tasks with large language models.

Jin, R. et al. A Comprehensive Evaluation of Quantization Strategies for Large Language Models. In

Han, S., Mao, H. & Dally, W. J. Deep compression: compressing deep neural networks with pruning, trained quantization and huffman coding. In

Illner, V. et al. Smartphone voice calls provide early biomarkers of Parkinsonism in rapid eye movement sleep behavior disorder. PubMed

Delpont, B. et al. Psychostimulant effect of dopaminergic treatment and addictions in Parkinson’s disease. PubMed DOI

Postuma, R. B. et al. MDS clinical diagnostic criteria for Parkinson’s disease. PubMed

American Psychiatric Association

Schade, S., Mollenhauer, B. & Trenkwalder, C. Levodopa Equivalent Dose Conversion Factors: An Updated Proposal Including Opicapone and Safinamide. PubMed PMC

Schmitt, E. et al. The neuropsychiatric fluctuations scale for Parkinson’s Disease: a pilot study. PubMed DOI PMC

Goetz, C. G. et al. Movement disorder society-sponsored revision of the unified Parkinson’s Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. PubMed DOI

Nasreddine, Z. S. et al. The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. PubMed DOI

Zigmond, A. S. & Snaith, R. P. The hospital anxiety and depression scale. PubMed

Starkstein, S. E. et al. Reliability, validity, and clinical correlates of apathy in Parkinson’s disease. PubMed DOI

Weintraub, D. et al. Questionnaire for impulsive-compulsive disorders in Parkinson’s Disease–Rating Scale. PubMed DOI PMC

Rusz, J., Tykalova, T., Ramig, L. O. & Tripoliti, E. Guidelines for speech recording and acoustic analyses in dysarthrias of movement disorders. PubMed

Radford, A. et al. Robust speech recognition via large-scale weak supervision. in

Kuhn, K., Kersken, V., Reuter, B., Egger, N. & Zimmermann, G. Measuring the accuracy of automatic speech recognition solutions.

Plüss, M. et al. STT4SG-350: a speech corpus for all Swiss German Dialect Regions. in

Etxaniz, J., Azkune, G., Soroa, A., de Lacalle, O. L. & Artetxe, M. Do multilingual language models think better in English? In

Pedregosa, F. et al. Scikit-Learn: Machine Learning in Python

Reimers, N. & Gurevych, I. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In

Agbavor, F. & Liang, H. Predicting dementia from spontaneous speech using large language models. PubMed DOI PMC

Vu, H., Abdurahman, S., Bhatia, S. & Ungar, L. Predicting Responses to Psychological Questionnaires from Participants’ Social Media Posts and Question Text Embeddings. In

Mathur, Y. et al. SummQA at MEDIQA-Chat 2023: In-Context Learning with GPT-4 for Medical Summarization. In

Naderalvojoud, B. & Hernandez-Boussard, T. Improving machine learning with ensemble learning on observational healthcare data. PubMed PMC

Vacareanu, R., Negru, V.-A., Suciu, V. & Surdeanu, M. From words to numbers: your large language model is secretly a capable regressor when given in-context examples. arXiv preprint arXiv:2404.07544 (2024).

Jiang, Z., Araki, J., Ding, H. & Neubig, G. How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering.

Pereira, T., Cardoso, S., Guerreiro, M., Mendonça, A. & Madeira, S. C. Targeting the uncertainty of predictions at patient-level using an ensemble of classifiers coupled with calibration methods, Venn-ABERS, and Conformal Predictors: A case study in AD. PubMed DOI

Guo, C., Pleiss, G., Sun, Y. & Weinberger, K. Q. On calibration of modern neural networks. in