Standard approaches to cognitive remediation can suffer from limited skill transferability to patients' life. Complex virtual environments (VEs) enable us to create ecologically valid remediation scenarios while preserving laboratory conditions. Nevertheless, the feasibility and efficacy of these programs in psychiatric patients are still unknown. Our aim was to compare the feasibility and efficacy of a novel rehabilitation program, designed in complex VEs, with standard paper-pencil treatment in patients with schizophrenia and major depressive disorder. We recruited 35 participants to complete a VE rehabilitation program and standard treatment in a crossover pilot study. Twenty-eight participants completed at least one program, 22 were diagnosed with schizophrenia and 6 with major depressive disorder. Participant's performance in the representative VE training task significantly improved in terms of maximum achieved difficulty (p ≤ 0.001), speed (p < 0.001) and efficacy (p ≤ 0.001) but not in item performance measure. Neither the standard treatment nor the VE program led to improvement in standardized cognitive measures. Participants perceived both programs as enjoyable and beneficial. The refusal rate was higher in the VE program (8.6%) than in the standard treatment (0%). But in general, the VE program was well-accepted by the psychiatric patients and it required minimal involvement of the clinician due to automatic difficulty level adjustment and performance recording. However, the VE program did not prove to be effective in improving cognitive performance in the standardized measures.

3rd Faculty of Medicine Charles University 100 00 Prague Czech Republic

National Institute of Mental Health 250 67 Klecany Czech Republic

Psychotherapeutic Day Center for Psychotic Patients 733 01 Karviná Czech Republic

See more in PubMed

Perälä J., Suvisaari J., Saarni S.I., Kuoppasalmi K., Isometsä E., Pirkola S., Partonen T., Tuulio-Henriksson A., Hintikka J., Kieseppä T., et al. Lifetime prevalence of psychotic and bipolar I disorders in a general population. Arch. Gen. Psychiatry. 2007;64:19–28. doi: 10.1001/archpsyc.64.1.19. PubMed DOI

Bromet E., Andrade L.H., Hwang I., Sampson N.A., Alonso J., de Girolamo G., de Graaf R., Demyttenaere K., Hu C., Iwata N., et al. Cross-national epidemiology of DSM-IV major depressive episode. BMC Med. 2011;9:90. doi: 10.1186/1741-7015-9-90. PubMed DOI PMC

Bora E., Pantelis C. Meta-analysis of Cognitive Impairment in First-Episode Bipolar Disorder: Comparison With First-Episode Schizophrenia and Healthy Controls. Schizophr. Bull. 2015;41:1095–1104. doi: 10.1093/schbul/sbu198. PubMed DOI PMC

Lee R.S.C., Hermens D.F., Scott J., Redoblado-Hodge M.A., Naismith S.L., Lagopoulos J., Griffiths K.R., Porter M.A., Hickie I.B. A meta-analysis of neuropsychological functioning in first-episode bipolar disorders. J. Psychiatr. Res. 2014;57:1–11. doi: 10.1016/j.jpsychires.2014.06.019. PubMed DOI

Hammar A., Ardal G. Cognitive functioning in major depression--a summary. Front. Hum. Neurosci. 2009;3:26. doi: 10.3389/neuro.09.026.2009. PubMed DOI PMC

Sheffield J.M., Karcher N.R., Barch D.M. Cognitive Deficits in Psychotic Disorders: A Lifespan Perspective. Neuropsychol. Rev. 2018;28:509–533. doi: 10.1007/s11065-018-9388-2. PubMed DOI PMC

Schatzberg A.F., Posener J.A., DeBattista C., Kalehzan B.M., Rothschild A.J., Shear P.K. Neuropsychological deficits in psychotic versus nonpsychotic major depression and no mental illness. Am. J. Psychiatry. 2000;157:1095–1100. doi: 10.1176/appi.ajp.157.7.1095. PubMed DOI

World Health Organization . International Statistical Classification of Diseases and Related Health Problems. World Health Organization; Geneva, Switzerland: 2004.

World Health Organization . International Classification of Diseases for Mortality and Morbidity Statistics. World Health Organization; Geneva, Switzerland: 2018.

Bora E., Binnur Akdede B., Alptekin K. Neurocognitive impairment in deficit and non-deficit schizophrenia: A meta-analysis. Psychol. Med. 2017;47:2401–2413. doi: 10.1017/S0033291717000952. PubMed DOI

Green M.F., Kern R.S., Heaton R.K. Longitudinal studies of cognition and functional outcome in schizophrenia: Implications for MATRICS. Schizophr. Res. 2004;72:41–51. doi: 10.1016/j.schres.2004.09.009. PubMed DOI

Green M.F. Cognitive impairment and functional outcome in schizophrenia and bipolar disorder. J. Clin. Psychiatry. 2006;67:e12. doi: 10.4088/JCP.1006e12. PubMed DOI

Huhn M., Nikolakopoulou A., Schneider-Thoma J., Krause M., Samara M., Peter N., Arndt T., Bäckers L., Rothe P., Cipriani A., et al. Comparative efficacy and tolerability of 32 oral antipsychotics for the acute treatment of adults with multi-episode schizophrenia: A systematic review and network meta-analysis. Lancet. 2019;394:939–951. doi: 10.1016/S0140-6736(19)31135-3. PubMed DOI PMC

Uchida H., Suzuki T., Takeuchi H., Arenovich T., Mamo D.C. Low dose vs standard dose of antipsychotics for relapse prevention in schizophrenia: Meta-analysis. Schizophr. Bull. 2011;37:788–799. doi: 10.1093/schbul/sbp149. PubMed DOI PMC

Leucht S., Corves C., Arbter D., Engel R.R., Li C., Davis J.M. Second-generation versus first-generation antipsychotic drugs for schizophrenia: A meta-analysis. Lancet. 2009;373:31–41. doi: 10.1016/S0140-6736(08)61764-X. PubMed DOI

Davidson M., Galderisi S., Weiser M., Werbeloff N., Fleischhacker W.W., Keefe R.S., Boter H., Keet I.P.M., Prelipceanu D., Rybakowski J.K., et al. Cognitive effects of antipsychotic drugs in first-episode schizophrenia and schizophreniform disorder: A randomized, open-label clinical trial (EUFEST) Am. J. Psychiatry. 2009;166:675–682. doi: 10.1176/appi.ajp.2008.08060806. PubMed DOI

Nielsen R.E., Levander S., Kjaersdam Telléus G., Jensen S.O.W., Østergaard Christensen T., Leucht S. Second-generation antipsychotic effect on cognition in patients with schizophrenia--a meta-analysis of randomized clinical trials. Acta Psychiatr. Scand. 2015;131:185–196. doi: 10.1111/acps.12374. PubMed DOI

Prado C.E., Watt S., Crowe S.F. A meta-analysis of the effects of antidepressants on cognitive functioning in depressed and non-depressed samples. Neuropsychol. Rev. 2018;28:32–72. doi: 10.1007/s11065-018-9369-5. PubMed DOI

Shilyansky C., Williams L.M., Gyurak A., Harris A., Usherwood T., Etkin A. Effect of antidepressant treatment on cognitive impairments associated with depression: A randomised longitudinal study. Lancet Psychiatry. 2016;3:425–435. doi: 10.1016/S2215-0366(16)00012-2. PubMed DOI PMC

Rosenblat J.D., Kakar R., McIntyre R.S. The Cognitive Effects of Antidepressants in Major Depressive Disorder: A Systematic Review and Meta-Analysis of Randomized Clinical Trials. Int. J. Neuropsychopharmacol. 2015;19 doi: 10.1093/ijnp/pyv082. PubMed DOI PMC

Benedict R.H., Harris A.E., Markow T., McCormick J.A., Nuechterlein K.H., Asarnow R.F. Effects of attention training on information processing in schizophrenia. Schizophr. Bull. 1994;20:537–546. doi: 10.1093/schbul/20.3.537. PubMed DOI

Prikken M., Konings M.J., Lei W.U., Begemann M.J.H., Sommer I.E.C. The efficacy of computerized cognitive drill and practice training for patients with a schizophrenia-spectrum disorder: A meta-analysis. Schizophr. Res. 2019;204:368–374. doi: 10.1016/j.schres.2018.07.034. PubMed DOI

McGurk S.R., Twamley E.W., Sitzer D.I., McHugo G.J., Mueser K.T. A Meta-Analysis of Cognitive Remediation in Schizophrenia. Am. J. Psychiatry. 2007;164:1791–1802. doi: 10.1176/appi.ajp.2007.07060906. PubMed DOI PMC

Wykes T., Huddy V., Cellard C., McGurk S.R., Czobor P. A Meta-Analysis of Cognitive Remediation for Schizophrenia: Methodology and Effect Sizes. Am. J. Psychiatry. 2011;168:472–485. doi: 10.1176/appi.ajp.2010.10060855. PubMed DOI

Grynszpan O., Perbal S., Pelissolo A., Fossati P., Jouvent R., Dubal S., Perez-Diaz F. Efficacy and specificity of computer-assisted cognitive remediation in schizophrenia: A meta-analytical study. Psychol. Med. 2011;41:163–173. doi: 10.1017/S0033291710000607. PubMed DOI

Cella M., Price T., Corboy H., Onwumere J., Shergill S., Preti A. Cognitive remediation for inpatients with psychosis: A systematic review and meta-analysis. Psychol. Med. 2020;50:1062–1076. doi: 10.1017/S0033291720000872. PubMed DOI

Hajri M., Abbes Z., Ben Yahia H., Boudali M., Halayem S., Othman S., Bouden A., Ouanes S. Effects of Cognitive Remediation in Patients with Mood Disorder. Eur. Psychiatry. 2015;30:1659. doi: 10.1016/S0924-9338(15)32082-4. DOI

Paquin K., Wilson A.L., Cellard C., Lecomte T., Potvin S. A systematic review on improving cognition in schizophrenia: Which is the more commonly used type of training, practice or strategy learning? BMC Psychiatry. 2014;14:139. doi: 10.1186/1471-244X-14-139. PubMed DOI PMC

Neisser U. Memory: What are the important questions. In: Gruneberg M.M., Morris P.E., Sykes R.N., editors. Practical Aspects of Memory. Academic Press; Cambridge, MA, USA: London, UK: 1978. pp. 3–24.

Moreau D., Conway A.R.A. The case for an ecological approach to cognitive training. Trends Cogn. Sci. 2014;18:334–336. doi: 10.1016/j.tics.2014.03.009. PubMed DOI

Rose F.D., Attree E.A., Brooks B.M., Parslow D.M., Penn P.R., Ambihaipahan N. Training in virtual environments: Transfer to real world tasks and equivalence to real task training. Ergonomics. 2000;43:494–511. doi: 10.1080/001401300184378. PubMed DOI

Parsons T.D. Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences. Front. Hum. Neurosci. 2015;9:660. doi: 10.3389/fnhum.2015.00660. PubMed DOI PMC

Samuel R., Thomas E., Jacob K.S. Instrumental Activities of Daily Living Dysfunction among People with Schizophrenia. Indian J. Psychol. Med. 2018;40:134–138. doi: 10.4103/IJPSYM.IJPSYM_308_17. PubMed DOI PMC

Rizzo A.A., Schultheis M., Kerns K.A., Mateer C. Analysis of assets for virtual reality applications in neuropsychology. Neuropsychol. Rehabil. 2004;14:207–239. doi: 10.1080/09602010343000183. DOI

Rose F.D., Brooks B.M., Rizzo A.A. Virtual reality in brain damage rehabilitation: Review. Cyberpsychol. Behav. 2005;8:241–262; discussion 263–271. doi: 10.1089/cpb.2005.8.241. PubMed DOI

Cummings J.J., Bailenson J.N. How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence. Media Psychol. 2015;19:272–309. doi: 10.1080/15213269.2015.1015740. DOI

Bisso E., Signorelli M.S., Milazzo M., Maglia M., Polosa R., Aguglia E., Caponnetto P. Immersive Virtual Reality Applications in Schizophrenia Spectrum Therapy: A Systematic Review. Int. J. Environ. Res. Public Health. 2020;17:6111. doi: 10.3390/ijerph17176111. PubMed DOI PMC

Donders F.C. On the speed of mental processes. Acta Psychol. 1969;30:412–431. doi: 10.1016/0001-6918(69)90065-1. PubMed DOI

Plechatá A., Hejtmánek L., Fajnerová I. Virtual Supermarket Shopping Task for Cognitive Rehabilitation and Assessment of Psychiatric Patients: Validation in Chronic Schizophrenia. Ceskoslovenska Psychol. 2021;65:14–30. doi: 10.51561/cspsych.65.1.14. DOI

Gold J.M., Queern C., Iannone V.N., Buchanan R.W. Repeatable battery for the assessment of neuropsychological status as a screening test in schizophrenia I: Sensitivity, reliability, and validity. Am. J. Psychiatry. 1999;156:1944–1950. doi: 10.1176/ajp.156.12.1944. PubMed DOI

Marder S.R., Fenton W. Measurement and Treatment Research to Improve Cognition in Schizophrenia: NIMH MATRICS initiative to support the development of agents for improving cognition in schizophrenia. Schizophr. Res. 2004;72:5–9. doi: 10.1016/j.schres.2004.09.010. PubMed DOI

Krámská L., Dvořáková Z., Žalmanová J. Adaptation and initial validation of the Czech version of Neuropsychological Assessment Battery Screening Module; Proceedings of the International Neuropsychological Society 2020 Virtual Event “The Neuropsychology of Pleasure, Dreaming, and Memories”; Vienna, Austria. 1–2 July 2020; DOI

Bates D., Mächler M., Bolker B., Walker S. Fitting Linear Mixed-Effects Models Using lme4. J. Stat. Softw. Artic. 2015;67:1–48. doi: 10.18637/jss.v067.i01. DOI

Cnaan A., Laird N.M., Slasor P. Using the general linear mixed model to analyse unbalanced repeated measures and longitudinal data. Stat. Med. 1997;16:2349–2380. doi: 10.1002/(SICI)1097-0258(19971030)16:20<2349::AID-SIM667>3.0.CO;2-E. PubMed DOI

R Core Team . R: A Language and Environment for Statistical Computing. R Core Team; Vienna, Austria: 2020.

Wickham H. Ggplot2: Elegant Graphics for Data Analysis. Springer; Cham, Switzerland: 2016.

Kuznetsova A., Brockhoff P., Christensen R. lmerTest Package: Tests in Linear Mixed Effects Models. J. Stat. Softw. Artic. 2017;82:1–26. doi: 10.18637/jss.v082.i13. DOI

La Cascia C., Ferraro L., Seminerio F., Scaglione A., Maniaci G., Matranga D., Sideli L., Colli G., Sartorio C., La Paglia F., et al. Evaluating the feasibility of the Italian version of the computerized interactive remediation of cognition training for schizophrenia (CIRCuiTS) Minerva Psichiatr. 2020;61 doi: 10.23736/S0391-1772.20.02092-0. DOI

La Paglia F., La Cascia C., Rizzo R., Sanna M., Cangialosi F., Sideli L., Francomano A., Riva G., La Barbera D. Virtual reality environments to rehabilitation attention deficits in schizophrenic patients. Annu. Rev. Cybertherapy Telemed. 2016;14:143–148.

La Paglia F., La Cascia C., Rizzo R., Sideli L., Francomano A., La Barbera D. Cognitive rehabilitation of schizophrenia through NeuroVr training. Stud. Health Technol. Inform. 2013;191:158–162. PubMed

Revell E.R., Neill J.C., Harte M., Khan Z., Drake R.J. A systematic review and meta-analysis of cognitive remediation in early schizophrenia. Schizophr. Res. 2015;168:213–222. doi: 10.1016/j.schres.2015.08.017. PubMed DOI

Kidd S.A., Herman Y., Virdee G., Bowie C.R., Velligan D., Plagiannakos C., Voineskos A. A comparison of compensatory and restorative cognitive interventions in early psychosis. Schizophr Res Cogn. 2020;19:100157. doi: 10.1016/j.scog.2019.100157. PubMed DOI PMC

Mahncke H.W., Kim S.-J., Rose A., Stasio C., Buckley P., Caroff S., Duncan E., Yasmin S., Jarskog L.F., Lamberti J.S., et al. Evaluation of a plasticity-based cognitive training program in schizophrenia: Results from the eCaesar trial. Schizophr. Res. 2019;208:182–189. doi: 10.1016/j.schres.2019.03.006. PubMed DOI PMC

Rass O., Forsyth J.K., Bolbecker A.R., Hetrick W.P., Breier A., Lysaker P.H., O’Donnell B.F. Computer-assisted cognitive remediation for schizophrenia: A randomized single-blind pilot study. Schizophr. Res. 2012;139:92–98. doi: 10.1016/j.schres.2012.05.016. PubMed DOI PMC

Lejeune J.A., Northrop A., Kurtz M.M. A Meta-analysis of Cognitive Remediation for Schizophrenia: Efficacy and the Role of Participant and Treatment Factors. Schizophr. Bull. 2021 doi: 10.1093/schbul/sbab022. PubMed DOI PMC

Gsottschneider A., Keller Z., Pitschel-Walz G., Froböse T., Bäuml J., Jahn T. The role of encoding strategies in the verbal memory performance in patients with schizophrenia. J. Neuropsychol. 2011;5:56–72. doi: 10.1348/174866410X497382. PubMed DOI

Bonner-Jackson A., Barch D.M. Strategic Manipulations for Associative Memory and the Role of Verbal Processing Abilities in Schizophrenia. J. Int. Neuropsychol. Soc. 2011;17:796–806. doi: 10.1017/S1355617711000749. PubMed DOI

Barlati S., Deste G., Galluzzo A., Perin A.P., Valsecchi P., Turrina C., Vita A. Factors Associated With Response and Resistance to Cognitive Remediation in Schizophrenia: A Critical Review. Front. Pharmacol. 2018;9:1542. doi: 10.3389/fphar.2018.01542. PubMed DOI PMC

Bezdicek O., Michalec J., Kališová L., Kufa T., Děchtěrenko F., Chlebovcová M., Havlík F., Green M.F., Nuechterlein K.H. Profile of cognitive deficits in schizophrenia and factor structure of the Czech MATRICS Consensus Cognitive Battery. Schizophr. Res. 2020;218:85–92. doi: 10.1016/j.schres.2020.02.004. PubMed DOI

Bryce S., Sloan E., Lee S., Ponsford J., Rossell S. Cognitive remediation in schizophrenia: A methodological appraisal of systematic reviews and meta-analyses. J. Psychiatr. Res. 2016;75:91–106. doi: 10.1016/j.jpsychires.2016.01.004. PubMed DOI

Buchanan R.W. Persistent negative symptoms in schizophrenia: An overview. Schizophr. Bull. 2007;33:1013–1022. doi: 10.1093/schbul/sbl057. PubMed DOI PMC

Blanchard J.J., Cohen A.S. The structure of negative symptoms within schizophrenia: Implications for assessment. Schizophr. Bull. 2006;32:238–245. doi: 10.1093/schbul/sbj013. PubMed DOI PMC

Wilk C.M., Gold J.M., Bartko J.J., Dickerson F., Fenton W.S., Knable M., Randolph C., Buchanan R.W. Test-retest stability of the Repeatable Battery for the Assessment of Neuropsychological Status in schizophrenia. Am. J. Psychiatry. 2002;159:838–844. doi: 10.1176/appi.ajp.159.5.838. PubMed DOI

Brodská V. Ph.D. Thesis. Charles University; Prague, Czechia: 2017. Evaluation of Psychometric Characteristics of Czech Version RBANS.