Artificial Intelligence Can Improve Patient Management at the Time of a Pandemic: The Role of Voice Technology
Language English Country Canada Media electronic
Document type Journal Article
PubMed
33999834
PubMed Central
PMC8153030
DOI
10.2196/22959
PII: v23i5e22959
Knihovny.cz E-resources
- Keywords
- COVID-19, artificial intelligence, conversational agent, virtual care, voice assistant, voice chatbot,
- MeSH
- Chronic Disease therapy MeSH
- COVID-19 * MeSH
- Voice * MeSH
- Communication * MeSH
- Referral and Consultation MeSH
- Humans MeSH
- Cell Phone MeSH
- Pandemics MeSH
- Critical Care methods MeSH
- Delivery of Health Care methods MeSH
- Speech Recognition Software * MeSH
- Telemedicine methods MeSH
- Triage MeSH
- Artificial Intelligence * MeSH
- Check Tag
- Humans MeSH
- Publication type
- Journal Article MeSH
Artificial intelligence-driven voice technology deployed on mobile phones and smart speakers has the potential to improve patient management and organizational workflow. Voice chatbots have been already implemented in health care-leveraging innovative telehealth solutions during the COVID-19 pandemic. They allow for automatic acute care triaging and chronic disease management, including remote monitoring, preventive care, patient intake, and referral assistance. This paper focuses on the current clinical needs and applications of artificial intelligence-driven voice chatbots to drive operational effectiveness and improve patient experience and outcomes.
Department of Cardiology and Structural Heart Diseases Medical University of Silesia Katowice Poland
See more in PubMed
Hoy MB. Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Med Ref Serv Q. 2018;37(1):81–88. doi: 10.1080/02763869.2018.1404391. PubMed DOI
Lai L, Wittbold KA, Dadabhoy FZ, Sato R, Landman AB, Schwamm LH, He S, Patel R, Wei N, Zuccotti G, Lennes IT, Medina D, Sequist TD, Bomba G, Keschner YG, Zhang H. Digital triage: Novel strategies for population health management in response to the COVID-19 pandemic. Healthc (Amst) 2020 Dec;8(4):100493. doi: 10.1016/j.hjdsi.2020.100493. PubMed DOI PMC
Sezgin E, Noritz G, Elek A, Conkol K, Rust S, Bailey M, Strouse R, Chandawarkar A, von Sadovszky V, Lin S, Huang Y. Capturing At-Home Health and Care Information for Children With Medical Complexity Using Voice Interactive Technologies: Multi-Stakeholder Viewpoint. J Med Internet Res. 2020 Feb 13;22(2):e14202. doi: 10.2196/14202. PubMed DOI PMC
Furst J. Mayo Clinic introduces skill for Amazon’s Alexa about COVID-19. Mayo Clinic. 2020. Apr 27, [2020-03-21]. https://newsnetwork.mayoclinic.org/discussion/mayo-clinic-introduces-skill-for-amazons-alexa-about-covid-19/
Beaman J. Interactive Voice-Based Administration of the PHQ-9. ClinicalTrials.gov. 2020. [2021-05-17]. https://clinicaltrials.gov/ct2/show/NCT04609267.
Palanica A, Thommandram A, Lee A, Li M, Fossat Y. Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names. NPJ Digit Med. 2019;2:55. doi: 10.1038/s41746-019-0133-x. doi: 10.1038/s41746-019-0133-x. PubMed DOI PMC
Jadczyk T, Kiwic O, Khandwalla RM, Grabowski K, Rudawski S, Magaczewski P, Benyahia H, Wojakowski W, Henry TD. Feasibility of a voice-enabled automated platform for medical data collection: CardioCube. Int J Med Inform. 2019 Sep;129:388–393. doi: 10.1016/j.ijmedinf.2019.07.001. PubMed DOI
Miner AS, Milstein A, Schueller S, Hegde R, Mangurian C, Linos E. Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health. JAMA Intern Med. 2016 May 01;176(5):619–625. doi: 10.1001/jamainternmed.2016.0400. PubMed DOI PMC
Nobles AL, Leas EC, Caputi TL, Zhu S, Strathdee SA, Ayers JW. Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digit Med. 2020;3:11. doi: 10.1038/s41746-019-0215-9. doi: 10.1038/s41746-019-0215-9. PubMed DOI PMC
Kocaballi AB, Quiroz JC, Rezazadegan D, Berkovsky S, Magrabi F, Coiera E, Laranjo L. Responses of Conversational Agents to Health and Lifestyle Prompts: Investigation of Appropriateness and Presentation Structures. J Med Internet Res. 2020 Feb 09;22(2):e15823. doi: 10.2196/15823. PubMed DOI PMC
Alagha EC, Helbing RR. Evaluating the quality of voice assistants' responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform. 2019 Nov;26(1):e100075. doi: 10.1136/bmjhci-2019-100075. PubMed DOI PMC
Koulaouzidis G, Charisopoulou D, Wojakowski W, Koulaouzidis A, Marlicz W, Jadczyk T. Telemedicine in cardiology in the time of coronavirus disease 2019: a friend that everybody needs. Pol Arch Intern Med. 2020 Jun 25;130(6):559–561. doi: 10.20452/pamw.15432. PubMed DOI
Medical Device Data Systems. US Food and Drug Administration. 2019. Sep 26, [2021-03-21]. https://www.fda.gov/medical-devices/general-hospital-devices-and-supplies/medical-device-data-systems.
Medical Device Data Systems, Medical Image Storage Devices, and Medical Image Communications Devices. US Food and Drug Administration. 2019. [2021-03-21]. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/medical-device-data-systems-medical-image-storage-devices-and-medical-image-communications-devices.
Software as a Medical Device (SaMD) US Food and Drug Adminisration. 2018. Apr 12, [2021-03-21]. https://www.fda.gov/medical-devices/digital-health-center-excellence/software-medical-device-samd.
WebMD. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B01MRM361G.
Cleveland Clinic Tip of the Day. Amazon. [2021-03-21]. https://www.amazon.com/Cleveland-Clinic-Tip-Day/dp/B077BFFQSZ.
KidsMD. Amazon. [2021-03-21]. https://www.amazon.com/Boston-Childrens-Hospital-KidsMD/dp/B01E3F0AUC.
Mayo Clinic First Aid. Amazon. [2021-03-21]. https://www.amazon.com/mayo-clinic-first-aid/dp/b0744ljcv2.
First Aid. Amazon. [2021-03-21]. https://www.amazon.com/American-Red-Cross-First-Aid/dp/B07KMSZQ5F.
Mayo Clinic News Network. Amazon. [2021-03-21]. https://www.amazon.com/mayo-clinic-news-network/dp/b0711hkbb6.
MyChildren's Enhanced Recovery After Surgery. Amazon. [2021-03-21]. https://www.amazon.com/MyChildrens-Enhanced-Recovery-After-Surgery/dp/B07QB7PQYW/
OhioHealth: Alexa skills. Amazon. [2021-03-21]. https://www.amazon.com/OhioHealth/dp/B077SNT8L6.
New Hanover Regional Medical Center. Amazon. [2021-03-21]. https://www.amazon.com/New-Hanover-Regional-Medical-Center/dp/B07BS5TGSQ.
Livongo Blood Sugar Lookup. Amazon. [2021-03-21]. https://www.amazon.com/Livongo-Health-Blood-Sugar-Lookup/dp/B07QHF76RN.
Giant Eagle Pharmacy. Amazon. [2021-03-21]. https://www.amazon.com/Omnicell-Inc-Giant-Eagle-Pharmacy/dp/B08164DYJ7.
Express Scripts. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07QB7P6Y2.
Swedish Health Connect: Alexa skills. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07PGJYYF6.
Atrium Health. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07H1T46DC,
OrbitaASSIST: Virtual Bedside Assistant. Orbita. [2021-03-21]. https://orbita.ai/orbita-assist-virtual-bedside-assistant/
Answers by Cigna. Amazon. [2021-03-21]. https://www.amazon.com/Cigna-Answers-by/dp/B079SMKCZB.
OrbitaCONNECT. Orbita. [2021-03-21]. https://orbita.ai/orbita-connect-virtual-health-assistant-care-continuity/,
Talkspace: Online therapy for all. Amazon. [2021-03-21]. https://www.amazon.com/Talkspace-Online-therapy-for-all/dp/B085VHRW33.
Personalized Voice Activated Wellness Assistants for Patients With Heart Failure. ClinicalTrials.gov. [2021-03-21]. https://www.clinicaltrials.gov/ct2/show/NCT03707275.
Haase CB, Bearman M, Brodersen J, Hoeyer K, Risor T. 'You should see a doctor', said the robot: Reflections on a digital diagnostic device in a pandemic age. Scand J Public Health. 2021 Feb 18;49(1):33–36. doi: 10.1177/1403494820980268. PubMed DOI PMC
Iansiti M, Lakhani K. Competing in the Age of AI. Harvard Business Review. 2020. Jan 16, [2021-05-17]. https://hbr.org/webinar/2020/01/competing-in-the-age-of-ai#:~:text=and%20deliver%20value.-,In%20their%20new%20book%20Competing%20in%20the%20Age%20of%20AI,scale%2C%20scope%2C%20and%20learning.
Kucharski AJ, Russell TW, Diamond C, Liu Y, Edmunds J, Funk S, Eggo RM, Centre for Mathematical Modelling of Infectious Diseases COVID-19 working group Early dynamics of transmission and control of COVID-19: a mathematical modelling study. Lancet Infect Dis. 2020 May;20(5):553–558. doi: 10.1016/S1473-3099(20)30144-4. PubMed DOI PMC
Schwirtz M. Nurses die, doctors fall sick and panic rises on virus front lines. The New York Times. [2021-03-21]. https://www.nytimes.com/2020/03/30/nyregion/ny-coronavirus-doctors-sick.html.
Rose C. Am I Part of the Cure or Am I Part of the Disease? Keeping Coronavirus Out When a Doctor Comes Home. N Engl J Med. 2020 Apr 30;382(18):1684–1685. doi: 10.1056/NEJMp2004768. PubMed DOI
Wu JT, Leung K, Bushman M, Kishore N, Niehus R, de Salazar PM, Cowling BJ, Lipsitch M, Leung GM. Estimating clinical severity of COVID-19 from the transmission dynamics in Wuhan, China. Nat Med. 2020 Apr;26(4):506–510. doi: 10.1038/s41591-020-0822-7. PubMed DOI PMC
Worldometer. [2021-03-21]. https://www.worldometers.info/coronavirus/
Solomon MD, McNulty EJ, Rana JS, Leong TK, Lee C, Sung S, Ambrosy AP, Sidney S, Go AS. The Covid-19 Pandemic and the Incidence of Acute Myocardial Infarction. N Engl J Med. 2020 Aug 13;383(7):691–693. doi: 10.1056/NEJMc2015630. PubMed DOI
Krouse HJ. COVID-19 and the Widening Gap in Health Inequity. Otolaryngol Head Neck Surg. 2020 Jul;163(1):65–66. doi: 10.1177/0194599820926463. PubMed DOI
Lacina L. COVID-19 reveals gaps in health systems: WHO Briefing. World Economic Forum. 2020. May 06, [2021-03-21]. https://www.weforum.org/agenda/2020/05/covid-19-reveals-gaps-in-public-health-system-who-briefing/
Judson T, Odisho A, Young J, Bigazzi O, Steuer D, Gonzales R, Neinstein AB. Implementation of a digital chatbot to screen health system employees during the COVID-19 pandemic. J Am Med Inform Assoc. 2020 Jul 01;27(9):1450–1455. doi: 10.1093/jamia/ocaa130. PubMed DOI PMC
Webster P. Virtual health care in the era of COVID-19. Lancet. 2020 Apr 11;395(10231):1180–1181. doi: 10.1016/S0140-6736(20)30818-7. PubMed DOI PMC
Greenhalgh T, Koh GCH, Car J. Covid-19: a remote assessment in primary care. BMJ. 2020 Mar 25;368:m1182. doi: 10.1136/bmj.m1182. PubMed DOI
Cosentino D. Ten steps to building a successful telehealth program. Caring. 2009 Jul;28(7):34–39. PubMed
Schulman KA, Richman BD. Toward an Effective Innovation Agenda. N Engl J Med. 2019 Mar 07;380(10):900–901. doi: 10.1056/NEJMp1812460. PubMed DOI
Keesara S, Jonas A, Schulman K. Covid-19 and Health Care's Digital Revolution. N Engl J Med. 2020 Jun 04;382(23):e82. doi: 10.1056/NEJMp2005835. PubMed DOI
Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians' Perceptions of Chatbots in Health Care: Cross-Sectional Web-Based Survey. J Med Internet Res. 2019 Apr 05;21(4):e12887. doi: 10.2196/12887. PubMed DOI PMC
Schwamm LH, Erskine A, Licurse A. A digital embrace to blunt the curve of COVID19 pandemic. NPJ Digit Med. 2020;3:64. doi: 10.1038/s41746-020-0279-6. doi: 10.1038/s41746-020-0279-6. PubMed DOI PMC
Roth M. How OSF'S 6 Digital Approaches Handle More Than 50,000 COVID Encounters. HealthLeaders. 2020. Apr 28, [2021-03-21]. https://www.healthleadersmedia.com/innovation/how-osfs-6-digital-approaches-handle-more-50000-covid-encounters.
The VOICE-COVID-19. ClinicalTrials.gov. [2021-03-21]. https://www.clinicaltrials.gov/ct2/show/NCT04508972.
Sherr I. Apple, Google, Amazon block nonofficial coronavirus apps from app stores. CNET. 2020. Mar 15, [2021-03-21]. https://www.cnet.com/news/apple-google-amazon-block-nonofficial-coronavirus-apps-from-app-stores/
Employee Health Manager. Orbita. [2021-03-21]. https://orbita.ai/orbita-employee-health-manager/
Ross C. I asked eight chatbots whether I had Covid-19. The answers ranged from ‘low’ risk to ‘start home isolation’. STAT. 2020. Mar 23, [2021-03-21]. https://www.statnews.com/2020/03/23/coronavirus-i-asked-eight-chatbots-whether-i-had-covid-19/
Cohen AB, Mathews SC, Dorsey ER, Bates DW, Safavi K. Direct-to-consumer digital health. Lancet Digit Health. 2020 Apr;2(4):e163–e165. doi: 10.1016/S2589-7500(20)30057-1. PubMed DOI
Virtual healthcare at an affordable rate. CardioCube. [2021-03-21]. https://cardiocube.com/
Gao C. Use New Alexa Emotions and Speaking Styles to Create a More Natural and Intuitive Voice Experience. Amazon Alexa. 2019. [2021-03-21]. https://developer.amazon.com/en-US/blogs/alexa/alexa-skills-kit/2019/11/new-alexa-emotions-and-speaking-styles.
Gao C. Create Engaging Voice Experiences with a New Alexa Speaking Style, Speaking Styles in Amazon Polly Voices and Additional Polly Voices. Amazon Alexa. 2020. [2021-03-21]. https://developer.amazon.com/en-US/blogs/alexa/alexa-skills-kit/2020/04/new-alexa-long-form-speaking-style-and-polly-voices?tag=theverge02-20.
Portet F, Vacher M, Golanski C, Roux C, Meillon B. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Pers Ubiquit Comput. 2011 Oct 2;17(1):127–144. doi: 10.1007/s00779-011-0470-5. DOI
Cheng A, Raghavaraju V, Kanugo J, Handrianto Y, Shang Y. Development and evaluation of a healthy coping voice interface application using the Google home for elderly patients with type 2 diabetes. 2018 15th IEEE Annual Consumer Communications & Networking Conference; January 12-15, 2018; Las Vegas, NV. 2018. pp. 12–15. DOI
Slavík P, Němec V, Sporka AJ. Speech Based User Interface for Users with Special Needs. 8th International Conference on Text, Speech and Dialogue; September 12-15, 2005; Karlovy Vary. 2005. DOI
Fisher T, Metcalf D, Pruthi S, Pappas H. Voice Technology in Healthcare: Leveraging Voice to Enhance Patient and Provider Experiences. New York, NY: Productivity Press; 2020. The Opportunity for Voice in Healthcare.
Kumah-Crystal Y, Pirtle C, Whyte H, Goode E, Anders S, Lehmann C. Electronic Health Record Interactions through Voice: A Review. Appl Clin Inform. 2018 Jul;9(3):541–552. doi: 10.1055/s-0038-1666844. PubMed DOI PMC
The Smart Audio Report. National Public Media. 2020. [2021-03-21]. https://www.nationalpublicmedia.com/insights/reports/smart-audio-report/,
Number of digital voice assistants in use worldwide from 2019 to 2024 (in billions)*. Statista. [2021-03-21]. https://www.statista.com/statistics/973815/worldwide-digital-voice-assistant-in-use/#statisticContainer,
Hollander JE, Carr BG. Virtually Perfect? Telemedicine for Covid-19. N Engl J Med. 2020 Apr 30;382(18):1679–1681. doi: 10.1056/NEJMp2003539. PubMed DOI
Ignatowicz A, Atherton H, Bernstein CJ, Bryce C, Court R, Sturt J, Griffiths F. Internet videoconferencing for patient-clinician consultations in long-term conditions: A review of reviews and applications in line with guidelines and recommendations. Digit Health. 2019;5:2055207619845831. doi: 10.1177/2055207619845831. PubMed DOI PMC
Shaw J, Rudzicz F, Jamieson T, Goldfarb A. Artificial Intelligence and the Implementation Challenge. J Med Internet Res. 2019 Jul 10;21(7):e13659. doi: 10.2196/13659. PubMed DOI PMC
Greenhalgh T, Wherton J, Shaw S, Morrison C. Video consultations for covid-19. BMJ. 2020 Mar 12;368:m998. doi: 10.1136/bmj.m998. PubMed DOI
FCNcare A new way to connect with your care team through Alexa. FNCare. [2021-03-21]. https://fcncare.com/
Voice for Healthcare. Amazon Alexa. [2021-03-21]. https://developer.amazon.com/en-US/alexa/alexa-skills-kit/get-deeper/custom-skills/healthcare-skills.
Lau J, Zimmerman B, Schaub F. Alexa, Are You Listening?: Privacy Perceptions, Concerns and Privacy-seeking Behaviors with Smart Speakers. Proc ACM Hum-Comput Interact. 2018 Nov;2:1–31. doi: 10.1145/3274371. DOI
Trebilcock O. Are Alexa and Google Assistant spying on us? Which? 2020. Jan 24, [2021-03-21]. https://www.which.co.uk/news/2020/01/are-alexa-and-google-assistant-spying-on-us/
Edu JS, Such JM, Suarez-Tangil G. Smart Home Personal Assistants. ACM Comput Surv. 2021 Feb;53(6):1–36. doi: 10.1145/3412383. DOI
The Cedars-Sinai Accelarator. Cedars Sinai. [2021-03-21]. https://csaccelerator.com/
Palanica A, Thommandram A, Lee A, Li M, Fossat Y. Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names. NPJ Digit Med. 2019;2:55. doi: 10.1038/s41746-019-0133-x. doi: 10.1038/s41746-019-0133-x. PubMed DOI PMC
Alagha EC, Helbing RR. Evaluating the quality of voice assistants' responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform. 2019 Nov;26(1):e100075. doi: 10.1136/bmjhci-2019-100075. PubMed DOI PMC
Reis A, Paulino D, Paredes H. Using intelligent personal assistants to assist the elderlies An evaluation of Amazon Alexa, Google Assistant, Microsoft Cortana, and Apple Siri. 2018 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing; June 20-22, 2018; Thessaloniki. 2018. DOI
Trajkova M, Martin-Hammond A. "Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo. CHI Conference on Human Factors in Computing Systems; April 2020; Honolulu, HI. 2020. DOI
Kowalska M, Gładyś A, Kalańska-Łukasik B, Gruz-Kwapisz M, Wojakowski W, Jadczyk T. Readiness for Voice Technology in Patients With Cardiovascular Diseases: Cross-Sectional Study. J Med Internet Res. 2020 Dec 17;22(12):e20456. doi: 10.2196/20456. PubMed DOI PMC
Language Support in Voice Assistants Compared. Summa Linguae Technologies. 2021. Apr 21, [2021-03-21]. https://www.globalme.net/blog/language-support-voice-assistants-compared/
Jercich K. Amazon plans to provide health services to workers at other companies, says BI. Healthcare IT News Australia. 2020. Dec 16, [2021-03-21]. https://www.healthcareitnews.com/news/amazon-plans-provide-health-services-workers-other-companies-says-bi.
Amazon HealthLake (Preview): Store, transform, query, and analyze health data in minutes. Amazon Web Services Inc. [2021-03-21]. https://aws.amazon.com/healthlake/
Maor E, Perry D, Mevorach D, Taiblum N, Luz Y, Mazin I, Lerman A, Koren G, Shalev V. Vocal Biomarker Is Associated With Hospitalization and Mortality Among Heart Failure Patients. J Am Heart Assoc. 2020 Apr 07;9(7):e013359. doi: 10.1161/JAHA.119.013359. PubMed DOI PMC
Mekyska J, Galaz Z, Kiska T, Zvoncak V, Mucha J, Smekal Z, Eliasova I, Kostalova M, Mrackova M, Fiedorova D, Faundez-Zanuy M, Solé-Casals J, Gomez-Vilda P, Rektorova I. Quantitative Analysis of Relationship Between Hypokinetic Dysarthria and the Freezing of Gait in Parkinson's Disease. Cognit Comput. 2018;10(6):1006–1018. doi: 10.1007/s12559-018-9575-8. PubMed DOI PMC
Han J, Brown C, Chauhan J, Grammenos A, Hasthanasombat A, Spathis D, Xia T, Cicuta P, Mascolo C. Exploring Automatic COVID-19 Diagnosis via Voice and Symptoms from Crowdsourced Data. 2021 IEEE International Conference on Acoustics, Speech and Signal Processing; June 6-11, 2021; Toronto, ON. 2021. DOI