• This record comes from PubMed

Artificial Intelligence Can Improve Patient Management at the Time of a Pandemic: The Role of Voice Technology

. 2021 May 25 ; 23 (5) : e22959. [epub] 20210525

Language English Country Canada Media electronic

Document type Journal Article

Links

PubMed 33999834
PubMed Central PMC8153030
DOI 10.2196/22959
PII: v23i5e22959
Knihovny.cz E-resources

Artificial intelligence-driven voice technology deployed on mobile phones and smart speakers has the potential to improve patient management and organizational workflow. Voice chatbots have been already implemented in health care-leveraging innovative telehealth solutions during the COVID-19 pandemic. They allow for automatic acute care triaging and chronic disease management, including remote monitoring, preventive care, patient intake, and referral assistance. This paper focuses on the current clinical needs and applications of artificial intelligence-driven voice chatbots to drive operational effectiveness and improve patient experience and outcomes.

See more in PubMed

Hoy MB. Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants. Med Ref Serv Q. 2018;37(1):81–88. doi: 10.1080/02763869.2018.1404391. PubMed DOI

Lai L, Wittbold KA, Dadabhoy FZ, Sato R, Landman AB, Schwamm LH, He S, Patel R, Wei N, Zuccotti G, Lennes IT, Medina D, Sequist TD, Bomba G, Keschner YG, Zhang H. Digital triage: Novel strategies for population health management in response to the COVID-19 pandemic. Healthc (Amst) 2020 Dec;8(4):100493. doi: 10.1016/j.hjdsi.2020.100493. PubMed DOI PMC

Sezgin E, Noritz G, Elek A, Conkol K, Rust S, Bailey M, Strouse R, Chandawarkar A, von Sadovszky V, Lin S, Huang Y. Capturing At-Home Health and Care Information for Children With Medical Complexity Using Voice Interactive Technologies: Multi-Stakeholder Viewpoint. J Med Internet Res. 2020 Feb 13;22(2):e14202. doi: 10.2196/14202. PubMed DOI PMC

Furst J. Mayo Clinic introduces skill for Amazon’s Alexa about COVID-19. Mayo Clinic. 2020. Apr 27, [2020-03-21]. https://newsnetwork.mayoclinic.org/discussion/mayo-clinic-introduces-skill-for-amazons-alexa-about-covid-19/

Beaman J. Interactive Voice-Based Administration of the PHQ-9. ClinicalTrials.gov. 2020. [2021-05-17]. https://clinicaltrials.gov/ct2/show/NCT04609267.

Palanica A, Thommandram A, Lee A, Li M, Fossat Y. Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names. NPJ Digit Med. 2019;2:55. doi: 10.1038/s41746-019-0133-x. doi: 10.1038/s41746-019-0133-x. PubMed DOI PMC

Jadczyk T, Kiwic O, Khandwalla RM, Grabowski K, Rudawski S, Magaczewski P, Benyahia H, Wojakowski W, Henry TD. Feasibility of a voice-enabled automated platform for medical data collection: CardioCube. Int J Med Inform. 2019 Sep;129:388–393. doi: 10.1016/j.ijmedinf.2019.07.001. PubMed DOI

Miner AS, Milstein A, Schueller S, Hegde R, Mangurian C, Linos E. Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health. JAMA Intern Med. 2016 May 01;176(5):619–625. doi: 10.1001/jamainternmed.2016.0400. PubMed DOI PMC

Nobles AL, Leas EC, Caputi TL, Zhu S, Strathdee SA, Ayers JW. Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digit Med. 2020;3:11. doi: 10.1038/s41746-019-0215-9. doi: 10.1038/s41746-019-0215-9. PubMed DOI PMC

Kocaballi AB, Quiroz JC, Rezazadegan D, Berkovsky S, Magrabi F, Coiera E, Laranjo L. Responses of Conversational Agents to Health and Lifestyle Prompts: Investigation of Appropriateness and Presentation Structures. J Med Internet Res. 2020 Feb 09;22(2):e15823. doi: 10.2196/15823. PubMed DOI PMC

Alagha EC, Helbing RR. Evaluating the quality of voice assistants' responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform. 2019 Nov;26(1):e100075. doi: 10.1136/bmjhci-2019-100075. PubMed DOI PMC

Koulaouzidis G, Charisopoulou D, Wojakowski W, Koulaouzidis A, Marlicz W, Jadczyk T. Telemedicine in cardiology in the time of coronavirus disease 2019: a friend that everybody needs. Pol Arch Intern Med. 2020 Jun 25;130(6):559–561. doi: 10.20452/pamw.15432. PubMed DOI

Medical Device Data Systems. US Food and Drug Administration. 2019. Sep 26, [2021-03-21]. https://www.fda.gov/medical-devices/general-hospital-devices-and-supplies/medical-device-data-systems.

Medical Device Data Systems, Medical Image Storage Devices, and Medical Image Communications Devices. US Food and Drug Administration. 2019. [2021-03-21]. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/medical-device-data-systems-medical-image-storage-devices-and-medical-image-communications-devices.

Software as a Medical Device (SaMD) US Food and Drug Adminisration. 2018. Apr 12, [2021-03-21]. https://www.fda.gov/medical-devices/digital-health-center-excellence/software-medical-device-samd.

WebMD. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B01MRM361G.

Cleveland Clinic Tip of the Day. Amazon. [2021-03-21]. https://www.amazon.com/Cleveland-Clinic-Tip-Day/dp/B077BFFQSZ.

KidsMD. Amazon. [2021-03-21]. https://www.amazon.com/Boston-Childrens-Hospital-KidsMD/dp/B01E3F0AUC.

Mayo Clinic First Aid. Amazon. [2021-03-21]. https://www.amazon.com/mayo-clinic-first-aid/dp/b0744ljcv2.

First Aid. Amazon. [2021-03-21]. https://www.amazon.com/American-Red-Cross-First-Aid/dp/B07KMSZQ5F.

Mayo Clinic News Network. Amazon. [2021-03-21]. https://www.amazon.com/mayo-clinic-news-network/dp/b0711hkbb6.

MyChildren's Enhanced Recovery After Surgery. Amazon. [2021-03-21]. https://www.amazon.com/MyChildrens-Enhanced-Recovery-After-Surgery/dp/B07QB7PQYW/

OhioHealth: Alexa skills. Amazon. [2021-03-21]. https://www.amazon.com/OhioHealth/dp/B077SNT8L6.

New Hanover Regional Medical Center. Amazon. [2021-03-21]. https://www.amazon.com/New-Hanover-Regional-Medical-Center/dp/B07BS5TGSQ.

Livongo Blood Sugar Lookup. Amazon. [2021-03-21]. https://www.amazon.com/Livongo-Health-Blood-Sugar-Lookup/dp/B07QHF76RN.

Giant Eagle Pharmacy. Amazon. [2021-03-21]. https://www.amazon.com/Omnicell-Inc-Giant-Eagle-Pharmacy/dp/B08164DYJ7.

Express Scripts. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07QB7P6Y2.

Swedish Health Connect: Alexa skills. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07PGJYYF6.

Atrium Health. Amazon. [2021-03-21]. https://www.amazon.com/gp/product/B07H1T46DC,

OrbitaASSIST: Virtual Bedside Assistant. Orbita. [2021-03-21]. https://orbita.ai/orbita-assist-virtual-bedside-assistant/

Answers by Cigna. Amazon. [2021-03-21]. https://www.amazon.com/Cigna-Answers-by/dp/B079SMKCZB.

OrbitaCONNECT. Orbita. [2021-03-21]. https://orbita.ai/orbita-connect-virtual-health-assistant-care-continuity/,

Talkspace: Online therapy for all. Amazon. [2021-03-21]. https://www.amazon.com/Talkspace-Online-therapy-for-all/dp/B085VHRW33.

Personalized Voice Activated Wellness Assistants for Patients With Heart Failure. ClinicalTrials.gov. [2021-03-21]. https://www.clinicaltrials.gov/ct2/show/NCT03707275.

Haase CB, Bearman M, Brodersen J, Hoeyer K, Risor T. 'You should see a doctor', said the robot: Reflections on a digital diagnostic device in a pandemic age. Scand J Public Health. 2021 Feb 18;49(1):33–36. doi: 10.1177/1403494820980268. PubMed DOI PMC

Iansiti M, Lakhani K. Competing in the Age of AI. Harvard Business Review. 2020. Jan 16, [2021-05-17]. https://hbr.org/webinar/2020/01/competing-in-the-age-of-ai#:~:text=and%20deliver%20value.-,In%20their%20new%20book%20Competing%20in%20the%20Age%20of%20AI,scale%2C%20scope%2C%20and%20learning.

Kucharski AJ, Russell TW, Diamond C, Liu Y, Edmunds J, Funk S, Eggo RM, Centre for Mathematical Modelling of Infectious Diseases COVID-19 working group Early dynamics of transmission and control of COVID-19: a mathematical modelling study. Lancet Infect Dis. 2020 May;20(5):553–558. doi: 10.1016/S1473-3099(20)30144-4. PubMed DOI PMC

Schwirtz M. Nurses die, doctors fall sick and panic rises on virus front lines. The New York Times. [2021-03-21]. https://www.nytimes.com/2020/03/30/nyregion/ny-coronavirus-doctors-sick.html.

Rose C. Am I Part of the Cure or Am I Part of the Disease? Keeping Coronavirus Out When a Doctor Comes Home. N Engl J Med. 2020 Apr 30;382(18):1684–1685. doi: 10.1056/NEJMp2004768. PubMed DOI

Wu JT, Leung K, Bushman M, Kishore N, Niehus R, de Salazar PM, Cowling BJ, Lipsitch M, Leung GM. Estimating clinical severity of COVID-19 from the transmission dynamics in Wuhan, China. Nat Med. 2020 Apr;26(4):506–510. doi: 10.1038/s41591-020-0822-7. PubMed DOI PMC

Worldometer. [2021-03-21]. https://www.worldometers.info/coronavirus/

Solomon MD, McNulty EJ, Rana JS, Leong TK, Lee C, Sung S, Ambrosy AP, Sidney S, Go AS. The Covid-19 Pandemic and the Incidence of Acute Myocardial Infarction. N Engl J Med. 2020 Aug 13;383(7):691–693. doi: 10.1056/NEJMc2015630. PubMed DOI

Krouse HJ. COVID-19 and the Widening Gap in Health Inequity. Otolaryngol Head Neck Surg. 2020 Jul;163(1):65–66. doi: 10.1177/0194599820926463. PubMed DOI

Lacina L. COVID-19 reveals gaps in health systems: WHO Briefing. World Economic Forum. 2020. May 06, [2021-03-21]. https://www.weforum.org/agenda/2020/05/covid-19-reveals-gaps-in-public-health-system-who-briefing/

Judson T, Odisho A, Young J, Bigazzi O, Steuer D, Gonzales R, Neinstein AB. Implementation of a digital chatbot to screen health system employees during the COVID-19 pandemic. J Am Med Inform Assoc. 2020 Jul 01;27(9):1450–1455. doi: 10.1093/jamia/ocaa130. PubMed DOI PMC

Webster P. Virtual health care in the era of COVID-19. Lancet. 2020 Apr 11;395(10231):1180–1181. doi: 10.1016/S0140-6736(20)30818-7. PubMed DOI PMC

Greenhalgh T, Koh GCH, Car J. Covid-19: a remote assessment in primary care. BMJ. 2020 Mar 25;368:m1182. doi: 10.1136/bmj.m1182. PubMed DOI

Cosentino D. Ten steps to building a successful telehealth program. Caring. 2009 Jul;28(7):34–39. PubMed

Schulman KA, Richman BD. Toward an Effective Innovation Agenda. N Engl J Med. 2019 Mar 07;380(10):900–901. doi: 10.1056/NEJMp1812460. PubMed DOI

Keesara S, Jonas A, Schulman K. Covid-19 and Health Care's Digital Revolution. N Engl J Med. 2020 Jun 04;382(23):e82. doi: 10.1056/NEJMp2005835. PubMed DOI

Palanica A, Flaschner P, Thommandram A, Li M, Fossat Y. Physicians' Perceptions of Chatbots in Health Care: Cross-Sectional Web-Based Survey. J Med Internet Res. 2019 Apr 05;21(4):e12887. doi: 10.2196/12887. PubMed DOI PMC

Schwamm LH, Erskine A, Licurse A. A digital embrace to blunt the curve of COVID19 pandemic. NPJ Digit Med. 2020;3:64. doi: 10.1038/s41746-020-0279-6. doi: 10.1038/s41746-020-0279-6. PubMed DOI PMC

Roth M. How OSF'S 6 Digital Approaches Handle More Than 50,000 COVID Encounters. HealthLeaders. 2020. Apr 28, [2021-03-21]. https://www.healthleadersmedia.com/innovation/how-osfs-6-digital-approaches-handle-more-50000-covid-encounters.

The VOICE-COVID-19. ClinicalTrials.gov. [2021-03-21]. https://www.clinicaltrials.gov/ct2/show/NCT04508972.

Sherr I. Apple, Google, Amazon block nonofficial coronavirus apps from app stores. CNET. 2020. Mar 15, [2021-03-21]. https://www.cnet.com/news/apple-google-amazon-block-nonofficial-coronavirus-apps-from-app-stores/

Employee Health Manager. Orbita. [2021-03-21]. https://orbita.ai/orbita-employee-health-manager/

Ross C. I asked eight chatbots whether I had Covid-19. The answers ranged from ‘low’ risk to ‘start home isolation’. STAT. 2020. Mar 23, [2021-03-21]. https://www.statnews.com/2020/03/23/coronavirus-i-asked-eight-chatbots-whether-i-had-covid-19/

Cohen AB, Mathews SC, Dorsey ER, Bates DW, Safavi K. Direct-to-consumer digital health. Lancet Digit Health. 2020 Apr;2(4):e163–e165. doi: 10.1016/S2589-7500(20)30057-1. PubMed DOI

Virtual healthcare at an affordable rate. CardioCube. [2021-03-21]. https://cardiocube.com/

Gao C. Use New Alexa Emotions and Speaking Styles to Create a More Natural and Intuitive Voice Experience. Amazon Alexa. 2019. [2021-03-21]. https://developer.amazon.com/en-US/blogs/alexa/alexa-skills-kit/2019/11/new-alexa-emotions-and-speaking-styles.

Gao C. Create Engaging Voice Experiences with a New Alexa Speaking Style, Speaking Styles in Amazon Polly Voices and Additional Polly Voices. Amazon Alexa. 2020. [2021-03-21]. https://developer.amazon.com/en-US/blogs/alexa/alexa-skills-kit/2020/04/new-alexa-long-form-speaking-style-and-polly-voices?tag=theverge02-20.

Portet F, Vacher M, Golanski C, Roux C, Meillon B. Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Pers Ubiquit Comput. 2011 Oct 2;17(1):127–144. doi: 10.1007/s00779-011-0470-5. DOI

Cheng A, Raghavaraju V, Kanugo J, Handrianto Y, Shang Y. Development and evaluation of a healthy coping voice interface application using the Google home for elderly patients with type 2 diabetes. 2018 15th IEEE Annual Consumer Communications & Networking Conference; January 12-15, 2018; Las Vegas, NV. 2018. pp. 12–15. DOI

Slavík P, Němec V, Sporka AJ. Speech Based User Interface for Users with Special Needs. 8th International Conference on Text, Speech and Dialogue; September 12-15, 2005; Karlovy Vary. 2005. DOI

Fisher T, Metcalf D, Pruthi S, Pappas H. Voice Technology in Healthcare: Leveraging Voice to Enhance Patient and Provider Experiences. New York, NY: Productivity Press; 2020. The Opportunity for Voice in Healthcare.

Kumah-Crystal Y, Pirtle C, Whyte H, Goode E, Anders S, Lehmann C. Electronic Health Record Interactions through Voice: A Review. Appl Clin Inform. 2018 Jul;9(3):541–552. doi: 10.1055/s-0038-1666844. PubMed DOI PMC

The Smart Audio Report. National Public Media. 2020. [2021-03-21]. https://www.nationalpublicmedia.com/insights/reports/smart-audio-report/,

Number of digital voice assistants in use worldwide from 2019 to 2024 (in billions)*. Statista. [2021-03-21]. https://www.statista.com/statistics/973815/worldwide-digital-voice-assistant-in-use/#statisticContainer,

Hollander JE, Carr BG. Virtually Perfect? Telemedicine for Covid-19. N Engl J Med. 2020 Apr 30;382(18):1679–1681. doi: 10.1056/NEJMp2003539. PubMed DOI

Ignatowicz A, Atherton H, Bernstein CJ, Bryce C, Court R, Sturt J, Griffiths F. Internet videoconferencing for patient-clinician consultations in long-term conditions: A review of reviews and applications in line with guidelines and recommendations. Digit Health. 2019;5:2055207619845831. doi: 10.1177/2055207619845831. PubMed DOI PMC

Shaw J, Rudzicz F, Jamieson T, Goldfarb A. Artificial Intelligence and the Implementation Challenge. J Med Internet Res. 2019 Jul 10;21(7):e13659. doi: 10.2196/13659. PubMed DOI PMC

Greenhalgh T, Wherton J, Shaw S, Morrison C. Video consultations for covid-19. BMJ. 2020 Mar 12;368:m998. doi: 10.1136/bmj.m998. PubMed DOI

FCNcare A new way to connect with your care team through Alexa. FNCare. [2021-03-21]. https://fcncare.com/

Voice for Healthcare. Amazon Alexa. [2021-03-21]. https://developer.amazon.com/en-US/alexa/alexa-skills-kit/get-deeper/custom-skills/healthcare-skills.

Lau J, Zimmerman B, Schaub F. Alexa, Are You Listening?: Privacy Perceptions, Concerns and Privacy-seeking Behaviors with Smart Speakers. Proc ACM Hum-Comput Interact. 2018 Nov;2:1–31. doi: 10.1145/3274371. DOI

Trebilcock O. Are Alexa and Google Assistant spying on us? Which? 2020. Jan 24, [2021-03-21]. https://www.which.co.uk/news/2020/01/are-alexa-and-google-assistant-spying-on-us/

Edu JS, Such JM, Suarez-Tangil G. Smart Home Personal Assistants. ACM Comput Surv. 2021 Feb;53(6):1–36. doi: 10.1145/3412383. DOI

The Cedars-Sinai Accelarator. Cedars Sinai. [2021-03-21]. https://csaccelerator.com/

Palanica A, Thommandram A, Lee A, Li M, Fossat Y. Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names. NPJ Digit Med. 2019;2:55. doi: 10.1038/s41746-019-0133-x. doi: 10.1038/s41746-019-0133-x. PubMed DOI PMC

Alagha EC, Helbing RR. Evaluating the quality of voice assistants' responses to consumer health questions about vaccines: an exploratory comparison of Alexa, Google Assistant and Siri. BMJ Health Care Inform. 2019 Nov;26(1):e100075. doi: 10.1136/bmjhci-2019-100075. PubMed DOI PMC

Reis A, Paulino D, Paredes H. Using intelligent personal assistants to assist the elderlies An evaluation of Amazon Alexa, Google Assistant, Microsoft Cortana, and Apple Siri. 2018 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing; June 20-22, 2018; Thessaloniki. 2018. DOI

Trajkova M, Martin-Hammond A. "Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo. CHI Conference on Human Factors in Computing Systems; April 2020; Honolulu, HI. 2020. DOI

Kowalska M, Gładyś A, Kalańska-Łukasik B, Gruz-Kwapisz M, Wojakowski W, Jadczyk T. Readiness for Voice Technology in Patients With Cardiovascular Diseases: Cross-Sectional Study. J Med Internet Res. 2020 Dec 17;22(12):e20456. doi: 10.2196/20456. PubMed DOI PMC

Language Support in Voice Assistants Compared. Summa Linguae Technologies. 2021. Apr 21, [2021-03-21]. https://www.globalme.net/blog/language-support-voice-assistants-compared/

Jercich K. Amazon plans to provide health services to workers at other companies, says BI. Healthcare IT News Australia. 2020. Dec 16, [2021-03-21]. https://www.healthcareitnews.com/news/amazon-plans-provide-health-services-workers-other-companies-says-bi.

Amazon HealthLake (Preview): Store, transform, query, and analyze health data in minutes. Amazon Web Services Inc. [2021-03-21]. https://aws.amazon.com/healthlake/

Maor E, Perry D, Mevorach D, Taiblum N, Luz Y, Mazin I, Lerman A, Koren G, Shalev V. Vocal Biomarker Is Associated With Hospitalization and Mortality Among Heart Failure Patients. J Am Heart Assoc. 2020 Apr 07;9(7):e013359. doi: 10.1161/JAHA.119.013359. PubMed DOI PMC

Mekyska J, Galaz Z, Kiska T, Zvoncak V, Mucha J, Smekal Z, Eliasova I, Kostalova M, Mrackova M, Fiedorova D, Faundez-Zanuy M, Solé-Casals J, Gomez-Vilda P, Rektorova I. Quantitative Analysis of Relationship Between Hypokinetic Dysarthria and the Freezing of Gait in Parkinson's Disease. Cognit Comput. 2018;10(6):1006–1018. doi: 10.1007/s12559-018-9575-8. PubMed DOI PMC

Han J, Brown C, Chauhan J, Grammenos A, Hasthanasombat A, Spathis D, Xia T, Cicuta P, Mascolo C. Exploring Automatic COVID-19 Diagnosis via Voice and Symptoms from Crowdsourced Data. 2021 IEEE International Conference on Acoustics, Speech and Signal Processing; June 6-11, 2021; Toronto, ON. 2021. DOI

Find record

Citation metrics

Loading data ...

Archiving options

Loading data ...