Chatbots powered by artificial intelligence used in patient care are regulated as medical devices, but their unreliability precludes approval as such.
This is a preview of subscription content, access via your institution
Relevant articles
Open Access articles citing this article.
-
Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology
Nature Cancer Open Access 06 June 2025
-
Evaluation of a large language model to simplify discharge summaries and provide cardiological lifestyle recommendations
Communications Medicine Open Access 29 May 2025
-
An automated framework for assessing how well LLMs cite relevant medical references
Nature Communications Open Access 16 April 2025
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
27,99 € / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
209,00 € per year
only 17,42 € per issue
Buy this article
- Purchase on SpringerLink
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
References
Singhal, K. et al. Preprint at https://doi.org/10.48550/arXiv.2212.13138 (2022).
Roose, K. New York Times https://go.nature.com/3X7xXku (5 December 2022).
Lee, P. et al. N. Engl. J. Med. 388, 1233–1239 (2023).
Korngiebel, D. M. et al. NPJ Digit. Med. 4, 93 (2021).
Wolfram, S. Stephen Wolfram Writings https://go.nature.com/3qP9hBi (14 February 2023).
Stokel-Walker, C. et al. Nature 614, 214–216 (2023).
Riel, N. V. et al. BJGP Open 1, bjgpopen17X100833 (2017).
Dorfman, S. PM360 https://go.nature.com/3Jfzbo0 (2019).
European Union. Regulation (EU) 2017/745 of the European Parliament and of the Council (5 April 2017).
US FDA. https://go.nature.com/3NwlVOc (2022).
Stokel-Walker, C. Nature https://doi.org/10.1038/d41586-023-00423-4 (2023).
Dawes, R. AINews https://go.nature.com/3p9HRoY (28 October 2020).
Ingram, D. NBC News https://go.nature.com/43ZEGip (14 January 2023).
Yang, X. et al. NPJ Digit. Med. 5, 194 (2022).
Acknowledgements
This work was supported by the German Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF) through the European Union-financed NextGenerationEU program under grant number 16KISA100K, project PATH (Personal Mastery of Health and Wellness Data).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
S.G. has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd, Flo Health Ltd, Thymia Ltd and Ada Health GmbH; and holds share options in Ada Health GmbH. E.V. is a partner of Axon Lawyers. H.H. is owner and managing director of Hardian Ltd. T.M. is an unpaid advisory board member of Pumpinheart Ltd; was previously a senior medical officer in medical devices at the Health Products Regulatory Authority, Ireland; and was previously co-chair of the Clinical Investigation and Evaluation Working Group of the European Commission. P.W. is employed by Wicks Digital Health Ltd, which has received funding from Ada Health, AstraZeneca, Biogen, Bold Health, Camoni, Compass Pathways, Corevitas, EIT, Endava, Happify, HealthUnlocked, Inbeeo, Kheiron Medical, Lindus Health, MedRhythms, PatientsLikeMe, Sano Genetics, Self Care Catalysts, The Learning Corp, The Wellcome Trust, THREAD Research, United Genomics, VeraSci and Woebot. P.W. and spouse are shareholders of WDH Investments Ltd, which owns stock in BlueSkeye AI Ltd, Earswitch Ltd, Sano Genetics Ltd and Una Health GmbH.
Rights and permissions
About this article
Cite this article
Gilbert, S., Harvey, H., Melvin, T. et al. Large language model AI chatbots require approval as medical devices. Nat Med 29, 2396–2398 (2023). https://doi.org/10.1038/s41591-023-02412-6
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41591-023-02412-6
This article is cited by
-
An active inference strategy for prompting reliable responses from large language models in medical practice
npj Digital Medicine (2025)
-
Development and validation of an autonomous artificial intelligence agent for clinical decision-making in oncology
Nature Cancer (2025)
-
Could transparent model cards with layered accessible information drive trust and safety in health AI?
npj Digital Medicine (2025)
-
Large Language Models lack essential metacognition for reliable medical reasoning
Nature Communications (2025)
-
An automated framework for assessing how well LLMs cite relevant medical references
Nature Communications (2025)