English
Related papers

Related papers: Large Language Models Encode Clinical Knowledge

200 papers

Large Language Models (LLMs) have demonstrated remarkable performance on various medical question-answering (QA) benchmarks, including standardized medical exams. However, correct answers alone do not ensure correct logic, and models may…

Computation and Language · Computer Science 2025-06-02 Yuexing Hao , Kumail Alhamoud , Hyewon Jeong , Haoran Zhang , Isha Puri , Philip Torr , Mike Schaekermann , Ariel D. Stern , Marzyeh Ghassemi

Large language models (LLMs) are increasingly deployed across healthcare applications, including clinical documentation, diagnostic reasoning, medicine recommendation, and medical education. Their outputs are largely unstructured clinical…

Computers and Society · Computer Science 2026-05-26 Lingyao Li , Deyi Li , Chen Chen , Renkai Ma , Runlong Yu , Mingquan Lin , Rui Yin , Lizhou Fan , Cathy Shyr , Siyuan Ma , Mei Liu , Steven Bethard

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Evaluating natural language generation (NLG) systems in the medical domain presents unique challenges due to the critical demands for accuracy, relevance, and domain-specific expertise. Traditional automatic evaluation metrics, such as…

Computation and Language · Computer Science 2025-09-17 Wen-wai Yim , Asma Ben Abacha , Zixuan Yu , Robert Doerning , Fei Xia , Meliha Yetisgen

The escalating global mental health crisis, marked by persistent treatment gaps, availability, and a shortage of qualified therapists, positions Large Language Models (LLMs) as a promising avenue for scalable support. While LLMs offer…

The evaluation and improvement of medical large language models (LLMs) are critical for their real-world deployment, particularly in ensuring accuracy, safety, and ethical alignment. Existing frameworks inadequately dissect domain-specific…

Computation and Language · Computer Science 2025-03-11 Luyi Jiang , Jiayuan Chen , Lu Lu , Xinwei Peng , Lihao Liu , Junjun He , Jie Xu

Large language models (LLMs) have shown amazing capabilities in knowledge memorization and the present. However, when it comes to domain-specific knowledge and downstream tasks like medical, general LLMs are often unable to give precise…

Computation and Language · Computer Science 2024-06-06 Maojun Sun

The current work investigates the capability of Large language models (LLMs) that are explicitly trained on large corpuses of medical knowledge (Med-PaLM 2) to predict psychiatric functioning from patient interviews and clinical…

Computation and Language · Computer Science 2023-08-04 Isaac R. Galatzer-Levy , Daniel McDuff , Vivek Natarajan , Alan Karthikesalingam , Matteo Malgaroli

The proliferation of Large Language Models (LLMs) in high-stakes applications such as medical (self-)diagnosis and preliminary triage raises significant ethical and practical concerns about the effectiveness, appropriateness, and possible…

Computers and Society · Computer Science 2025-06-18 Bonam Mingole , Aditya Majumdar , Firdaus Ahmed Choudhury , Jennifer L. Kraschnewski , Shyam S. Sundar , Amulya Yadav

Multimodal large language models (MLLMs) have emerged as a promising paradigm for dental image analysis. However, their ability to capture the multi-level cognitive processes required for radiographic analysis remains unclear. Here, we…

Computation and Language · Computer Science 2026-05-11 Rongyang Wang , Shuang Zhou , Jiashuo Wang , Wenya Xie , Xiaoxia Che

We introduce MedXpertQA, a highly challenging and comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning. MedXpertQA includes 4,460 questions spanning 17 specialties and 11 body systems. It includes two…

Artificial Intelligence · Computer Science 2025-06-09 Yuxin Zuo , Shang Qu , Yifei Li , Zhangren Chen , Xuekai Zhu , Ermo Hua , Kaiyan Zhang , Ning Ding , Bowen Zhou

Large language models (LLMs) hold great promise for assisting clinical interviews due to their fluent interactive capabilities and extensive medical knowledge. However, the lack of high-quality interview dialogue data and widely accepted…

Computation and Language · Computer Science 2025-04-15 Jing Chen , Zhihua Wei , Wei Zhang , Yingying Hu , Qiong Zhang

Large language models (LLMs) have made significant progress in various domains, including healthcare. However, the specialized nature of clinical language understanding tasks presents unique challenges and limitations that warrant further…

Computation and Language · Computer Science 2023-08-01 Yuqing Wang , Yun Zhao , Linda Petzold

Although recent advances in scaling large language models (LLMs) have resulted in improvements on many NLP tasks, it remains unclear whether these models trained primarily with general web text are the right tool in highly specialized,…

Large Language Models (LLMs) like GPT-4, MedPaLM-2, and Med-Gemini achieve performance competitively with human experts across various medical benchmarks. However, they still face challenges in making professional diagnoses akin to…

Computation and Language · Computer Science 2024-08-23 Xiaohan Wang , Xiaoyan Yang , Yuqi Zhu , Yue Shen , Jian Wang , Peng Wei , Lei Liang , Jinjie Gu , Huajun Chen , Ningyu Zhang

The integration of Large Language Models (LLMs) into healthcare holds significant potential to enhance diagnostic accuracy and support medical treatment planning. These AI-driven systems can analyze vast datasets, assisting clinicians in…

Computation and Language · Computer Science 2025-04-15 Diogo Sousa , Guilherme Barbosa , Catarina Rocha , Dulce Oliveira

The evaluation of Large Language Models (LLMs) in healthcare has been dominated by physician-centric, English-language benchmarks, creating a dangerous illusion of competence that ignores the interprofessional nature of patient care. To…

Computation and Language · Computer Science 2025-06-30 Andrew Maranhão Ventura D'addario

With the advent of Large Language Models (LLMs), medical artificial intelligence (AI) has experienced substantial technological progress and paradigm shifts, highlighting the potential of LLMs to streamline healthcare delivery and improve…

Computation and Language · Computer Science 2024-12-10 Lei Liu , Xiaoyan Yang , Junchi Lei , Yue Shen , Jian Wang , Peng Wei , Zhixuan Chu , Zhan Qin , Kui Ren

Fine-tuning Large Language Models (LLMs) incurs considerable training costs, driving the need for data-efficient training with optimised data ordering. Human-inspired strategies offer a solution by organising data based on human learning…

Computation and Language · Computer Science 2024-11-06 Yushi Yang , Andrew M. Bean , Robert McCraith , Adam Mahdi

Large language models (LLMs) have demonstrated strong performance on medical benchmarks, including question answering and diagnosis. To enable their use in clinical settings, LLMs are typically further adapted through continued pretraining…