English
Related papers

Related papers: Towards Expert-Level Medical Question Answering wi…

200 papers

This research paper discusses the advances made in the past decade in biomedicine and Large Language Models. To understand how the advances have been made hand-in-hand with one another, the paper also discusses the integration of Natural…

Computation and Language · Computer Science 2024-06-26 Michael Ackerman

In recent years, Large Language Models (LLMs) have demonstrated an impressive ability to encode knowledge during pre-training on large text corpora. They can leverage this knowledge for downstream tasks like question answering (QA), even in…

Computation and Language · Computer Science 2024-06-11 Juraj Vladika , Phillip Schneider , Florian Matthes

Artificial Intelligence (AI) has become essential in modern healthcare, with large language models (LLMs) offering promising advances in clinical decision-making. Traditional model-based approaches, including those leveraging in-context…

This study evaluates the performance of several Large Language Models (LLMs) on MedRedQA, a dataset of consumer-based medical questions and answers by verified experts extracted from the AskDocs subreddit. While LLMs have shown proficiency…

Computation and Language · Computer Science 2025-01-03 Moaiz Abrar , Yusuf Sermet , Ibrahim Demir

Large language models (LLMs) hold promise to serve complex health information needs but also have the potential to introduce harm and exacerbate health disparities. Reliably evaluating equity-related model failures is a critical step toward…

Large language models (LLMs) show promise for clinical use. They are often evaluated using datasets such as MedQA. However, Many medical datasets, such as MedQA, rely on simplified Question-Answering (Q\A) that underrepresents real-world…

Computation and Language · Computer Science 2025-10-24 Yunpeng Xiao , Carl Yang , Mark Mai , Xiao Hu , Kai Shu

Large language models (LLMs) show significant potential in healthcare, prompting numerous benchmarks to evaluate their capabilities. However, concerns persist regarding the reliability of these benchmarks, which often lack clinical…

Computation and Language · Computer Science 2026-04-30 Wenting Chen , Guo Yu , Yiu-Fai Cheung , Meidan Ding , Jie Liu , Zizhan Ma , Wenxuan Wang , Linlin Shen

Large language models (LLMs) have shown remarkable progress in encoding clinical knowledge and responding to complex medical queries with appropriate clinical reasoning. However, their applicability in subspecialist or complex medical…

Large language models (LLMs), such as ChatGPT, have received substantial attention due to their capabilities for understanding and generating human language. While there has been a burgeoning trend in research focusing on the employment of…

Large language models, such as GPT-4 and Med-PaLM, have shown impressive performance on clinical tasks; however, they require access to compute, are closed-source, and cannot be deployed on device. Mid-size models such as BioGPT-large,…

This paper presents the overview of the development and fine-tuning of large language models (LLMs) designed specifically for answering medical questions. We are mainly improving the accuracy and efficiency of providing reliable answers to…

Computation and Language · Computer Science 2025-01-30 Aysegul Ucar , Soumik Nayak , Anunak Roy , Burak Taşcı , Gülay Taşcı

Artificial intelligence has significantly advanced healthcare, particularly through large language models (LLMs) that excel in medical question answering benchmarks. However, their real-world clinical application remains limited due to the…

Computation and Language · Computer Science 2024-07-01 Zhihao Fan , Jialong Tang , Wei Chen , Siyuan Wang , Zhongyu Wei , Jun Xi , Fei Huang , Jingren Zhou

This study presents a comprehensive analysis and comparison of two predominant fine-tuning methodologies - full-parameter fine-tuning and parameter-efficient tuning - within the context of medical Large Language Models (LLMs). We developed…

The recent success of Large Language Models (LLMs) has had a significant impact on the healthcare field, providing patients with medical advice, diagnostic information, and more. However, due to a lack of professional medical knowledge,…

Computation and Language · Computer Science 2024-06-27 Wenya Xie , Qingying Xiao , Yu Zheng , Xidong Wang , Junying Chen , Ke Ji , Anningzhe Gao , Xiang Wan , Feng Jiang , Benyou Wang

While recent advancements in commercial large language models (LM) have shown promising results in medical tasks, their closed-source nature poses significant privacy and security concerns, hindering their widespread use in the medical…

Computation and Language · Computer Science 2024-07-02 Hyunjae Kim , Hyeon Hwang , Jiwoo Lee , Sihyeon Park , Dain Kim , Taewhoo Lee , Chanwoong Yoon , Jiwoong Sohn , Donghee Choi , Jaewoo Kang

The proliferation of Large Language Models (LLMs) in high-stakes applications such as medical (self-)diagnosis and preliminary triage raises significant ethical and practical concerns about the effectiveness, appropriateness, and possible…

Computers and Society · Computer Science 2025-06-18 Bonam Mingole , Aditya Majumdar , Firdaus Ahmed Choudhury , Jennifer L. Kraschnewski , Shyam S. Sundar , Amulya Yadav

In this study, we present MedS-Bench, a comprehensive benchmark designed to evaluate the performance of large language models (LLMs) in clinical contexts. Unlike existing benchmarks that focus on multiple-choice question answering,…

Computation and Language · Computer Science 2024-09-06 Chaoyi Wu , Pengcheng Qiu , Jinxin Liu , Hongfei Gu , Na Li , Ya Zhang , Yanfeng Wang , Weidi Xie

In recent years, pre-trained large language models (LLMs) have achieved tremendous success in the field of Natural Language Processing (NLP). Prior studies have primarily focused on general and generic domains, with relatively less research…

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

Online medical forums have long served as vital platforms where patients seek professional healthcare advice, generating vast amounts of valuable knowledge. However, the informal nature and linguistic complexity of forum interactions pose…

Computation and Language · Computer Science 2025-10-22 Antonio Romano , Giuseppe Riccio , Mariano Barone , Marco Postiglione , Vincenzo Moscato