English
Related papers

Related papers: Medical large language models are easily distracte…

200 papers

This paper investigates the challenges of developing large language models (LLMs) proficient in both multilingual understanding and medical knowledge. We demonstrate that simply translating medical data does not guarantee strong performance…

Computation and Language · Computer Science 2025-01-20 Nada Saadi , Tathagata Raha , Clément Christophe , Marco AF Pimentel , Ronnie Rajan , Praveen K Kanithi

Large language models (LLMs) have recently showcased remarkable capabilities, spanning a wide range of tasks and applications, including those in the medical domain. Models like GPT-4 excel in medical question answering but may face…

Computation and Language · Computer Science 2025-07-02 Bowen Wang , Jiuyang Chang , Yiming Qian , Guoxin Chen , Junhao Chen , Zhouqiang Jiang , Jiahao Zhang , Yuta Nakashima , Hajime Nagahara

We explore the potential of Large Language Models (LLMs) to assist and potentially correct physicians in medical decision-making tasks. We evaluate several LLMs, including Meditron, Llama2, and Mistral, to analyze the ability of these…

Computation and Language · Computer Science 2024-05-07 Burcu Sayin , Pasquale Minervini , Jacopo Staiano , Andrea Passerini

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

Artificial Intelligence · Computer Science 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

This paper is under review in AI and Ethics This study examines whether large language models (LLMs) can reliably answer scientific questions and demonstrates how easily they can be influenced by fringe scientific material. The authors…

Computers and Society · Computer Science 2026-04-29 Harry Collins , Hartmut Grote , Paul Newbury , Patrick Sutton , Simon Thorne

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

Computation and Language · Computer Science 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large language models (LLMs) can produce erroneous responses that sound fluent and convincing, raising the risk that users will rely on these responses as if they were correct. Mitigating such overreliance is a key challenge. Through a…

Human-Computer Interaction · Computer Science 2025-02-13 Sunnie S. Y. Kim , Jennifer Wortman Vaughan , Q. Vera Liao , Tania Lombrozo , Olga Russakovsky

Large language models (LLMs) are increasingly deployed in clinical decision support, yet subtle demographic cues can influence their reasoning. Prior work has documented disparities in outputs across patient groups, but little is known…

Computation and Language · Computer Science 2025-10-16 Rajarshi Ghosh , Abhay Gupta , Hudson McBride , Anurag Vaidya , Faisal Mahmood

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz

The performance of Large Language Models (LLMs) degrades from the temporal drift between data used for model training and newer text seen during inference. One understudied avenue of language change causing data drift is the emergence of…

Computation and Language · Computer Science 2024-08-14 Jonathan Zheng , Alan Ritter , Wei Xu

Large Language Models (LLMs) have demonstrated remarkable capabilities in various educational tasks, yet their alignment with human learning patterns, particularly in predicting which incorrect options students are most likely to select in…

Computation and Language · Computer Science 2025-02-24 Naiming Liu , Shashank Sonkar , Richard G. Baraniuk

The recommendation of medication is a vital aspect of intelligent healthcare systems, as it involves prescribing the most suitable drugs based on a patient's specific health needs. Unfortunately, many sophisticated models currently in use…

Information Retrieval · Computer Science 2025-01-28 Qidong Liu , Xian Wu , Xiangyu Zhao , Yuanshao Zhu , Zijian Zhang , Feng Tian , Yefeng Zheng

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Recent advancements in Large Language Models (LLMs) have demonstrated impressive capabilities across a range of natural language processing tasks, especially in reasoning, a cornerstone for achieving Artificial General Intelligence (AGI).…

Computation and Language · Computer Science 2023-10-09 Wenbei Xie

Large language models (LLM) have achieved impressive performance on medical question-answering benchmarks. However, high benchmark accuracy does not imply that the performance generalizes to real-world clinical settings. Medical…

Computation and Language · Computer Science 2024-09-04 Robert Osazuwa Ness , Katie Matton , Hayden Helm , Sheng Zhang , Junaid Bajwa , Carey E. Priebe , Eric Horvitz

Recent advances in large language models (LLMs) have shown promising results in medical diagnosis, with some studies indicating superior performance compared to human physicians in specific scenarios. However, the diagnostic capabilities of…

Artificial Intelligence · Computer Science 2025-03-24 Zhoujian Sun , Ziyi Liu , Cheng Luo , Jiebin Chu , Zhengxing Huang

The medical ecosystem consists of the training of new clinicians and researchers, the practice of clinical medicine, and areas of adjacent research. There are many aspects of these domains that could benefit from the application of task…

Computers and Society · Computer Science 2025-07-29 Elisha D. O. Roberson

Large Language Models (LLMs) have become valuable assets in mental health, showing promise in both classification tasks and counseling applications. This paper offers a perspective on using LLMs in mental health applications. It discusses…

Computation and Language · Computer Science 2023-12-19 Shaoxiong Ji , Tianlin Zhang , Kailai Yang , Sophia Ananiadou , Erik Cambria

The potential of large language models (LLMs) as decision support tools is increasingly being explored in fields such as business, engineering, and medicine, which often face challenging tasks of decision-making under uncertainty. In this…

Artificial Intelligence · Computer Science 2024-10-14 Ollie Liu , Deqing Fu , Dani Yogatama , Willie Neiswanger

Large Language Models (LLMs) have shown promising results on machine translation for high resource language pairs and domains. However, in specialised domains (e.g. medical) LLMs have shown lower performance compared to standard neural…

Computation and Language · Computer Science 2025-07-31 Miguel Rios