English
Related papers

Related papers: Addressing cognitive bias in medical language mode…

200 papers

Biased AI-generated medical advice and misdiagnoses can jeopardize patient safety, making the integrity of AI in healthcare more critical than ever. As Large Language Models (LLMs) take on a growing role in medical decision-making,…

Computation and Language · Computer Science 2024-10-10 Pardis Sadat Zahraei , Zahra Shakeri

The recent success of large language models (LLMs) has paved the way for their adoption in the high-stakes domain of healthcare. Specifically, the application of LLMs in patient-trial matching, which involves assessing patient eligibility…

Artificial Intelligence · Computer Science 2023-12-18 Mauro Nievas , Aditya Basu , Yanshan Wang , Hrituraj Singh

Large language models (LLMs) have demonstrated impressive performance across various domains. However, for clinical diagnosis, higher expectations are required for LLM's reliability and sensitivity: thinking like physicians and remaining…

Computation and Language · Computer Science 2025-04-21 Chenwei Yan , Xiangling Fu , Yuxuan Xiong , Tianyi Wang , Siu Cheung Hui , Ji Wu , Xien Liu

Although large language models (LLMs) often produce impressive outputs, it remains unclear how they perform in real-world scenarios requiring strong reasoning skills and expert domain knowledge. We set out to investigate whether close- and…

Computation and Language · Computer Science 2023-12-27 Valentin Liévin , Christoffer Egeberg Hother , Andreas Geert Motzfeldt , Ole Winther

As Large Language Models (LLMs) are increasingly embedded in real-world decision-making processes, it becomes crucial to examine the extent to which they exhibit cognitive biases. Extensively studied in the field of psychology, cognitive…

Computation and Language · Computer Science 2025-09-30 R. Alexander Knipper , Charles S. Knipper , Kaiqi Zhang , Valerie Sims , Clint Bowers , Santu Karmaker

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz

The widespread adoption of Large Language Models (LLMs) in software development is transforming programming from a solution-generative to a solution-evaluative activity. This shift opens a pathway for new cognitive challenges that amplify…

Software Engineering · Computer Science 2026-01-14 Xinyi Zhou , Zeinadsadat Saghi , Sadra Sabouri , Rahul Pandita , Mollie McGuire , Souti Chattopadhyay

Lab results are often confusing and hard to understand. Large language models (LLMs) such as ChatGPT have opened a promising avenue for patients to get their questions answered. We aim to assess the feasibility of using LLMs to generate…

Computation and Language · Computer Science 2024-04-23 Zhe He , Balu Bhasuran , Qiao Jin , Shubo Tian , Karim Hanna , Cindy Shavor , Lisbeth Garcia Arguello , Patrick Murray , Zhiyong Lu

Large Language Models (LLMs) are increasingly used in decision-making, yet their susceptibility to cognitive biases remains a pressing challenge. This study explores how personality traits influence these biases and evaluates the…

Artificial Intelligence · Computer Science 2025-02-21 Jiangen He , Jiqun Liu

Clinical problem-solving requires processing of semantic medical knowledge such as illness scripts and numerical medical knowledge of diagnostic tests for evidence-based decision-making. As large language models (LLMs) show promising…

Large language models (LLMs) are increasingly used for medical consultation and health information support. In this high-stakes setting, safety depends not only on medical knowledge, but also on how models respond when patient inputs are…

Computation and Language · Computer Science 2026-04-01 Yahan Li , Xinyi Jie , Wanjia Ruan , Xubei Zhang , Huaijie Zhu , Yicheng Gao , Chaohao Du , Ruishan Liu

LLMs have demonstrated impressive performance in answering medical questions, such as achieving passing scores on medical licensing examinations. However, medical board exams or general clinical questions do not capture the complexity of…

Computation and Language · Computer Science 2026-02-19 Hanjie Chen , Zhouxiang Fang , Yash Singla , Mark Dredze

Large language models (LLMs) have recently emerged as powerful tools, finding many medical applications. LLMs' ability to coalesce vast amounts of information from many sources to generate a response-a process similar to that of a human…

Large language models (LLMs) are increasingly embedded in healthcare workflows for documentation, education, and clinical decision support. However, these systems are trained on large text corpora that encode existing biases, including sex…

Computation and Language · Computer Science 2026-02-05 Isabel Tsintsiper , Sheng Wong , Beth Albert , Shaun P Brennecke , Gabriel Davis Jones

Despite growing interest in using large language models (LLMs) in healthcare, current explorations do not assess the real-world utility and safety of LLMs in clinical settings. Our objective was to determine whether two LLMs can serve…

Although large language models (LLMs) have been assessed for general medical knowledge using licensing exams, their ability to support clinical decision-making, such as selecting medical calculators, remains uncertain. We assessed nine…

Computation and Language · Computer Science 2025-03-25 Nicholas Wan , Qiao Jin , Joey Chan , Guangzhi Xiong , Serina Applebaum , Aidan Gilson , Reid McMurry , R. Andrew Taylor , Aidong Zhang , Qingyu Chen , Zhiyong Lu

Large Language Models (LLMs) are trained on large corpora written by humans and demonstrate high performance on various tasks. However, as humans are susceptible to cognitive biases, which can result in irrational judgments, LLMs can also…

Computation and Language · Computer Science 2024-12-03 Yasuaki Sumita , Koh Takeuchi , Hisashi Kashima

This study assesses the ability of state-of-the-art large language models (LLMs) including GPT-3.5, GPT-4, Falcon, and LLaMA 2 to identify patients with mild cognitive impairment (MCI) from discharge summaries and examines instances where…

IMPORTANCE The response effectiveness of different large language models (LLMs) and various individuals, including medical students, graduate students, and practicing physicians, in pediatric ophthalmology consultations, has not been…

Computation and Language · Computer Science 2023-11-09 Jason Holmes , Rui Peng , Yiwei Li , Jinyu Hu , Zhengliang Liu , Zihao Wu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

Large Language Models (LLMs) have shown promise in various domains, including healthcare, with significant potential to transform mental health applications by enabling scalable and accessible solutions. This study aims to provide a…

Artificial Intelligence · Computer Science 2025-11-25 Abdelrahman Hanafi , Mohammed Saad , Noureldin Zahran , Radwa J. Hanafy , Mohammed E. Fouda