English
Related papers

Related papers: ClinDEF: A Dynamic Evaluation Framework for Large …

200 papers

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and…

Computation and Language · Computer Science 2023-09-11 Jiatong Li , Rui Li , Qi Liu

Large Language Models (LLMs) have made significant progress in various fields. However, challenges remain in Multi-Disciplinary Team (MDT) medical consultations. Current research enhances reasoning through role assignment, task…

Artificial Intelligence · Computer Science 2025-03-19 Kai Chen , Xinfeng Li , Tianpei Yang , Hewei Wang , Wei Dong , Yang Gao

The emergence of advanced reasoning capabilities in Large Language Models (LLMs) marks a transformative development in healthcare applications. Beyond merely expanding functional capabilities, these reasoning mechanisms enhance decision…

Artificial Intelligence · Computer Science 2025-08-27 Armin Berger , Sarthak Khanna , David Berghaus , Rafet Sifa

The increasing complexity of clinical decision-making, alongside the rapid expansion of electronic health records (EHR), presents both opportunities and challenges for delivering data-informed care. This paper proposes a clinical decision…

Artificial Intelligence · Computer Science 2025-10-03 Leon Garza , Anantaa Kotal , Michael A. Grasso , Emre Umucu

Large language models (LLMs) have shown considerable potential in supporting medical diagnosis. However, their effective integration into clinical workflows is hindered by physicians' difficulties in perceiving and trusting LLM…

Human-Computer Interaction · Computer Science 2026-01-28 Yuansong Xu , Yichao Zhu , Haokai Wang , Yuchen Wu , Yang Ouyang , Hanlu Li , Wenzhe Zhou , Xinyu Liu , Chang Jiang , Quan Li

Large language models (LLMs) hold transformative potential for medical decision support yet their application in psychiatry remains constrained by hallucinations and superficial reasoning. This limitation is particularly acute in…

Large language models (LLMs) are advancing rapidly in medical NLP, yet Traditional Chinese Medicine (TCM) with its distinctive ontology, terminology, and reasoning patterns requires domain-faithful evaluation. Existing TCM benchmarks are…

Therapeutic dialogue is not a sequence of isolated responses: client goals, motivation, resistance, and therapeutic alliance evolve over time. Yet current LLM-based mental health dialogue systems often lack explicit mechanisms for tracking…

The rise of Large Language Models (LLMs) has enabled the development of specialized AI agents with domain-specific reasoning and interaction capabilities, particularly in healthcare. While recent frameworks simulate medical decision-making,…

Artificial Intelligence · Computer Science 2025-07-04 Tianqi Shang , Weiqing He , Charles Zheng , Lingyao Li , Li Shen , Bingxin Zhao

With their growing capabilities, generative large language models (LLMs) are being increasingly investigated for complex medical tasks. However, their effectiveness in real-world clinical applications remains underexplored. To address this,…

Computation and Language · Computer Science 2026-01-27 Paul Grundmann , Dennis Fast , Jan Frick , Thomas Steffek , Felix Gers , Wolfgang Nejdl , Alexander Löser

Clinical diagnosis is critical in medical practice, typically requiring a continuous and evolving process that includes primary diagnosis, differential diagnosis, and final diagnosis. However, most existing clinical diagnostic tasks are…

Artificial Intelligence · Computer Science 2024-12-17 Ruihui Hou , Shencheng Chen , Yongqi Fan , Guangya Yu , Lifeng Zhu , Jing Sun , Jingping Liu , Tong Ruan

Background: Cognitive biases in clinical decision-making significantly contribute to errors in diagnosis and suboptimal patient outcomes. Addressing these biases presents a formidable challenge in the medical field. Objective: This study…

Computation and Language · Computer Science 2024-05-14 Yu He Ke , Rui Yang , Sui An Lie , Taylor Xin Yi Lim , Hairil Rizal Abdullah , Daniel Shu Wei Ting , Nan Liu

Recent progress in multimodal large language models (MLLMs) has demonstrated promising performance on medical benchmarks and in preliminary trials as clinical assistants. Yet, our pilot audit of diagnostic cases uncovers a critical failure…

Artificial Intelligence · Computer Science 2025-09-30 Hongjun Liu , Yinghao Zhu , Yuhui Wang , Yitao Long , Zeyu Lai , Lequan Yu , Chen Zhao

Existing benchmarks for evaluating the clinical reasoning capabilities of large language models (LLMs) often lack a clear definition of "clinical reasoning" as a construct, fail to capture the full breadth of interdependent tasks within a…

The emergence of large language models (LLMs) has significantly influenced numerous fields, including healthcare, by enhancing the capabilities of automated systems to process and generate human-like text. However, despite their…

Information Retrieval · Computer Science 2025-04-23 Mohit Gupta , Akiko Aizawa , Rajiv Ratn Shah

Large language models (LLMs) are increasingly used for diagnostic tasks in medicine. In clinical practice, the correct diagnosis can rarely be immediately inferred from the initial patient presentation alone. Rather, reaching a diagnosis…

Artificial Intelligence · Computer Science 2026-02-20 Hui Min Wong , Philip Heesen , Pascal Janetzky , Martin Bendszus , Stefan Feuerriegel

The application of large language models (LLMs) in clinical decision support faces significant challenges of "tunnel vision" and diagnostic hallucinations present in their processing unstructured electronic health records (EHRs). To address…

Artificial Intelligence · Computer Science 2026-04-28 Zhiqi Lv , Duofan Tu , Jun Li , Mingyue Zhao , Heqin Zhu , Wenliang Li , Shaohua Kevin Zhou

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

Electronic medical records (EMRs), particularly in neurology, are inherently heterogeneous, sparse, and noisy, which poses significant challenges for large language models (LLMs) in clinical diagnosis. In such settings, single-agent systems…

Artificial Intelligence · Computer Science 2026-04-30 Shaowei Shen , Xiaohong Yang , Jie Yang , Lianfen Huang , Yongcai Zhang , Yang Zou , Seyyedali Hosseinalipour

Large Language Models (LLMs) are increasingly used for clinical decision support, where hallucinations and unsafe suggestions may pose direct risks to patient safety. These risks are hard to assess: subtle clinical errors are often missed…

Computation and Language · Computer Science 2026-05-14 Yinzhu Chen , Abdine Maiga , Hossein A. Rahmani , Emine Yilmaz