English
Related papers

Related papers: Assessing and Mitigating Medical Knowledge Drift a…

200 papers

LLMs often fail to handle temporal knowledge conflicts--contradictions arising when facts evolve over time within their training data. Existing studies evaluate this phenomenon through benchmarks built on structured knowledge bases like…

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

Computation and Language · Computer Science 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large language models (LLMs) hold promise for transforming healthcare, from streamlining administrative and clinical workflows to enriching patient engagement and advancing clinical decision-making. However, their successful integration…

Computers and Society · Computer Science 2025-04-04 Mohammed Al-Garadi , Tushar Mungle , Abdulaziz Ahmed , Abeed Sarker , Zhuqi Miao , Michael E. Matheny

Introduction. Advances in large language models (LLMs) offer a chance to act as scientific assistants, helping people grasp complex research areas. This study examines how LLMs evolve in healthcare disparities research, with attention to…

Computers and Society · Computer Science 2025-12-10 David An

Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories,…

Computation and Language · Computer Science 2026-01-13 Jiaqi Zhao , Qiang Huang , Haodong Chen , Xiaoxing You , Jun Yu

Large language models (LLMs) have achieved impressive advancements across numerous disciplines, yet the critical issue of knowledge conflicts, a major source of hallucinations, has rarely been studied. Only a few research explored the…

Computation and Language · Computer Science 2024-08-23 Zhaochen Su , Jun Zhang , Xiaoye Qu , Tong Zhu , Yanshu Li , Jiashuo Sun , Juntao Li , Min Zhang , Yu Cheng

We propose DISC-MedLLM, a comprehensive solution that leverages Large Language Models (LLMs) to provide accurate and truthful medical response in end-to-end conversational healthcare services. To construct high-quality Supervised…

Computation and Language · Computer Science 2023-08-29 Zhijie Bao , Wei Chen , Shengze Xiao , Kuang Ren , Jiaao Wu , Cheng Zhong , Jiajie Peng , Xuanjing Huang , Zhongyu Wei

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge…

The proliferation of large language models (LLMs) has significantly advanced intelligent systems. Unfortunately, LLMs often face knowledge conflicts between internal memory and retrieved external information, arising from misinformation,…

Computation and Language · Computer Science 2025-11-18 Jiatai Wang , Zhiwei Xu , Di Jin , Xuewen Yang , Tao Li

This survey provides an in-depth analysis of knowledge conflicts for large language models (LLMs), highlighting the complex challenges they encounter when blending contextual and parametric knowledge. Our focus is on three categories of…

Computation and Language · Computer Science 2024-06-25 Rongwu Xu , Zehan Qi , Zhijiang Guo , Cunxiang Wang , Hongru Wang , Yue Zhang , Wei Xu

Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited…

Computation and Language · Computer Science 2025-01-14 Haochun Wang , Sendong Zhao , Zewen Qiang , Zijian Li , Nuwa Xi , Yanrui Du , MuZhen Cai , Haoqiang Guo , Yuhan Chen , Haoming Xu , Bing Qin , Ting Liu

Large Language Models (LLMs) have shown impressive capabilities in various applications, but they still face various inconsistency issues. Existing works primarily focus on the inconsistency issues within a single LLM, while we…

Computation and Language · Computer Science 2024-11-15 Kai Xiong , Xiao Ding , Yixin Cao , Ting Liu , Bing Qin

Large Language Models (LLMs) have revolutionized conversational AI, yet their robustness in extended multi-turn dialogues remains poorly understood. Existing evaluation frameworks focus on static benchmarks and single-turn assessments,…

Computation and Language · Computer Science 2026-02-05 Yubo Li , Ramayya Krishnan , Rema Padman

By providing external information to large language models (LLMs), tool augmentation (including retrieval augmentation) has emerged as a promising solution for addressing the limitations of LLMs' static parametric memory. However, how…

Computation and Language · Computer Science 2024-02-28 Jian Xie , Kai Zhang , Jiangjie Chen , Renze Lou , Yu Su

Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis under escalating pressure. We propose \textbf{\textsc{Med-Stress}}, a targeted stress test…

Artificial Intelligence · Computer Science 2026-05-26 Boyu Xiao , Xiuqi Tian , Xuwen Song , Haochun Wang , Guanchun Song , Sendong Zhao , Bing Qin

The introduction of large language models (LLMs) has greatly enhanced the capabilities of software agents. Instead of relying on rule-based interactions, agents can now interact in flexible ways akin to humans. However, this flexibility…

Human-Computer Interaction · Computer Science 2026-02-04 Joar Sabel , Mattias Wingren , Andreas Lundell , Sören Andersson , Sara Rosenberg , Susanne Hägglund , Linda Estman , Malin Andtfolk

Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect…

Computation and Language · Computer Science 2025-05-23 Kexin Shang , Chia-Hsuan Chang , Christopher C. Yang

This paper investigates the challenges of developing large language models (LLMs) proficient in both multilingual understanding and medical knowledge. We demonstrate that simply translating medical data does not guarantee strong performance…

Computation and Language · Computer Science 2025-01-20 Nada Saadi , Tathagata Raha , Clément Christophe , Marco AF Pimentel , Ronnie Rajan , Praveen K Kanithi

Multi-modal Large Language Models (MLLMs) frequently face challenges from concept drift when dealing with real-world streaming data, wherein distributions change unpredictably. This mainly includes gradual drift due to long-tailed data and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Xiaoyu Yang , Jie Lu , En Yu

Large language models (LLMs) show promise for supporting clinicians in diagnostic communication by generating explanations and guidance for patients. Yet their ability to produce outputs that are both understandable and empathetic remains…

Computation and Language · Computer Science 2025-11-04 Jianzhou Yao , Shunchang Liu , Guillaume Drui , Rikard Pettersson , Alessandro Blasimme , Sara Kijewski