中文
相关论文

相关论文: ClinDEF: A Dynamic Evaluation Framework for Large …

200 篇论文

In this paper, we present a novel diagnostic framework that integrates Knowledge Graphs (KGs) and Large Language Models (LLMs) to support system diagnostics in high-reliability systems such as nuclear power plants. Traditional diagnostic…

人工智能 · 计算机科学 2025-09-01 Saman Marandi , Yu-Shu Hu , Mohammad Modarres

Clinical decision-making is a dynamic, interactive, and cyclic process where doctors have to repeatedly decide on which clinical action to perform and consider newly uncovered information for diagnosis and treatment. Large Language Models…

计算与语言 · 计算机科学 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Ege Özsoy , Nassir Navab , Matthias Keicher

LLMs are increasingly used as third-party judges, yet their reliability when evaluating speakers in dialogue remains poorly understood. We show that LLMs judge identical claims differently depending on framing: the same content elicits…

The development of large language models (LLMs) has brought unprecedented possibilities for artificial intelligence (AI) based medical diagnosis. However, the application perspective of LLMs in real diagnostic scenarios is still unclear…

计算与语言 · 计算机科学 2024-05-21 Zhoujian Sun , Cheng Luo , Ziyi Liu , Zhengxing Huang

With the proliferation of Large Language Models (LLMs) in diverse domains, there is a particular need for unified evaluation standards in clinical medical scenarios, where models need to be examined very thoroughly. We present CliMedBench,…

计算与语言 · 计算机科学 2024-10-07 Zetian Ouyang , Yishuai Qiu , Linlin Wang , Gerard de Melo , Ya Zhang , Yanfeng Wang , Liang He

Clinical Decision Support Systems (CDSSs) provide reasoning and inquiry guidance for physicians, yet they face notable challenges, including high maintenance costs and low generalization capability. Recently, Large Language Models (LLMs)…

计算与语言 · 计算机科学 2026-04-24 Yue Guo , Fanfu Wang , Jianwei Lv , Xincheng Shi , Yuchen Li , Youya Wang , Yunsheng Zeng , Yujing Liu , Yunhao Qiao , Gen Li , Junfeng Wang , Bo Yuan

Extracting structured information from clinical notes requires navigating a dense web of interdependent variables where the value of one attribute logically constrains others. Existing Large Language Model (LLM)-based extraction pipelines…

Interactive medical dialogue benchmarks have shown that LLM diagnostic accuracy degrades significantly when interacting with non-cooperative patients, yet existing approaches either apply adversarial behaviors without graded severity or…

计算与语言 · 计算机科学 2026-04-09 Xiaotian Luo , Xun Jiang , Jiangcheng Wu

Answering complex medical questions requires not only domain expertise and patient-specific information, but also structured and multi-perspective reasoning. Existing multi-agent approaches often rely on fixed roles or shallow interaction…

人工智能 · 计算机科学 2026-03-04 Siqi Ma , Jiajie Huang , Fan Zhang , Yue Shen , Jinlin Wu , Guohui Fan , Zhu Zhang , Zelin Zang

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

计算与语言 · 计算机科学 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intelligent task-oriented dialogue systems. However, existing…

计算与语言 · 计算机科学 2026-03-02 Yu Zhu , Kai Yang

Biases and errors in human-labeled data present significant challenges for machine learning, especially in supervised learning reliant on potentially flawed ground truth data. These flaws, including diagnostic errors and societal biases,…

人工智能 · 计算机科学 2024-10-25 Edward Y. Chang

While Large Language Models (LLMs) have demonstrated potential in healthcare, they often struggle with the complex, non-linear reasoning required for accurate clinical diagnosis. Existing methods typically rely on static, linear mappings…

计算与语言 · 计算机科学 2026-05-28 Zhuohan Ge , Haoyang Li , Yubo Wang , Nicole Hu , Chen Jason Zhang , Qing Li

The potential of Multimodal Large Language Models (MLLMs) in domain of medical imaging raise the demands of systematic and rigorous evaluation frameworks that are aligned with the real-world medical imaging practice. Existing practices that…

计算与语言 · 计算机科学 2026-04-16 Zhijie Bao , Fangke Chen , Licheng Bao , Chenhui Zhang , Wei Chen , Jiajie Peng , Zhongyu Wei

Artificial intelligence has significantly advanced healthcare, particularly through large language models (LLMs) that excel in medical question answering benchmarks. However, their real-world clinical application remains limited due to the…

计算与语言 · 计算机科学 2024-07-01 Zhihao Fan , Jialong Tang , Wei Chen , Siyuan Wang , Zhongyu Wei , Jun Xi , Fei Huang , Jingren Zhou

Doctors and patients alike increasingly use Large Language Models (LLMs) to diagnose clinical cases. However, unlike domains such as math or coding, where correctness can be objectively defined by the final answer, medical diagnosis…

Continuing advances in Large Language Models (LLMs) in artificial intelligence offer important capacities in intuitively accessing and using medical knowledge in many contexts, including education and training as well as assessment and…

计算与语言 · 计算机科学 2024-08-01 Roma Shusterman , Allison C. Waters , Shannon O`Neill , Phan Luu , Don M. Tucker

Recent advances in Large Language Models (LLMs) have led to remarkable progresses in medical consultation. However, existing medical LLMs overlook the essential role of Electronic Health Records (EHR) and focus primarily on diagnosis…

人工智能 · 计算机科学 2025-06-26 Weijieying Ren , Tianxiang Zhao , Lei Wang , Tianchun Wang , Vasant Honavar

We propose a clinical decision support system (CDSS) for mental health diagnosis that combines the strengths of large language models (LLMs) and constraint logic programming (CLP). Having a CDSS is important because of the high complexity…

人工智能 · 计算机科学 2025-02-24 Brian Hyeongseok Kim , Chao Wang

Reasoning Large Language Models (LLMs) with enhanced accuracy and explainability are increasingly being adopted in the medical domain, as the life-critical nature of clinical decision-making demands reliable support. Despite these…

计算与语言 · 计算机科学 2025-11-12 Sung-Min Lee , Siyoon Lee , Juyeon Kim , Kyoungmin Roh