中文
相关论文

相关论文: DeVisE: Behavioral Testing of Medical Large Langua…

200 篇论文

Large Language Models (LLMs) have demonstrated remarkable proficiency in human interactions, yet their application within the medical field remains insufficiently explored. Previous works mainly focus on the performance of medical knowledge…

计算与语言 · 计算机科学 2024-07-23 Yusheng Liao , Yutong Meng , Yuhao Wang , Hongcheng Liu , Yanfeng Wang , Yu Wang

In the realms of computer vision and natural language processing, Multimodal Large Language Models (MLLMs) have become indispensable tools, proficient in generating textual responses based on visual inputs. Despite their advancements, our…

计算机视觉与模式识别 · 计算机科学 2025-08-15 YiFan Zhang , Yang Shi , Weichen Yu , Qingsong Wen , Xue Wang , Wenjing Yang , Zhang Zhang , Liang Wang , Rong Jin

Clinical Decision Support Systems (CDSS) utilize evidence-based knowledge and patient data to offer real-time recommendations, with Large Language Models (LLMs) emerging as a promising tool to generate plain-text explanations for medical…

计算与语言 · 计算机科学 2023-10-04 D. Umerenkov , G. Zubkova , A. Nesterov

Doctors and patients alike increasingly use Large Language Models (LLMs) to diagnose clinical cases. However, unlike domains such as math or coding, where correctness can be objectively defined by the final answer, medical diagnosis…

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at text-based inferences, health applications require that models…

An accurate differential diagnosis (DDx) is a cornerstone of medical care, often reached through an iterative process of interpretation that combines clinical history, physical examination, investigations and procedures. Interactive…

Large language models (LLMs) hold great promise for medical applications and are evolving rapidly, with new models being released at an accelerated pace. However, benchmarking on large-scale real-world data such as electronic health records…

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

计算与语言 · 计算机科学 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Accurately predicting mortality risk in intensive care unit (ICU) patients is essential for clinical decision-making. Although large language models (LLMs) show strong potential in structured medical prediction tasks, their outputs may…

机器学习 · 计算机科学 2026-03-24 Gangxiong Zhang , Yongchao Long , Yuxi Zhou , Yong Zhang , Shenda Hong

Recently, Large Language Models (LLM) have demonstrated impressive capability to solve a wide range of tasks. However, despite their success across various tasks, no prior work has investigated their capability in the biomedical domain yet.…

计算与语言 · 计算机科学 2024-02-21 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

As the performance of large language models (LLMs) continues to advance, their adoption in the medical domain is increasing. However, most existing risk evaluations largely focused on general safety benchmarks. In the medical applications,…

As opposed to evaluating computation and logic-based reasoning, current benchmarks for evaluating large language models (LLMs) in medicine are primarily focused on question-answering involving domain knowledge and descriptive reasoning.…

Clinical document classification is essential for converting unstructured medical texts into standardised ICD-10 diagnoses, yet it faces challenges due to complex medical language, privacy constraints, and limited annotated datasets. Large…

计算与语言 · 计算机科学 2026-02-03 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Large language models (LLMs) show promise in medical diagnosis, but real-world deployment remains challenging due to high-stakes clinical decisions and imperfect reasoning reliability. As a result, careful inspection of model behavior is…

计算与语言 · 计算机科学 2026-04-28 Yurui Xiang , Xingyi Mao , Rui Sheng , Zixin Chen , Zelin Zang , Yuyang Wu , Haipeng Zeng , Huamin Qu , Yushi Sun , Yanna Lin

Several recent works seek to adapt general-purpose large language models (LLMs) and vision-language models (VLMs) for medical applications through continued pretraining on publicly available biomedical corpora. These works typically claim…

计算与语言 · 计算机科学 2025-07-01 Daniel P. Jeong , Pranav Mani , Saurabh Garg , Zachary C. Lipton , Michael Oberst

Large language models (LLMs) have demonstrated powerful text generation capabilities, bringing unprecedented innovation to the healthcare field. While LLMs hold immense promise for applications in healthcare, applying them to real clinical…

计算与语言 · 计算机科学 2023-10-16 Rui Yang , Edison Marrese-Taylor , Yuhe Ke , Lechao Cheng , Qingyu Chen , Irene Li

Large Vision-Language Models (LVLMs) increasingly rely on retrieval to answer knowledge-intensive multimodal questions. Existing benchmarks overlook conflicts between visual and textual evidence and the importance of generating deflections…

计算与语言 · 计算机科学 2026-04-15 Nicholas Moratelli , Christopher Davis , Leonardo F. R. Ribeiro , Bill Byrne , Gonzalo Iglesias

Large language models (LLMs) are increasingly being used in user-facing applications, from providing medical consultations to job interview advice. Recent research suggests that these models are becoming increasingly proficient at inferring…

计算与语言 · 计算机科学 2025-07-22 Matthew Kearney , Reuben Binns , Yarin Gal

The current work investigates the capability of Large language models (LLMs) that are explicitly trained on large corpuses of medical knowledge (Med-PaLM 2) to predict psychiatric functioning from patient interviews and clinical…

计算与语言 · 计算机科学 2023-08-04 Isaac R. Galatzer-Levy , Daniel McDuff , Vivek Natarajan , Alan Karthikesalingam , Matteo Malgaroli