English
Related papers

Related papers: Auditing medical multi-agent AI reveals risks of f…

200 papers

Artificial Intelligence (AI) is now firmly at the center of evidence-based medicine. Despite many success stories that edge the path of AI's rise in healthcare, there are comparably many reports of significant shortcomings and unexpected…

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted…

Computation and Language · Computer Science 2024-12-10 Raphael Shu , Nilaksh Das , Michelle Yuan , Monica Sunkara , Yi Zhang

Multi-agent systems (MAS) built on large language models promise improved problem-solving through collaboration, yet they often fail to consistently outperform strong single-agent baselines due to error propagation at inter-agent message…

Artificial Intelligence · Computer Science 2026-01-21 Bohan Lin , Kuo Yang , Zelin Tan , Yingchuan Lai , Chen Zhang , Guibin Zhang , Xinlei Yu , Miao Yu , Xu Wang , Yudong Zhang , Yang Wang

The shortage of doctors is creating a critical squeeze in access to medical expertise. While conversational Artificial Intelligence (AI) holds promise in addressing this problem, its safe deployment in patient-facing roles remains largely…

Artificial Intelligence · Computer Science 2025-04-11 Antoine Lizée , Pierre-Auguste Beaucoté , James Whitbeck , Marion Doumeingts , Anaël Beaugnon , Isabelle Feldhaus

Deploying Large Language Models (LLMs) in medical applications requires fact-checking capabilities to ensure patient safety and regulatory compliance. We introduce MedFact, a challenging Chinese medical fact-checking benchmark with 2,116…

Computation and Language · Computer Science 2025-11-18 Jiayi He , Yangmin Huang , Qianyun Du , Xiangying Zhou , Zhiyang He , Jiaxue Hu , Xiaodong Tao , Lixian Lai

Large language models can generate scientific simulation code, but the generated code silently fails on most non-textbook problems. We show that classical mathematical validation -- well-posedness, convergence, and error certification --…

Software Engineering · Computer Science 2026-03-30 Chengshuai Yang

While Large Language Models (LLMs) have demonstrated potential in healthcare, they often struggle with the complex, non-linear reasoning required for accurate clinical diagnosis. Existing methods typically rely on static, linear mappings…

Computation and Language · Computer Science 2026-05-28 Zhuohan Ge , Haoyang Li , Yubo Wang , Nicole Hu , Chen Jason Zhang , Qing Li

Multiple myeloma is managed through sequential lines of therapy over years to decades, with each decision depending on cumulative disease history distributed across dozens to hundreds of heterogeneous clinical documents. Whether LLM-based…

Large Language Models (LLMs) have shown impressive performance on existing medical question-answering benchmarks. This high performance makes it increasingly difficult to meaningfully evaluate and differentiate advanced methods. We present…

Computation and Language · Computer Science 2025-03-21 Xiangru Tang , Daniel Shao , Jiwoong Sohn , Jiapeng Chen , Jiayi Zhang , Jinyu Xiang , Fang Wu , Yilun Zhao , Chenglin Wu , Wenqi Shi , Arman Cohan , Mark Gerstein

Large language models (LLMs) are increasingly grounded in sensor data to perceive and reason about human physiology and the physical world. However, accurately interpreting heterogeneous multimodal sensor data remains a fundamental…

Artificial Intelligence · Computer Science 2026-01-13 Hyungjun Yoon , Mohammad Malekzadeh , Sung-Ju Lee , Fahim Kawsar , Lorena Qendro

Multi-agent debate (MAD) is an emerging approach to improving the reasoning capabilities of large language models (LLMs). Existing MAD methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is…

Artificial Intelligence · Computer Science 2025-09-16 Yu Cui , Hang Fu , Haibin Zhang , Licheng Wang , Cong Zuo

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

Vision-Language Models (VLMs) show promise in medical diagnosis, yet suffer from reasoning detachment, where linguistically fluent explanations drift from verifiable image evidence, undermining clinical trust. Recent multi-agent frameworks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Qianhan Feng , Zhongzhen Huang , Yakun Zhu , Xiaofan Zhang , Qi Dou

Evaluating factual accuracy in Large Language Model (LLM)-generated clinical text is a critical barrier to adoption, as expert review is unscalable for the continuous quality assurance these systems require. We address this challenge with…

Multimodal artificial intelligence (AI) systems have the potential to enhance clinical decision-making by interpreting various types of medical data. However, the effectiveness of these models across all medical fields is uncertain. Each…

Accurate interpretation of clinical narratives is critical for patient care, but the complexity of these notes makes automation challenging. While Large Language Models (LLMs) show promise, single-model approaches can lack the robustness…

Artificial Intelligence · Computer Science 2025-09-01 Yeawon Lee , Xiaoyang Wang , Christopher C. Yang

Many research areas rely on data from the web to gain insights and test their methods. However, collecting comprehensive research datasets often demands manually reviewing many web pages to identify and record relevant data points, which is…

Multiagent Systems · Computer Science 2025-12-29 Sunith Vallabhaneni , Thomas Berkane , Maimuna Majumder

Large language models (LLMs) are increasingly envisioned as decision-support tools in clinical practice, yet safe clinical reasoning demands integrating heterogeneous knowledge bases -- trials, primary studies, regulatory documents, and…

Computation and Language · Computer Science 2025-05-22 Shan Chen , Pedro Moreira , Yuxin Xiao , Sam Schmidgall , Jeremy Warner , Hugo Aerts , Thomas Hartvigsen , Jack Gallifant , Danielle S. Bitterman

Artificial intelligence (AI) systems are increasingly integrated into healthcare and pharmacy workflows, supporting tasks such as medication recommendations, dosage determination, and drug interaction detection. While these systems often…

Artificial Intelligence · Computer Science 2026-05-21 Khalid Adnan Alsayed

Artificial Intelligence (AI) has become essential in modern healthcare, with large language models (LLMs) offering promising advances in clinical decision-making. Traditional model-based approaches, including those leveraging in-context…