English
Related papers

Related papers: Auditing medical multi-agent AI reveals risks of f…

200 papers

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker

While Multi-Agent Systems (MAS) show potential for complex clinical decision support, the field remains hindered by architectural fragmentation and the lack of standardized multimodal integration. Current medical MAS research suffers from…

Artificial Intelligence · Computer Science 2026-03-20 Yunhang Qian , Xiaobin Hu , Jiaquan Yu , Siyang Xin , Xiaokun Chen , Jiangning Zhang , Peng-Tao Jiang , Jiawei Liu , Hongwei Bran Li

Evaluating the clinical correctness and reasoning fidelity of automatically generated medical imaging reports remains a critical yet unresolved challenge. Existing evaluation methods often fail to capture the structured diagnostic logic…

Artificial Intelligence · Computer Science 2026-01-26 Suzhong Fu , Jingqi Dong , Xuan Ding , Rui Sun , Yiming Yang , Shuguang Cui , Zhen Li

Reliable clinical decision support requires medical AI agents capable of safe, multi-step reasoning over structured electronic health records (EHRs). While large language models (LLMs) show promise in healthcare, existing benchmarks…

Artificial Intelligence · Computer Science 2026-01-15 Ananya Mantravadi , Shivali Dalmia , Abhishek Mukherji

Large language models (LLMs) have demonstrated notable potential in medical applications, yet they face substantial challenges in handling complex real-world clinical diagnoses using conventional prompting methods. Current prompt…

Artificial Intelligence · Computer Science 2026-03-02 Wenliang Li , Rui Yan , Xu Zhang , Li Chen , Hongji Zhu , Jing Zhao , Junjun Li , Mengru Li , Wei Cao , Zihang Jiang , Wei Wei , Kun Zhang , Shaohua Kevin Zhou

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

Large Language Model (LLM)-based multi-agent systems are increasingly applied to automate computational workflows in science and engineering. However, how inter-agent dynamics influence reasoning quality and verification reliability remains…

Artificial Intelligence · Computer Science 2025-11-07 Chuan Tian , Yilei Zhang

We present Doctorina MedBench, a comprehensive evaluation framework for agent-based medical AI based on the simulation of realistic physician-patient interactions. Unlike traditional medical benchmarks that rely on solving standardized test…

Computation and Language · Computer Science 2026-03-30 Anna Kozlova , Stanislau Salavei , Pavel Satalkin , Hanna Plotnitskaya , Sergey Parfenyuk

Artificial intelligence in medicine is built to serve the average patient. By minimizing error across large datasets, most systems deliver strong aggregate accuracy yet falter at the margins: patients with rare variants, multimorbidity, or…

Artificial Intelligence · Computer Science 2025-10-29 Pedram Fard , Alaleh Azhir , Neguine Rezaii , Jiazi Tian , Hossein Estiri

Complex medical reasoning has historically required frontier language models to achieve clinically-acceptable accuracy, creating computational barriers that limit deployment in resource-constrained clinical settings. We present…

Artificial Intelligence · Computer Science 2026-04-01 Pranav Pushkar Mishra , Mohammad Arvan , Mohan Zalake

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Across healthcare, agentic artificial intelligence (AI) systems are increasingly promoted as capable of autonomous action, yet in practice they currently operate under near-total human oversight due to safety, regulatory, and liability…

Medical conversational AI (AI) plays a pivotal role in the development of safer and more effective medical dialogue systems. However, existing benchmarks and evaluation frameworks for assessing the information-gathering and diagnostic…

Computation and Language · Computer Science 2026-01-08 Lecheng Gong , Weimin Fang , Ting Yang , Dongjie Tao , Chunxiao Guo , Peng Wei , Bo Xie , Jinqun Guan , Zixiao Chen , Fang Shi , Jinjie Gu , Junwei Liu

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

Artificial Intelligence · Computer Science 2026-02-03 Ananya Joshi , Michael Rudow

This study presents a modular, multi-agent system for the automated review of highly structured enterprise business documents using AI agents. Unlike prior solutions focused on unstructured texts or limited compliance checks, this framework…

Computation and Language · Computer Science 2025-07-01 Sudip Dasgupta , Himanshu Shankar

Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. They can also be used to introduce a diverse group discussion step in chatbot pipelines, enhancing the cultural…

Artificial Intelligence · Computer Science 2024-08-16 Razan Baltaji , Babak Hemmatian , Lav R. Varshney

Large language models (LLMs) have demonstrated strong potential in clinical question answering, with recent multi-agent frameworks further improving diagnostic accuracy via collaborative reasoning. However, we identify a recurring issue of…

Computation and Language · Computer Science 2025-05-28 Yihan Wang , Qiao Yan , Zhenghao Xing , Lihao Liu , Junjun He , Chi-Wing Fu , Xiaowei Hu , Pheng-Ann Heng

Multi-agent systems achieve state-of-the-art outcomes through peer collaboration. However, when an agent in the pipeline silently drops a constraint, the system's final output may look correct even though the reasoning chain was quietly…

Current evaluations of medical consultation agents often prioritize outcome-oriented tasks, frequently overlooking the end-to-end process integrity and clinical safety essential for real-world practice. While recent interactive benchmarks…

Artificial Intelligence · Computer Science 2026-01-21 Chuhan Qiao , Jianghua Huang , Daxing Zhao , Ziding Liu , Yanjun Shen , Bing Cheng , Wei Lin , Kai Wu

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…