English
Related papers

Related papers: Auditing medical multi-agent AI reveals risks of f…

200 papers

We present PULSE, a medical reasoning agent that combines a domain-tuned large language model with scientific literature retrieval to support diagnostic decision-making in complex real-world cases. To evaluate its capabilities, we curated a…

Computation and Language · Computer Science 2026-03-19 Zhongzhen Huang , Yan Ling , Hong Chen , Ye Feng , Li Wu , Linjie Mu , Shaoting Zhang , Xiaofan Zhang , Kun Qian , Xiaomu Li

End-to-end automation of realistic healthcare operations stresses three capabilities underrepresented in current benchmarks: policy density, decisions must be grounded in a large library of medical, insurance, and operational rules;…

AI-based systems, including Large Language Models (LLM), impact millions by supporting diverse tasks but face issues like misinformation, bias, and misuse. AI ethics is crucial as new technologies and concerns emerge, but objective,…

Computers and Society · Computer Science 2025-05-19 José Antonio Siqueira de Cerqueira , Mamia Agbese , Rebekah Rousi , Nannan Xi , Juho Hamari , Pekka Abrahamsson

Recent advances in the data-driven medicine approach, which integrates ethically managed and explainable artificial intelligence into clinical decision support systems (CDSS), are critical to ensure reliable and effective patient care. This…

Artificial Intelligence · Computer Science 2025-09-23 Ying-Jung Chen , Ahmad Albarqawi , Chi-Sheng Chen

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

Large language models (LLMs) are increasingly used in clinical settings, raising concerns about racial bias in both generated medical text and clinical reasoning. Existing studies have identified bias in medical LLMs, but many focus on…

Computers and Society · Computer Science 2026-04-21 Sihao Xing , Zaur Gouliev

AI coding agents increasingly act directly within software environments, yet existing analyses of their failures rely on benchmark trajectories that miss how developers actually experience misalignment. We present an observational study of…

Software Engineering · Computer Science 2026-05-29 Ningzhi Tang , Chaoran Chen , Gelei Xu , Yiyu Shi , Yu Huang , Collin McMillan , Tao Dong , Toby Jia-Jun Li

As large language models (LLMs) are increasingly deployed in healthcare, ensuring their safety, particularly within collaborative multi-agent configurations, is paramount. In this paper we introduce MedSentry, a benchmark comprising 5 000…

Multiagent Systems · Computer Science 2025-05-28 Kai Chen , Taihang Zhen , Hewei Wang , Kailai Liu , Xinfeng Li , Jing Huo , Tianpei Yang , Jinfeng Xu , Wei Dong , Yang Gao

AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation…

Artificial Intelligence · Computer Science 2026-02-24 Stephan Rabanser , Sayash Kapoor , Peter Kirgis , Kangheng Liu , Saiteja Utpala , Arvind Narayanan

Multi-Agentic AI systems, powered by large language models (LLMs), are inherently non-deterministic and prone to silent failures such as drift, cycles, and missing details in outputs, which are difficult to detect. We introduce the task of…

Artificial Intelligence · Computer Science 2025-11-07 Divya Pathak , Harshit Kumar , Anuska Roy , Felix George , Mudit Verma , Pratibha Moogi

Prior Authorization delivers safe, appropriate, and cost-effective care that is medically justified with evidence-based guidelines. However, the process often requires labor-intensive manual comparisons between patient medical records and…

Artificial Intelligence · Computer Science 2024-07-09 Himanshu Pandey , Akhil Amod , Shivang

Across millennia, complex societies have faced the same coordination problem of how to organize collective action among cognitively bounded and informationally incomplete individuals. Different civilizations developed different political…

Artificial Intelligence · Computer Science 2026-05-01 Chao Fei , Hongcheng Guo , Yanghua Xiao

AI Agents can perform complex operations at great speed, but just like all the humans we have ever hired, their intelligence remains fallible. Miscommunications aren't noticed, systemic biases have no counter-action, and inner monologues…

Multiagent Systems · Computer Science 2026-01-22 Gopal Vijayaraghavan , Prasanth Jayachandran , Arun Murthy , Sunil Govindan , Vivek Subramanian

Reproducing computational research is often assumed to be as simple as rerunning the original code with provided data. In practice, missing packages, fragile file paths, version conflicts, or incomplete logic frequently cause analyses to…

Software Engineering · Computer Science 2026-04-24 Syed Mehtab Hussain Shah , Frank Hopfgartner , Arnim Bleier

Large Language Models (LLMs) are increasingly utilized for mental health support; however, current safety benchmarks often fail to detect the complex, longitudinal risks inherent in therapeutic dialogue. We introduce an evaluation framework…

Computation and Language · Computer Science 2026-03-06 Ian Steenstra , Paola Pedrelli , Weiyan Shi , Stacy Marsella , Timothy W. Bickmore

Motivated by the challenge to improve the adversarial robustness, security, and trust of medical decision making intelligent agents, this study develops a full-link security enhancement framework, which describes "input risk perception -…

Cryptography and Security · Computer Science 2026-05-12 Saisai Hu

What should a developer inspect before deploying an LLM agent: the model, the tool code, the deployment configuration, or all three? In practice, many security failures in agent systems arise not from model weights alone, but from the…

Cryptography and Security · Computer Science 2026-03-25 Haiyue Zhang , Yi Nian , Yue Zhao

Tabular anomaly detection is often handled by single detectors or static ensembles, even though strong performance on tabular data typically comes from heterogeneous model families (e.g., tree ensembles, deep tabular networks, and tabular…

Machine Learning · Computer Science 2026-02-17 Pinqiao Wang , Sheng Li

The application of AI in psychiatric diagnosis faces significant challenges, including the subjective nature of mental health assessments, symptom overlap across disorders, and privacy constraints limiting data availability. To address…

Social and Information Networks · Computer Science 2025-10-14 Mengxi Xiao , Ben Liu , He Li , Jimin Huang , Qianqian Xie , Xiaofen Zong , Mang Ye , Min Peng

Multi-agent systems, where LLM agents communicate through free-form language, enable sophisticated coordination for solving complex cooperative tasks. This surfaces a unique safety problem when a group of agents forms a coalition and…