English
Related papers

Related papers: VERITAS: Verifiable Epistemic Reasoning for Image-…

200 papers

Artificial intelligence has advanced in Medical Visual Question Answering (Med-VQA), but prevalent research tends to focus on the accuracy of the answers, often overlooking the reasoning paths and interpretability, which are crucial in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Zuozhu Liu

Explanations for AI models in high-stakes domains like medicine often lack verifiability, which can hinder trust. To address this, we propose an interactive agent that produces explanations through an auditable sequence of actions. The…

Artificial Intelligence · Computer Science 2025-11-04 Yuhang Huang , Zekai Lin , Fan Zhong , Lei Liu

We present a verification methodology for analysing the decision-making component in agent-based hybrid systems. Traditionally hybrid automata have been used to both implement and verify such systems, but hybrid automata based modelling,…

Logic in Computer Science · Computer Science 2013-10-10 Louise A. Dennis , Michael Fisher , Nicholas K. Lincoln , Alexei Lisitsa , Sandor M. Veres

This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple…

Computation and Language · Computer Science 2026-02-23 Jaeyoon Jung , Yejun Yoon , Kunwoo Park

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Medical Anomaly Detection (MedAD) presents a significant opportunity to enhance diagnostic accuracy using Large Multimodal Models (LMMs) to interpret and answer questions based on medical images. However, the reliance on Supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Haitao Zhang , Yingying Wang , Jiaxiang Wang , Haote Xu , Hongyang Zhang , Yirong Chen , Yue Huang , Xinghao Ding

Clinical evidence synthesis requires identifying relevant trials from large registries and aggregating results that account for population differences. While recent LLM-based approaches have automated components of systematic review, they…

Methodology · Statistics 2026-04-06 Yao Zhao , Zhiyue Zhang , Yanxun Xu

We present Veritas-RPM, a provenance-guided multi-agent architecture comprising five processing layers: VeritasAgent (ground-truth assembly), SentinelLayer (anomaly detection), DirectorAgent (specialist routing), six domain Specialist…

Multiagent Systems · Computer Science 2026-04-20 Aswini Misro , Vikash Sharma , Shreyank N Gowda

Artificial intelligence has demonstrated significant potential in clinical decision-making; however, developing models capable of adapting to diverse real-world scenarios and performing complex diagnostic reasoning remains a major…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Ronghao Xu , Zhen Huang , Yangbo Wei , Xiaoqian Zhou , Zikang Xu , Ting Liu , Zihang Jiang , S. Kevin Zhou

Automated fetal ultrasound interpretation requires a workflow from visual perception, including plane recognition and anatomical segmentation, to clinical understanding, including biometric measurement and diagnostic reporting. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiaotian Hu , Mingxuan Liu , Junwei Huang , Kasidit Anmahapong , Yifei Chen , Yiming Huang , Xuguang Bai , Zihan Li , Hongjia Yang , Yingqi Hao , Hong Xu , Yu Jiang , Tian Tian , Yi Liao , Haibo Qu , Qiyuan Tian

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

LLM-based agents have demonstrated strong potential for autonomous machine learning, yet their applicability to health data remains limited. Existing systems often struggle to generalize across heterogeneous health data modalities, rely…

Artificial Intelligence · Computer Science 2026-02-03 Tong Xia , Weibin Li , Gang Liu , Yong Li

Recent progress in multimodal large language models (MLLMs) has demonstrated promising performance on medical benchmarks and in preliminary trials as clinical assistants. Yet, our pilot audit of diagnostic cases uncovers a critical failure…

Artificial Intelligence · Computer Science 2025-09-30 Hongjun Liu , Yinghao Zhu , Yuhui Wang , Yitao Long , Zeyu Lai , Lequan Yu , Chen Zhao

Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning…

Artificial Intelligence · Computer Science 2026-02-04 Vishal Venkataramani , Haizhou Shi , Zixuan Ke , Austin Xu , Xiaoxiao He , Yingbo Zhou , Semih Yavuz , Hao Wang , Shafiq Joty

Multimodal Large Language Models (MLLMs) are evolving from passive observers into active agents, solving problems through Visual Expansion (invoking visual tools) and Knowledge Expansion (open-web search). However, existing evaluations fall…

Artificial Intelligence · Computer Science 2026-04-06 Qianshan Wei , Yishan Yang , Siyi Wang , Jinglin Chen , Binyu Wang , Jiaming Wang , Shuang Chen , Zechen Li , Yang Shi , Yuqi Tang , Weining Wang , Yi Yu , Chaoyou Fu , Qi Li , Yi-Fan Zhang

The ambiguity of the decision-making process has been pointed out as the main obstacle to applying the deep learning-based method in a practical way in spite of its outstanding performance. Interpretability could guarantee the confidence of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Hyebin Lee , Seong Tae Kim , Yong Man Ro

\textbf{Background:} Regulatory frameworks for AI in healthcare, including the EU AI Act and FDA guidance on AI/ML-based medical devices, require clinical decision support to demonstrate not only accuracy but auditability. Existing formal…

Artificial Intelligence · Computer Science 2026-04-24 Michael Bouzinier , Sergey Trifonov , Michael Chumack , Eugenia Lvova , Dmitry Etin

Large language models are increasingly being assembled into medical multi-agent systems that emulate multidisciplinary consultation through specialist roles, peer review and consensus formation. In clinical decision support, however,…

Computation and Language · Computer Science 2026-05-28 Yinghao Zhu , Lei Gu , Zixiang Wang , Haoran Sang , Dehao Sui , Wen Tang , Lan Mi , Yasha Wang , Junyi Gao , Liang Yao , Tianfan Fu , Ewen Harrison , Lequan Yu , Liantao Ma

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

Computation and Language · Computer Science 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia