English
Related papers

Related papers: Visual Multi-Agent System: Mitigating Hallucinatio…

200 papers

Multi-agent systems (MAS) powered by large language models suffer from severe token inefficiency arising from two compounding sources: (i) unstructured parallel execution, where all agents activate simultaneously irrespective of input…

Artificial Intelligence · Computer Science 2026-04-21 Mohit Dubey

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Large Vision-Language Models (LVLMs) still struggle with vision hallucination, where generated responses are inconsistent with the visual input. Existing methods either rely on large-scale annotated data for fine-tuning, which incurs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yu Zhang , Chuyang Sun , Kehai Chen , Xuefeng Bai , Yang Xiang , Min Zhang

Large language model-driven multi-agent systems (LLM-MAS) excel at complex tasks, yet unreliable agents remain a key bottleneck to system-level reliability. Automatic failure attribution is therefore critical, but existing approaches, such…

Computation and Language · Computer Science 2026-05-19 Hezhe Qiao , Hanghang Tong , Ee-Peng Lim , Bing Liu , Guansong Pang

Large Vision-Language Models (VLMs) often exhibit text inertia, where attention drifts from visual evidence toward linguistic priors, resulting in object hallucinations. Existing decoding strategies intervene only at the output logits and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Weijue Bu , Guan Yuan , Guixian Zhang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in multimodal tasks. Despite their impressive performance, MLLMs suffer from the modality imbalance issue, where visual information is often underutilized…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Hengzhuang Li , Xinsong Zhang , Qiming Peng , Bin Luo , Han Hu , Dengyang Jiang , Han-Jia Ye , Teng Zhang , Hai Jin

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated significant progress across multiple domains. However, these models still face the inherent challenge of integrating vision and language for collaborative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiabing Yang , Chenhang Cui , Yiyang Zhou , Yixiang Chen , Peng Xia , Ying Wei , Tao Yu , Yan Huang , Liang Wang

The incorporation of LLMs in multi-agent systems (MASs) has the potential to significantly improve our ability to autonomously solve complex problems. However, such systems introduce unique challenges in monitoring, interpreting, and…

We propose GAM-Agent, a game-theoretic multi-agent framework for enhancing vision-language reasoning. Unlike prior single-agent or monolithic models, GAM-Agent formulates the reasoning process as a non-zero-sum game between base…

Artificial Intelligence · Computer Science 2025-05-30 Jusheng Zhang , Yijia Fan , Wenjun Lin , Ruiqi Chen , Haoyi Jiang , Wenhao Chai , Jian Wang , Keze Wang

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

Computation and Language · Computer Science 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Vision-language models (VLMs) have demonstrated remarkable potential in integrating visual and linguistic information, but their performance is often constrained by the need for extensive, high-quality image-text training data. Curation of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Giorgio Giannone , Ruoteng Li , Qianli Feng , Evgeny Perevodchikov , Rui Chen , Aleix Martinez

Multimodal Large Reasoning Models (MLRMs) have achieved remarkable strides in visual reasoning through test time compute scaling, yet long chain reasoning remains prone to hallucinations. We identify a concerning phenomenon termed the…

Artificial Intelligence · Computer Science 2026-05-29 Zhe Qian , Yanbiao Ma , Zhuohan Ouyang , Zhonghua Wang , Zhongxing Xu , Fei Luo , Xinyu Liu , Zongyuan Ge , Yike Guo , Jungong Han

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Visual hallucination (VH) means that a multi-modal LLM (MLLM) imagines incorrect details about an image in visual question answering. Existing studies find VH instances only in existing image datasets, which results in biased understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Wen Huang , Hongbin Liu , Minxin Guo , Neil Zhenqiang Gong

Hallucination continues to pose a major obstacle in the reasoning capabilities of large language models (LLMs). Although the Multi-Agent Debate (MAD) paradigm offers a promising solution by promoting consensus among multiple agents to…

Artificial Intelligence · Computer Science 2025-11-17 Dayong Liang , Xiao-Yong Wei , Changmeng Zheng

Large Language Model-based Multi-Agent Systems (MAS) have demonstrated remarkable capabilities in complex tasks. However, manually designing optimal communication topologies is labor-intensive, while automated expansion methods often result…

Machine Learning · Computer Science 2026-05-12 Yulang Chen , Haoxuan Peng , Jinyan Liu , Zichen Wen , Dongrui Liu , Linfeng Zhang

Large Vision-Language Models (LVLMs) can reason effectively over both textual and visual inputs, but they tend to hallucinate syntactically coherent yet visually ungrounded contents. In this paper, we investigate the internal dynamics of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuowei Li , Haizhou Shi , Yunhe Gao , Di Liu , Zhenting Wang , Yuxiao Chen , Ting Liu , Long Zhao , Hao Wang , Dimitris N. Metaxas

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Recent advancements in the field of AI agents have impacted the way we work, enabling greater automation and collaboration between humans and agents. In the data visualization field, multi-agent systems can be useful for employing agents…

Artificial Intelligence · Computer Science 2025-09-03 Anton Wolter , Georgios Vidalakis , Michael Yu , Ankit Grover , Vaishali Dhanoa

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang