English
Related papers

Related papers: Improving VQA Reliability: A Dual-Assessment Appro…

200 papers

Vision-language reward modeling faces a dilemma: generative approaches are interpretable but slow, while discriminative ones are efficient but act as opaque "black boxes." To bridge this gap, we propose VL-MDR (Vision-Language…

Computation and Language · Computer Science 2026-04-08 Qiyuan Chen , Hongsen Huang , Jiahe Chen , Qian Shao , Jintai Chen , Hongxia Xu , Renjie Hua , Chuan Ren , Jian Wu

Despite the remarkable ability of large vision-language models (LVLMs) in image comprehension, these models frequently generate plausible yet factually incorrect responses, a phenomenon known as hallucination.Recently, in large language…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xiaoye Qu , Qiyuan Chen , Wei Wei , Jishuo Sun , Jianfeng Dong

Multimodal large language models (MLLMs) suffer from pronounced hallucinations in remote sensing visual question-answering (RS-VQA), primarily caused by visual grounding failures in large-scale scenes or misinterpretation of fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yi Liu , Jing Zhang , Di Wang , Xiaoyu Tian , Haonan Guo , Bo Du

Reinforcement learning has recently improved the reasoning ability of Large Language Models and Multimodal LLMs, yet prevailing reward designs emphasise final-answer correctness and consequently tolerate process hallucinations--cases where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yantao Li , Qiang Hui , Chenyang Yan , Kanzhi Cheng , Fang Zhao , Chao Tan , Huanling Gao , Jianbing Zhang , Kai Wang , Xinyu Dai , Shiguo Lian

Vision-language models (VLMs) are prone to object hallucinations, where they erroneously indicate the presenceof certain objects in an image. Existing benchmarks quantify hallucinations using relatively small, labeled datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Maximilian Augustin , Yannic Neuhaus , Matthias Hein

Large Vision Language Models (LVLMs) have recently achieved superior performance in various tasks on natural image and text data, which inspires a large amount of studies for LVLMs fine-tuning and training. Despite their advancements, there…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zishan Gu , Changchang Yin , Fenglin Liu , Ping Zhang

Vision-Language Models (VLMs) frequently suffer from visual perception errors and hallucinations that compromise answer accuracy in complex reasoning tasks. Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising solution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yin Zhang , Jiaxuan Zhao , Zonghan Wu , Zengxiang Li , Junfeng Fang , Kun Wang , Qingsong Wen , Yilei Shao

Biomedical question answering (QA) requires accurate interpretation of complex medical knowledge. Large language models (LLMs) have shown promising capabilities in this domain, with retrieval-augmented generation (RAG) systems enhancing…

Computation and Language · Computer Science 2025-10-21 Yingpeng Ning , Yuanyuan Sun , Ling Luo , Yanhua Wang , Yuchen Pan , Hongfei Lin

Despite significant advancements in vision-language models (VLMs), there lacks effective approaches to enhance response quality by scaling inference-time computation. This capability is known to be a core step towards the self-improving…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Xiyao Wang , Zhengyuan Yang , Linjie Li , Hongjin Lu , Yuancheng Xu , Chung-Ching Lin , Kevin Lin , Furong Huang , Lijuan Wang

Multimodal Large Reasoning Models (MLRMs) have achieved remarkable strides in visual reasoning through test time compute scaling, yet long chain reasoning remains prone to hallucinations. We identify a concerning phenomenon termed the…

Artificial Intelligence · Computer Science 2026-05-29 Zhe Qian , Yanbiao Ma , Zhuohan Ouyang , Zhonghua Wang , Zhongxing Xu , Fei Luo , Xinyu Liu , Zongyuan Ge , Yike Guo , Jungong Han

This paper presents the 5th place solution by our team, y3h2, for the Meta CRAG-MM Challenge at KDD Cup 2025. The CRAG-MM benchmark is a visual question answering (VQA) dataset focused on factual questions about images, including egocentric…

Information Retrieval · Computer Science 2025-12-29 Yuto Nakamizo , Ryuhei Miyazato , Hikaru Tanabe , Ryuta Yamakura , Kiori Hatanaka

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Large Vision-Language Models (LVLMs) have shown remarkable progress in various multimodal tasks, yet they often struggle with complex visual reasoning that requires multi-step inference. To address this limitation, we propose MF-SQ-LLaVA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Liu Jing , Amirul Rahman

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Visual Question Answering (VQA) models often perform poorly on out-of-distribution data and struggle on domain generalization. Due to the multi-modal nature of this task, multiple factors of variation are intertwined, making generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhuowan Li , Xingrui Wang , Elias Stengel-Eskin , Adam Kortylewski , Wufei Ma , Benjamin Van Durme , Alan Yuille

Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Chaoran Xu , Yingmao Miao , Pengfei Zhang , Hao Dou , Lei Sun , Xiangxiang Chu

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng