English
Related papers

Related papers: STEAR: Layer-Aware Spatiotemporal Evidence Interve…

200 papers

Recent Large Vision-Language Models (LVLMs) have introduced a new paradigm for understanding and reasoning about image input through textual responses. Although they have achieved remarkable performance across a range of multi-modal tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zifu Wan , Ce Zhang , Silong Yong , Martin Q. Ma , Simon Stepputtis , Louis-Philippe Morency , Deva Ramanan , Katia Sycara , Yaqi Xie

While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We argue this stems from a failure in spatio-temporal monitoring, the ability to persistently…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tri Cao , Khoi Le , Thong Nguyen , Cong-Duy Nguyen , Quynh Vo , Anh Tuan Luu , Chunyan Miao , See-Kiong Ng , Shuicheng Yan , Bryan Hooi

Large Language Models (LLMs) often produce fluent yet factually incorrect statements-a phenomenon known as hallucination-posing serious risks in high-stakes domains. We present Layer-wise Semantic Dynamics (LSD), a geometric framework for…

Computation and Language · Computer Science 2025-10-07 Amir Hameed Mir

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Large vision-language models (LVLMs) often hallucinate objects that are not present in the input image, largely because visual grounding weakens as decoding progresses. Existing inference-time mitigation methods modify logits or hidden…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Soumyadeep Jana , Pulkit Mittal , Sanasam Ranbir Singh

Large vision-language models (LVLMs) have achieved remarkable performance on multimodal tasks. However, they still suffer from hallucinations, generating text inconsistent with visual input, posing significant risks in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhenglin Hua , Jinghan He , Zijun Yao , Tianxu Han , Haiyun Guo , Yuheng Jia , Junfeng Fang

In this work, we tackle action-scene hallucination in Video Large Language Models (Video-LLMs), where models incorrectly predict actions based on the scene context or scenes based on observed actions. We observe that existing Video-LLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Kyungho Bae , Jinhyung Kim , Sihaeng Lee , Soonyoung Lee , Gunhee Lee , Jinwoo Choi

Hallucination, where models generate fluent text unsupported by visual evidence, remains a major flaw in vision-language models and is particularly critical in sign language translation (SLT). In SLT, meaning depends on precise grounding in…

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoda Yang , Shuai Yang , Can Wang , Jingyang Xue , Menglan Tang , Checheng Yu , Xunzhe Zhou , Sashuai Zhou , Tao Jin , Lixin Yang , Xiangyu Yue , Zhou Zhao

Large Vision-Language Models (LVLMs) have advanced rapidly by aligning visual patches with the text embedding space, but a fixed visual-token budget forces images to be resized to a uniform pretraining resolution, often erasing fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zipeng Zhu , Zhanghao Hu , Qinglin Zhu , Yuxi Hong , Yijun Liu , Jingyong Su , Yulan He , Lin Gui

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

Machine Learning · Computer Science 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Multimodal Large Language Models (MLLMs) achieve strong performance on tasks like image captioning and visual question answering, but remain prone to hallucinations, where generated text conflicts with the visual input. Prior work links…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tiancheng Yang , Lin Zhang , Jiaye Lin , Guimin Hu , Di Wang , Lijie Hu

Event stereo matching is an emerging technique to estimate depth from neuromorphic cameras; however, events are unlikely to trigger in the absence of motion or the presence of large, untextured regions, making the correspondence problem…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Luca Bartolomei , Matteo Poggi , Andrea Conti , Stefano Mattoccia

Large Vision-Language Models (LVLMs) have shown remarkable performance on many visual-language tasks. However, these models still suffer from multimodal hallucination, which means the generation of objects or content that violates the…

Computation and Language · Computer Science 2024-10-01 Fan Yuan , Chi Qin , Xiaogang Xu , Piji Li

Despite the significant advancements in Large Vision-Language Models (LVLMs), their tendency to generate hallucinations undermines reliability and restricts broader practical deployment. Among the hallucination mitigation methods, feature…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Tiantian Dang , Chao Bi , Shufan Shen , Jinzhe Liu , Qingming Huang , Shuhui Wang

Recent advancements in multimodal large language models (MLLMs) have significantly improved performance in visual question answering. However, they often suffer from hallucinations. In this work, hallucinations are categorized into two main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Feilong Tang , Chengzhi Liu , Zhongxing Xu , Ming Hu , Zelin Peng , Zhiwei Yang , Jionglong Su , Minquan Lin , Yifan Peng , Xuelian Cheng , Imran Razzak , Zongyuan Ge

Reasoning has emerged as a key capability of large language models. In linguistic tasks, this capability can be enhanced by self-improving techniques that refine reasoning paths for subsequent finetuning. However, extending these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zhiyu Pan , Yizheng Wu , Jiashen Hua , Junyi Feng , Shaotian Yan , Bing Deng , Zhiguo Cao , Jieping Ye

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their…

Artificial Intelligence · Computer Science 2026-01-27 Huajian Zhang , Mingyue Cheng , Yucong Luo , Xiaoyu Tao

Recent advancements in multimodal large reasoning models (MLRMs) have significantly improved performance in visual question answering. However, we observe that transition words (e.g., because, however, and wait) are closely associated with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhongxing Xu , Zhonghua Wang , Zhe Qian , Dachuan Shi , Feilong Tang , Ming Hu , Shiyan Su , Xiaocheng Zou , Wei Feng , Dwarikanath Mahapatra , Yifan Peng , Mingquan Lin , Zongyuan Ge

Vision-Language Models (VLMs) often hallucinate objects that are not present in the input image. We identify a contributing cause of this behavior, which we term spatial credit collapse: in early transformer layers, hidden-state activation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Niamul Hassan Samin , Md Arifur Rahman , Abdullah Ibne Hanif Arean , Juena Ahmed Noshin , Md Ashikur Rahman