English
Related papers

Related papers: SEASON: Mitigating Temporal Hallucination in Video…

200 papers

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

Computation and Language · Computer Science 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Robust frame-wise embeddings are essential to perform video analysis and understanding tasks. We present a self-supervised method for representation learning based on aligning temporal video sequences. Our framework uses a transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Keyne Oei , Amr Gomaa , Anna Maria Feit , João Belo

Large Language Models (LLMs) are powerful and widely adopted, but their practical impact is limited by the well-known hallucination phenomenon. While recent hallucination detection methods have made notable progress, we find most of them…

Computation and Language · Computer Science 2026-04-21 Boshui Chen , Zhaoxin Fan , Ke Wang , Zhiying Leng , Faguo Wu , Hongwei Zheng , Yifan Sun , Wenjun Wu

The development of Large Language Models (LLMs) has significantly advanced various AI applications in commercial and scientific research fields, such as scientific literature summarization, writing assistance, and knowledge graph…

Computation and Language · Computer Science 2024-10-17 Huiwen Wu , Xiaohan Li , Xiaogang Xu , Jiafei Wu , Deyi Zhang , Zhe Liu

Recent studies have shown that Large Vision-Language Models (VLMs) tend to neglect image content and over-rely on language-model priors, resulting in errors in visually grounded tasks and hallucinations. We hypothesize that this issue…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Shengguang Wu , Fan-Yun Sun , Kaiyue Wen , Nick Haber

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 April Fu

Video-language models (VLMs) achieve strong multimodal understanding but remain prone to hallucinations, especially when reasoning about actions and temporal order. Existing mitigation strategies, such as textual filtering or random video…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Tobia Poppi , Burak Uzkent , Amanmeet Garg , Lucas Porto , Garin Kessler , Yezhou Yang , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara , Florian Schiffers

Multilingual Large Language Models(MLLMs) demonstrate strong generalization across languages, yet they remain prone to hallucinations, especially in low-resource languages, due to training data imbalances. These hallucinations, which…

Computation and Language · Computer Science 2025-07-22 Weihua Zheng , Roy Ka-Wei Lee , Zhengyuan Liu , Kui Wu , AiTi Aw , Bowei Zou

Large vision-language models (LVLMs) tend to hallucinate, especially when visual inputs are corrupted at test time. We show that such corruptions act as additional distribution shifts, significantly amplifying hallucination rates in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Mriganka Nath , Anurag Das , Jiahao Xie , Bernt Schiele

While Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse tasks, their practical deployment is severely hindered by hallucination issues, which become particularly acute during Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Miao Pan , Wangjie Gan , Jintao Chen , Wenqi Zhang , Bing Sun , Jianwei Yin , Xuhong Zhang

While large language models have demonstrated exceptional performance across a wide range of tasks, they remain susceptible to hallucinations -- generating plausible yet factually incorrect contents. Existing methods to mitigating such risk…

Computation and Language · Computer Science 2025-09-16 Yurui Chang , Bochuan Cao , Lu Lin

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

Artificial Intelligence · Computer Science 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

This project develops a self correcting framework for large language models (LLMs) that detects and mitigates hallucinations during multi-step reasoning. Rather than relying solely on final answer correctness, our approach leverages fine…

Artificial Intelligence · Computer Science 2025-11-21 Chelsea Zou , Yiheng Yao , Basant Khalil

Large Vision-Language Models (LVLMs) frequently suffer from severe hallucination issues. Existing mitigation strategies predominantly rely on isolated, single-step states to enhance visual focus or suppress strong linguistic priors.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Bei Yan , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen

While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes. We argue this stems from a failure in spatio-temporal monitoring, the ability to persistently…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tri Cao , Khoi Le , Thong Nguyen , Cong-Duy Nguyen , Quynh Vo , Anh Tuan Luu , Chunyan Miao , See-Kiong Ng , Shuicheng Yan , Bryan Hooi

Hallucination has been a long-standing and inevitable problem that hinders the application of Large Vision-Language Models (LVLMs) in domains that require high reliability. Various methods focus on improvement depending on data annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Chao Wang , Jianming Yang , Yang Zhou

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

Computation and Language · Computer Science 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

Recent Large Vision-Language Models (LVLMs) have introduced a new paradigm for understanding and reasoning about image input through textual responses. Although they have achieved remarkable performance across a range of multi-modal tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zifu Wan , Ce Zhang , Silong Yong , Martin Q. Ma , Simon Stepputtis , Louis-Philippe Morency , Deva Ramanan , Katia Sycara , Yaqi Xie

Large multimodal models are increasingly used as the reasoning core of embodied agents operating in 3D environments, yet they remain prone to hallucinations that can produce unsafe and ungrounded decisions. Existing inference-time…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Makanjuola Ogunleye , Eman Abdelrahman , Ismini Lourentzou

Multimodal large language models (MLLMs) have recently achieved remarkable progress in radiology by integrating visual perception with natural language understanding. However, they often generate clinically unsupported descriptions, known…

Computation and Language · Computer Science 2025-10-20 Xi Zhang , Zaiqiao Meng , Jake Lever , Edmond S. L. Ho