English
Related papers

Related papers: Once Correct, Still Wrong: Counterfactual Hallucin…

200 papers

Video-language models (VLMs) achieve strong multimodal understanding but remain prone to hallucinations, especially when reasoning about actions and temporal order. Existing mitigation strategies, such as textual filtering or random video…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Tobia Poppi , Burak Uzkent , Amanmeet Garg , Lucas Porto , Garin Kessler , Yezhou Yang , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara , Florian Schiffers

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Chart question-answering (QA) benchmarks aim to pose questions that require visual reasoning to correctly answer, but models can often reach solutions through shortcuts or prior familiarity with a chart based on their own background…

Computation and Language · Computer Science 2026-05-27 Yifan Jiang , Dae Yon Hwang , Jesse C. Cresswell , Freda Shi

Vision-Language Models (VLMs) excel at multimodal reasoning, yet it remains unclear whether their answers are grounded in visual evidence or driven by learned language and world priors. Counting provides a precise testbed: when visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Reem Alzahrani , Hassan Alshanqiti , Bushra Bin Hemid , Zaid Alyafeai , Abdelrahman Eldesokey , Bernard Ghanem

Hallucination has been a major problem for large language models and remains a critical challenge when it comes to multimodality in which vision-language models (VLMs) have to deal with not just textual but also visual inputs. Despite rapid…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhecan Wang , Garrett Bingham , Adams Yu , Quoc Le , Thang Luong , Golnaz Ghiasi

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

Computation and Language · Computer Science 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Large Language Models (LLMs) enhanced with retrieval, an approach known as Retrieval-Augmented Generation (RAG), have achieved strong performance in open-domain question answering. However, RAG remains prone to hallucinations: factually…

We introduce FaithScore (Faithfulness to Atomic Image Facts Score), a reference-free and fine-grained evaluation metric that measures the faithfulness of the generated free-form answers from large vision-language models (LVLMs). The…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Liqiang Jing , Ruosen Li , Yunmo Chen , Xinya Du

Visual question answering (VQA) is a critical multimodal task in which an agent must answer questions according to the visual cue. Unfortunately, language bias is a common problem in VQA, which refers to the model generating answers only by…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Xinyao Shu , Shiyang Yan , Xu Yang , Ziheng Wu , Zhongfeng Chen , Zhenyu Lu

Multimodal Diffusion Large Language Models (MDLLMs) achieve high-concurrency generation through parallel masked decoding, yet the architectures remain prone to multimodal hallucinations. This structural vulnerability stems from an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vishal Narnaware , Animesh Gupta , Kevin Zhai , Zhenyi Wang , Mubarak Shah

Large language models (LMs) are prone to generate factual errors, which are often called hallucinations. In this paper, we introduce a comprehensive taxonomy of hallucinations and argue that hallucinations manifest in diverse forms, each…

Computation and Language · Computer Science 2024-08-14 Abhika Mishra , Akari Asai , Vidhisha Balachandran , Yizhong Wang , Graham Neubig , Yulia Tsvetkov , Hannaneh Hajishirzi

Large Language Models (LLMs) have advanced machine translation but remain vulnerable to hallucinations. Unfortunately, existing MT benchmarks are not capable of exposing failures in multilingual LLMs. To disclose hallucination in…

Computation and Language · Computer Science 2025-10-29 Xinwei Wu , Heng Liu , Jiang Zhou , Xiaohu Zhao , Linlong Xu , Longyue Wang , Weihua Luo , Kaifu Zhang

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

Machine Learning · Computer Science 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

Attribution is a key concept in large language models (LLMs) as it enables control over information sources and enhances the factuality of LLMs. While existing approaches utilize open book question answering to improve attribution, factual…

Computation and Language · Computer Science 2023-11-14 Abdullatif Köksal , Renat Aksitov , Chung-Ching Chang

While Large Language Models (LLMs) excel in question-answering (QA) tasks, their real reasoning abilities on multiple evidence retrieval and integration on Multi-hop QA tasks remain less explored. Firstly, LLMs sometimes generate answers…

Computation and Language · Computer Science 2024-10-16 Jian Wu , Linyi Yang , Zhen Wang , Manabu Okumura , Yue Zhang

Multimodal large language models (MLLMs) suffer from pronounced hallucinations in remote sensing visual question-answering (RS-VQA), primarily caused by visual grounding failures in large-scale scenes or misinterpretation of fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yi Liu , Jing Zhang , Di Wang , Xiaoyu Tian , Haonan Guo , Bo Du

Advancements in Large Vision-Language Models (LVLMs) have demonstrated promising performance in a variety of vision-language tasks involving image-conditioned free-form text generation. However, growing concerns about hallucinations in…

Machine Learning · Computer Science 2025-03-03 Zhuohang Li , Chao Yan , Nicholas J. Jackson , Wendi Cui , Bo Li , Jiaxin Zhang , Bradley A. Malin

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

Computation and Language · Computer Science 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov