English
Related papers

Related papers: Hallucination as Trajectory Commitment: Causal Evi…

200 papers

Large language models often struggle to recognize their knowledge limits in closed-book question answering, leading to confident hallucinations. While decomposed prompting is typically used to improve accuracy, we investigate its impact on…

Computation and Language · Computer Science 2026-02-05 Dhruv Madhwal , Lyuxin David Zhang , Dan Roth , Tomer Wolfson , Vivek Gupta

Hallucination remains a fundamental challenge in vision-language models (VLMs), where autoregressive generation may produce linguistically plausible yet physically inconsistent or visually ungrounded responses due to likelihood maximization…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Qinwu Xu

Retrieval-Augmented Generation (RAG) integrates external knowledge to mitigate hallucinations, yet models often generate outputs inconsistent with retrieved content. Accurate hallucination detection requires disentangling the contributions…

Computation and Language · Computer Science 2025-10-27 Likun Tan , Kuan-Wei Huang , Joy Shi , Kevin Wu

For Large Language Models (LLMs) to be reliably deployed, models must effectively know when not to answer: abstain. Reasoning models, in particular, have gained attention for impressive performance on complex tasks. However, reasoning…

Artificial Intelligence · Computer Science 2026-04-03 Abinitha Gourabathina , Inkit Padhi , Manish Nagireddy , Subhajit Chaudhury , Prasanna Sattigeri

We investigate the problem of generating instructions to guide humans to navigate in simulated residential environments. A major issue with current models is hallucination: they generate references to actions or objects that are…

Computation and Language · Computer Science 2023-10-25 Lingjun Zhao , Khanh Nguyen , Hal Daumé

Contrastive learning models based on Siamese structure have demonstrated remarkable performance in self-supervised learning. Such a success of contrastive learning relies on two conditions, a sufficient number of positive pairs and adequate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jing Wu , Jennifer Hobbs , Naira Hovakimyan

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

Recent studies have examined attention dynamics in large vision-language models (LVLMs) to detect hallucinations. However, existing approaches remain limited in reliably distinguishing hallucinated from factually grounded outputs, as they…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xiaofeng Zhang , Yuanchao Zhu , Chaochen Gu , Xiaosong Yuan , Qiyan Zhao , Jiawei Cao , Feilong Tang , Sinan Fan , Yaomin Shen , Chen Shen , Hao Tang

Large language models (LLMs) have demonstrated impressive performance in both research and real-world applications, but they still struggle with hallucination. Existing hallucination detection methods often perform poorly on sentence-level…

Computation and Language · Computer Science 2025-09-01 Weizhi Gao , Xiaorui Liu , Feiyi Wang , Dan Lu , Junqi Yin

Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable…

Computation and Language · Computer Science 2025-10-03 Nandakishor M

Large Language Models (LLMs) have shown significant potential in automating code generation tasks offering new opportunities across software engineering domains. However, their practical application remains limited due to hallucinations -…

Software Engineering · Computer Science 2025-08-18 Marc Pavel , Nenad Petrovic , Lukasz Mazur , Vahid Zolfaghari , Fengjunjie Pan , Alois Knoll

Large vision-language models (VLMs) are highly capable, yet often hallucinate by favoring textual prompts over visual evidence. We study this failure mode in a controlled object-counting setting, where the prompt overstates the number of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 William Rudman , Michal Golovanevsky , Dana Arad , Yonatan Belinkov , Ritambhara Singh , Carsten Eickhoff , Kyle Mahowald

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

Machine Learning · Computer Science 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

As LLM-based agents operate over sequential multi-step reasoning, hallucinations arising at intermediate steps risk propagating along the trajectory, thus degrading overall reliability. Unlike hallucination detection in single-turn…

Computation and Language · Computer Science 2026-01-13 Xuannan Liu , Xiao Yang , Zekun Li , Peipei Li , Ran He

Promptable segmentation typically requires instance-specific manual prompts to guide the segmentation of each desired object. To minimize such a need, task-generic promptable segmentation has been introduced, which employs a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jian Hu , Jiayi Lin , Junchi Yan , Shaogang Gong

While large language models (LLMs) have taken great strides towards helping humans with a plethora of tasks, hallucinations remain a major impediment towards gaining user trust. The fluency and coherence of model generations even when…

Computation and Language · Computer Science 2024-08-23 Ben Snyder , Marius Moisescu , Muhammad Bilal Zafar

Large language models are successful in answering factoid questions but are also prone to hallucination. We investigate the phenomenon of LLMs possessing correct answer knowledge yet still hallucinating from the perspective of inference…

Computation and Language · Computer Science 2024-10-29 Che Jiang , Biqing Qi , Xiangyu Hong , Dayuan Fu , Yang Cheng , Fandong Meng , Mo Yu , Bowen Zhou , Jie Zhou

Hallucination remains a key obstacle to the reliable deployment of large language models (LLMs) in real-world question answering tasks. A widely adopted strategy to detect hallucination, known as self-assessment, relies on the model's own…

Artificial Intelligence · Computer Science 2025-06-04 Jinyuan Luo , Zhen Fang , Yixuan Li , Seongheon Park , Ling Chen

Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA,…

Computation and Language · Computer Science 2023-10-24 Nick McKenna , Tianyi Li , Liang Cheng , Mohammad Javad Hosseini , Mark Johnson , Mark Steedman

Hallucinations in deployed language models can have real consequences for downstream decisions in domains such as healthcare, legal, and financial services. In production, detection has to run on what the deployed system can see: the query,…

Artificial Intelligence · Computer Science 2026-05-11 Javier Marín