English
Related papers

Related papers: Mitigating Hallucinations via Inter-Layer Consiste…

200 papers

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

Machine Learning · Computer Science 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

Multimodal Large Language Models frequently suffer from inference hallucinations, partially stemming from language priors dominating visual evidence. Existing training-free mitigation methods either perturb the visual representation and…

Computation and Language · Computer Science 2026-04-15 Sihang Jia , Shuliang Liu , Songbo Yang , Yibo Yan , Xin Zou , Xuming Hu

While Large Vision-Language Models (LVLMs) have rapidly advanced in recent years, the prevalent issue known as the `hallucination' problem has emerged as a significant bottleneck, hindering their real-world deployments. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Fushuo Huo , Wenchao Xu , Zhong Zhang , Haozhao Wang , Zhicheng Chen , Peilin Zhao

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has…

Computation and Language · Computer Science 2024-07-23 Weihang Su , Yichen Tang , Qingyao Ai , Changyue Wang , Zhijing Wu , Yiqun Liu

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Hallucination, posed as a pervasive challenge of multi-modal large language models (MLLMs), has significantly impeded their real-world usage that demands precise judgment. Existing methods mitigate this issue with either training with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Qidong Huang , Xiaoyi Dong , Pan Zhang , Bin Wang , Conghui He , Jiaqi Wang , Dahua Lin , Weiming Zhang , Nenghai Yu

Despite significant advancements in Vision-Language Models (VLMs), the performance of existing VLMs remains hindered by object hallucination, a critical challenge to achieving accurate visual understanding. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Woohyeon Park , Woojin Kim , Jaeik Kim , Jaeyoung Do

Large vision-language models (LVLMs) have made substantial progress in integrating large language models (LLMs) with visual inputs, enabling advanced multimodal reasoning. Despite their success, a persistent challenge is hallucination-where…

Computation and Language · Computer Science 2025-06-11 Jinghan He , Kuan Zhu , Haiyun Guo , Junfeng Fang , Zhenglin Hua , Yuheng Jia , Ming Tang , Tat-Seng Chua , Jinqiao Wang

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Large Vision-Language Models (LVLMs) have obtained impressive performance in visual content understanding and multi-modal reasoning. Unfortunately, these large models suffer from serious hallucination problems and tend to generate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wei Suo , Lijun Zhang , Mengyang Sun , Lin Yuanbo Wu , Peng Wang , Yanning Zhang

Hallucination remains one of the key obstacles to the reliable deployment of large language models (LLMs), particularly in real-world applications. Among various mitigation strategies, Retrieval-Augmented Generation (RAG) and reasoning…

Computation and Language · Computer Science 2025-10-29 Yihan Li , Xiyuan Fu , Ghanshyam Verma , Paul Buitelaar , Mingming Liu

With the large-scale adoption of Large Language Models (LLMs) in various applications, there is a growing reliability concern due to their tendency to generate inaccurate text, i.e. hallucinations. In this work, we propose Cross-Layer…

Computation and Language · Computer Science 2025-09-15 Malavika Suresh , Rahaf Aljundi , Ikechukwu Nkisi-Orji , Nirmalie Wiratunga

Code generation aims to automatically generate code from input requirements, significantly enhancing development efficiency. Recent large language models (LLMs) based approaches have shown promising results and revolutionized code…

Software Engineering · Computer Science 2025-01-20 Ziyao Zhang , Yanlin Wang , Chong Wang , Jiachi Chen , Zibin Zheng

Despite their powerful chat, coding, and reasoning abilities, Large Language Models (LLMs) frequently hallucinate. Conventional wisdom suggests that hallucinations are a consequence of a balance between creativity and factuality, which can…

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Large language models (LLMs) have demonstrated impressive performance in both research and real-world applications, but they still struggle with hallucination. Existing hallucination detection methods often perform poorly on sentence-level…

Computation and Language · Computer Science 2025-09-01 Weizhi Gao , Xiaorui Liu , Feiyi Wang , Dan Lu , Junqi Yin

Despite their remarkable progress in multimodal understanding tasks, large vision language models (LVLMs) often suffer from "hallucinations", generating texts misaligned with the visual context. Existing methods aimed at reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Sreetama Sarkar , Yue Che , Alex Gavin , Peter A. Beerel , Souvik Kundu

Recent advancements in multimodal large language models (MLLMs) have significantly improved performance in visual question answering. However, they often suffer from hallucinations. In this work, hallucinations are categorized into two main…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Feilong Tang , Chengzhi Liu , Zhongxing Xu , Ming Hu , Zelin Peng , Zhiwei Yang , Jionglong Su , Minquan Lin , Yifan Peng , Xuelian Cheng , Imran Razzak , Zongyuan Ge

Hallucinations in Large Vision-Language Models (LVLMs) pose significant security and reliability risks in real-world applications. Inspired by the observation that humans are more error-prone when uncertain or hesitant, we investigate how…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Zhaoxu Li , Chenqi Kong , Peijun Bao , Song Xia , Yi Tu , Yi Yu , Xinghao Jiang , Xudong Jiang

Large Vision-Language Models (LVLMs) demonstrate significant progress in multimodal understanding and reasoning, yet object hallucination remains a critical challenge. While existing research focuses on mitigating language priors or…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yuxuan Xia , Siheng Wang , Peng Li