English
Related papers

Related papers: Locate-then-Sparsify: Attribution Guided Sparse St…

200 papers

Recent advances in large language models (LLMs) promise more effective information extraction for review-based recommender systems, yet current methods still (i) mine free-form reviews without scope control, producing redundant and noisy…

Machine Learning · Computer Science 2025-11-05 Zheng Nie , Peijie Sun

Large Language Models suffer from hallucination, generating plausible yet factually incorrect content. Current mitigation strategies focus on post-generation correction, which is computationally expensive and fails to prevent unreliable…

Computation and Language · Computer Science 2025-10-03 Nandakishor M

Large Language Models (LLMs) exhibit impressive capabilities but often hallucinate, confidently providing incorrect answers instead of admitting ignorance. Prior work has shown that models encode linear representations of their own…

Computation and Language · Computer Science 2025-12-09 Wannan , Yang , Xinchi Qiu , Lei Yu , Yuchen Zhang , Aobo Yang , Narine Kokhlikyan , Nicola Cancedda , Diego Garcia-Olano

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal understanding capabilities, yet they remain prone to object hallucination, where models describe non-existent objects or attribute incorrect factual information,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ahmed Akl , Abdelwahed Khamis , Ali Cheraghian , Zhe Wang , Sara Khalifa , Kewen Wang

Large language models (LLMs) have garnered significant interest in AI community. Despite their impressive generation capabilities, they have been found to produce misleading or fabricated information, a phenomenon known as hallucinations.…

Machine Learning · Computer Science 2025-10-21 Wenyun Li , Zheng Zhang , Dongmei Jiang , Xiangyuan Lan

Multilingual Large Language Models (LLMs) often exhibit hallucinations such as unintended code-switching, reducing reliability in downstream tasks. We propose latent-space language steering, a lightweight inference-time method that…

Computation and Language · Computer Science 2026-04-16 Andrey Goncharov , Nikolai Kondusov , Alexey Zaytsev

Factual hallucination remains a central challenge for large language models (LLMs). Existing mitigation approaches primarily rely on either external post-hoc verification or mapping uncertainty directly to abstention during fine-tuning,…

Artificial Intelligence · Computer Science 2026-02-03 Enes Altinisik , Masoomali Fatehkia , Fatih Deniz , Nadir Durrani , Majd Hawasly , Mohammad Raza , Husrev Taha Sencar

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

Machine Learning · Computer Science 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Alignment is a standard procedure to fine-tune pre-trained large language models (LLMs) to follow natural language instructions and serve as helpful AI assistants. We have observed, however, that the conventional alignment process fails to…

Computation and Language · Computer Science 2024-05-03 Sheng-Chieh Lin , Luyu Gao , Barlas Oguz , Wenhan Xiong , Jimmy Lin , Wen-tau Yih , Xilun Chen

In Text-to-SQL generation, large language models (LLMs) have shown strong generalization and adaptability. However, LLMs sometimes generate hallucinations, i.e.,unrealistic or illogical content, which leads to incorrect SQL queries and…

Software Engineering · Computer Science 2025-12-30 Bo Yang , Yinfen Xia , Weisong Sun , Yang Liu

Hallucination is a common problem for Large Vision-Language Models (LVLMs) with long generations which is difficult to eradicate. The generation with hallucinations is partially inconsistent with the image content. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yue Chang , Liqiang Jing , Xiaopeng Zhang , Yue Zhang

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Multimodal large language models (MLLMs) have achieved remarkable progress, yet the object hallucination remains a critical challenge for reliable deployment. In this paper, we present an in-depth analysis of instruction token embeddings…

Machine Learning · Computer Science 2026-05-13 Runhe Lai , Xinhua Lu , Yanqi Wu , Jinlun Ye , Weijiang Yu , Ruixuan Wang

Despite the rapid success of Large Vision-Language Models (LVLMs), a persistent challenge is their tendency to generate hallucinated content, undermining reliability in real-world use. Existing training-free methods address hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Neeraj Anand , Samyak Jha , Udbhav Bamba , Rahul Rahaman

Semi-structured sparsity provides a practical path to accelerate large language models (LLMs) with native hardware support, but post-training semi-structured pruning often suffers from substantial quality degradation due to strong…

Machine Learning · Computer Science 2026-05-08 Liu Hanzuo , Chaofan Lin , Weixuan Sun , Yulong Wang , Key , Rayying , Mingyu Gao

Large vision-language models (VLMs) frequently suffer from hallucinations, generating content that is inconsistent with visual inputs. Existing methods typically address this problem through post-hoc filtering, additional training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tripti Shukla , Zsolt Kira

Automated radiology report generation using vision-language models (VLMs) is limited by the risk of prior-comparison hallucination, where the model generates historical findings unsupported by the current study. We address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ao Li , Rui Liu , Mingjie Li , Sheng Liu , Lei Wang , Xiaodan Liang , Lina Yao , Xiaojun Chang , Lei Xing

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe

Large Language Model (LLM) hallucination is a significant barrier to their reliable deployment. Current methods like Retrieval-Augmented Generation (RAG) are often reactive. We introduce **Dynamic Self-reinforcing Calibration for…

Computation and Language · Computer Science 2025-09-18 Xiao Zheng