English
Related papers

Related papers: Generation Constraint Scaling Can Mitigate Halluci…

200 papers

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Recent research on query generation has focused on using Large Language Models (LLMs), which despite bringing state-of-the-art performance, also introduce issues with hallucinations in the generated queries. In this work, we introduce…

Computation and Language · Computer Science 2024-10-16 Zhongxiang Sun , Zihua Si , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu

Despite the remarkable performance of generative large language models (LLMs) on abstractive summarization, they face two significant challenges: their considerable size and tendency to hallucinate. Hallucinations are concerning because…

Computation and Language · Computer Science 2024-10-28 George Chrysostomou , Zhixue Zhao , Miles Williams , Nikolaos Aletras

Large Vision-Language Models (LVLMs) usually generate texts which satisfy context coherence but don't match the visual input. Such a hallucination issue hinders LVLMs' applicability in the real world. The key to solving hallucination in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Nanxing Hu , Xiaoyue Duan , Jinchao Zhang , Guoliang Kang

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Computation and Language · Computer Science 2026-01-22 Mohor Banerjee , Nadya Yuki Wangsajaya , Syed Ali Redha Alsagoff , Min Sen Tan , Zachary Choy Kit Chun , Alvin Chan Guo Wei

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

The rise of Large Language Models (LLMs) has significantly advanced various applications on software engineering tasks, particularly in code generation. Despite the promising performance, LLMs are prone to generate hallucinations, which…

Software Engineering · Computer Science 2026-01-22 Fang Liu , Yang Liu , Lin Shi , Zhen Yang , Li Zhang , Xiaoli Lian , Zhongqi Li , Yuchi Ma

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

Machine Learning · Computer Science 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Recent technical breakthroughs in large language models (LLMs) have enabled them to fluently generate source code. Software developers often leverage both general-purpose and code-specialized LLMs to revise existing code or even generate a…

Software Engineering · Computer Science 2025-05-14 Yunseo Lee , John Youngeun Song , Dongsun Kim , Jindae Kim , Mijung Kim , Jaechang Nam

Large Language Models (LLMs) are powerful computational models trained on extensive corpora of human-readable text, enabling them to perform general-purpose language understanding and generation. LLMs have garnered significant attention in…

Computation and Language · Computer Science 2024-10-28 Liam Barkley , Brink van der Merwe

Despite their impressive ability to generate high-quality and fluent text, generative large language models (LLMs) also produce hallucinations: statements that are misaligned with established world knowledge or provided input context.…

Computation and Language · Computer Science 2025-01-15 Abhilasha Ravichander , Shrusti Ghela , David Wadden , Yejin Choi

Large Vision-Language Models (LVLMs) exhibit powerful generative capabilities but frequently produce hallucinations that compromise output reliability. Fine-tuning on annotated data devoid of hallucinations offers the most direct solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xingyu Zhu , Junfeng Fang , Shuo Wang , Beier Zhu , Zhicai Wang , Yonghui Yang , Xiangnan He

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

Computation and Language · Computer Science 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Multimodal large language models (MLLMs) have achieved remarkable progress in video understanding.However, hallucination, where the model generates plausible yet incorrect outputs, persists as a significant and under-addressed challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jianfeng Cai , Wengang Zhou , Zongmeng Zhang , Jiale Hong , Nianji Zhan , Houqiang Li

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

Computation and Language · Computer Science 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

Computation and Language · Computer Science 2024-08-12 Avshalom Manevich , Reut Tsarfaty