English
Related papers

Related papers: DoLa: Decoding by Contrasting Layers Improves Fact…

200 papers

Multilingual Large Language Models(MLLMs) demonstrate strong generalization across languages, yet they remain prone to hallucinations, especially in low-resource languages, due to training data imbalances. These hallucinations, which…

Computation and Language · Computer Science 2025-07-22 Weihua Zheng , Roy Ka-Wei Lee , Zhengyuan Liu , Kui Wu , AiTi Aw , Bowei Zou

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

This paper introduces KnowHalu, a novel approach for detecting hallucinations in text generated by large language models (LLMs), utilizing step-wise reasoning, multi-formulation query, multi-form knowledge for factual checking, and…

Computation and Language · Computer Science 2024-04-05 Jiawei Zhang , Chejian Xu , Yu Gai , Freddy Lecue , Dawn Song , Bo Li

The widespread adoption and transformative effects of large language models (LLMs) have sparked concerns regarding their capacity to produce inaccurate and fictitious content, referred to as `hallucinations'. Given the potential risks…

Human-Computer Interaction · Computer Science 2024-08-13 Mahjabin Nahar , Haeseung Seo , Eun-Ju Lee , Aiping Xiong , Dongwon Lee

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

The rise of Large Language Models (LLMs) has significantly advanced various applications on software engineering tasks, particularly in code generation. Despite the promising performance, LLMs are prone to generate hallucinations, which…

Software Engineering · Computer Science 2026-01-22 Fang Liu , Yang Liu , Lin Shi , Zhen Yang , Li Zhang , Xiaoli Lian , Zhongqi Li , Yuchi Ma

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Despite the recent progress in news summarization made by large language models (LLMs), they often generate summaries that are factually inconsistent with original articles, known as "hallucinations" in text generation. Unlike previous…

Computation and Language · Computer Science 2025-02-17 Huawen Feng , Yan Fan , Xiong Liu , Ting-En Lin , Zekun Yao , Yuchuan Wu , Fei Huang , Yongbin Li , Qianli Ma

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

Computation and Language · Computer Science 2025-12-25 Shize Liang , Hongzhi Wang

Recent Large Vision-Language Models (LVLMs) have introduced a new paradigm for understanding and reasoning about image input through textual responses. Although they have achieved remarkable performance across a range of multi-modal tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zifu Wan , Ce Zhang , Silong Yong , Martin Q. Ma , Simon Stepputtis , Louis-Philippe Morency , Deva Ramanan , Katia Sycara , Yaqi Xie

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Large language models (LLMs) face the challenge of hallucinations -- outputs that seem coherent but are actually incorrect. A particularly damaging type is fact-conflicting hallucination (FCH), where generated content contradicts…

Computation and Language · Computer Science 2025-02-20 Ningke Li , Yahui Song , Kailong Wang , Yuekang Li , Ling Shi , Yi Liu , Haoyu Wang

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

The prevalence of unwarranted beliefs, spanning pseudoscience, logical fallacies, and conspiracy theories, presents substantial societal hurdles and the risk of disseminating misinformation. Utilizing established psychometric assessments,…

Artificial Intelligence · Computer Science 2024-05-03 Sowmya S Sundaram , Balaji Alwar

Reasoning Large Language Models (R-LLMs) have significantly advanced complex reasoning tasks but often struggle with factuality, generating substantially more hallucinations than their non-reasoning counterparts on long-form factuality…

Computation and Language · Computer Science 2025-08-08 Xilun Chen , Ilia Kulikov , Vincent-Pierre Berges , Barlas Oğuz , Rulin Shao , Gargi Ghosh , Jason Weston , Wen-tau Yih

While large language models (LLMs) have demonstrated exceptional performance across various tasks following human alignment, they may still generate responses that sound plausible but contradict factual knowledge, a phenomenon known as…

Computation and Language · Computer Science 2024-09-24 Fanqi Wan , Xinting Huang , Leyang Cui , Xiaojun Quan , Wei Bi , Shuming Shi

Despite the great success of Large Vision-Language Models (LVLMs), they inevitably suffer from hallucination. As we know, both the visual encoder and the Large Language Model (LLM) decoder in LVLMs are Transformer-based, allowing the model…

Computation and Language · Computer Science 2025-11-07 Xuan Gong , Tianshi Ming , Xinpeng Wang , Zhihua Wei

Large Language Models (LLMs) have demonstrated exceptional capabilities across various machine learning (ML) tasks. Given the high costs of creating annotated datasets for supervised learning, LLMs offer a valuable alternative by enabling…

Computation and Language · Computer Science 2024-08-23 Meiyun Wang , Masahiro Suzuki , Hiroki Sakaji , Kiyoshi Izumi

Large Language Models (LLMs) frequently hallucinate, limiting their reliability in critical applications. Conformal Prediction (CP) addresses this by calibrating error rates on held-out data to provide statistically valid confidence…

Machine Learning · Computer Science 2026-04-23 Nathan Hittesdorf , Marco Salzetta , Lu Cheng

Large Language Models (LLMs) have significantly advanced communications fields, such as Telecom Q\&A, mathematical modeling, and coding. However, LLMs encounter an inherent issue known as hallucination, i.e., generating fact-conflicting or…

Networking and Internet Architecture · Computer Science 2024-12-10 Yinqiu Liu , Guangyuan Liu , Ruichen Zhang , Dusit Niyato , Zehui Xiong , Dong In Kim , Kaibin Huang , Hongyang Du