English
Related papers

Related papers: Rethinking Hallucinations: Correctness, Consistenc…

200 papers

As Large Language Models become more ubiquitous across domains, it becomes important to examine their inherent limitations critically. This work argues that hallucinations in language models are not just occasional errors but an inevitable…

Machine Learning · Statistics 2024-09-10 Sourav Banerjee , Ayushi Agarwal , Saloni Singla

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

Machine Learning · Computer Science 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Code generation aims to automatically generate code from input requirements, significantly enhancing development efficiency. Recent large language models (LLMs) based approaches have shown promising results and revolutionized code…

Software Engineering · Computer Science 2025-01-20 Ziyao Zhang , Yanlin Wang , Chong Wang , Jiachi Chen , Zibin Zheng

With the widespread adoption of large language models (LLMs), hallucinations, which are non-factual fabrications in model outputs, have become serious concerns. Reasoning capabilities have received attention as a self-verification process…

Computation and Language · Computer Science 2026-01-06 Junichiro Niimi

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Hallucination in large language models (LLMs) has been widely studied in recent years, with progress in both detection and mitigation aimed at improving truthfulness. Yet, a critical side effect remains largely overlooked: enhancing…

Computation and Language · Computer Science 2026-02-02 Omar Mahmoud , Ali Khalil , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

Do large language models (LLMs) know the law? These models are increasingly being used to augment legal practice, education, and research, yet their revolutionary potential is threatened by the presence of hallucinations -- textual output…

Computation and Language · Computer Science 2024-08-09 Matthew Dahl , Varun Magesh , Mirac Suzgun , Daniel E. Ho

Hallucination, i.e., generating factually incorrect content, remains a critical challenge for large language models (LLMs). We introduce TOHA, a TOpology-based HAllucination detector in the RAG setting, which leverages a topological…

Hallucinations, defined as instances where Large Language Models (LLMs) generate false or misleading content, pose a significant challenge that impacts the safety and trust of downstream applications. We introduce UQLM, a Python package for…

Computation and Language · Computer Science 2026-03-05 Dylan Bouchard , Mohit Singh Chauhan , David Skarbrevik , Ho-Kyeong Ra , Viren Bajaj , Zeya Ahmad

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

Machine Learning · Computer Science 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

Large Language Models (LLMs) are widely used in critical fields such as healthcare, education, and finance due to their remarkable proficiency in various language-related tasks. However, LLMs are prone to generating factually incorrect…

Computation and Language · Computer Science 2023-11-27 Muneeswaran I , Shreya Saxena , Siva Prasad , M V Sai Prakash , Advaith Shankar , Varun V , Vishal Vaddina , Saisubramaniam Gopalakrishnan

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

Computation and Language · Computer Science 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

Computers and Society · Computer Science 2025-09-23 Richard Ackermann , Simeon Emanuilov

Large language models are increasingly being used in patient-facing medical question answering, where hallucinated outputs can vary widely in potential harm. However, existing hallucination standards and evaluation metrics focus primarily…

Computation and Language · Computer Science 2026-03-02 Savan Doshi

Hallucinations pose critical risks for large language model (LLM)-based agents, often manifesting as hallucinative actions resulting from fabricated or misinterpreted information within the cognitive context. While recent studies have…

Artificial Intelligence · Computer Science 2025-07-29 Weichen Zhang , Yiyou Sun , Pohao Huang , Jiayue Pu , Heyue Lin , Dawn Song

The rapid advancement of large language models (LLMs) has transformed the landscape of natural language processing, enabling breakthroughs across a wide range of areas including question answering, machine translation, and text…

Computation and Language · Computer Science 2025-10-15 Sungmin Kang , Yavuz Faruk Bakman , Duygu Nur Yaldiz , Baturalp Buyukates , Salman Avestimehr

Recently, 3D-LLMs, which combine point-cloud encoders with large models, have been proposed to tackle complex tasks in embodied intelligence and scene understanding. In addition to showing promising results on 3D tasks, we found that they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Ruiying Peng , Kaiyuan Li , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Hallucinations in LLMs present a critical barrier to their reliable usage. Existing research usually categorizes hallucination by their external properties rather than by the LLMs' underlying internal properties. This external focus…

Computation and Language · Computer Science 2025-10-29 Adi Simhi , Jonathan Herzig , Itay Itzhak , Dana Arad , Zorik Gekhman , Roi Reichart , Fazl Barez , Gabriel Stanovsky , Idan Szpektor , Yonatan Belinkov

Large language models (LLMs) like ChatGPT demonstrate the remarkable progress of artificial intelligence. However, their tendency to hallucinate -- generate plausible but false information -- poses a significant challenge. This issue is…

Computation and Language · Computer Science 2024-06-13 Philip Feldman , James R. Foulds , Shimei Pan