English
Related papers

Related papers: Beyond Accuracy: Rethinking Hallucination and Regu…

200 papers

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

While large language models (LLMs) have demonstrated remarkable capabilities across a range of downstream tasks, a significant concern revolves around their propensity to exhibit hallucinations: LLMs occasionally generate content that…

Computation and Language · Computer Science 2025-09-16 Yue Zhang , Yafu Li , Leyang Cui , Deng Cai , Lemao Liu , Tingchen Fu , Xinting Huang , Enbo Zhao , Yu Zhang , Chen Xu , Yulong Chen , Longyue Wang , Anh Tuan Luu , Wei Bi , Freda Shi , Shuming Shi

Robot Foundation Models, such as VLAs, promise end-to-end generative robot policies with broad generalization. Yet it remains unclear whether they fundamentally resolve the core problem of action generation in embodied settings, or overcome…

Robotics · Computer Science 2026-05-13 Harold Soh , Eugene Lim

Large language models (LLMs) are known to "hallucinate" by generating false or misleading outputs. Hallucinations pose various harms, from erosion of trust to widespread misinformation. Existing hallucination evaluation, however, focuses…

Machine Learning · Computer Science 2026-02-03 Prakhar Ganesh , Reza Shokri , Golnoosh Farnadi

We show that language models hallucinate not because they fail to detect uncertainty, but because of a failure to integrate it into output generation. Across architectures, uncertain inputs are reliably identified, occupying…

Artificial Intelligence · Computer Science 2026-03-17 Valeria Ruscio , Keiran Thompson

Generative AI is frequently portrayed as revolutionary or even apocalyptic, prompting calls for novel regulatory approaches. This essay argues that such views are misguided. Instead, generative AI should be understood as an evolutionary…

Computers and Society · Computer Science 2025-03-11 Gilad Abiri

Large Language Models (LLMs) exhibit remarkable capabilities in natural language understanding and reasoning, but suffer from hallucination: the generation of factually incorrect content. While numerous methods have been developed to reduce…

Computation and Language · Computer Science 2026-01-22 Mohor Banerjee , Nadya Yuki Wangsajaya , Syed Ali Redha Alsagoff , Min Sen Tan , Zachary Choy Kit Chun , Alvin Chan Guo Wei

Benchmarks measure whether a model is correct. They do not measure whether a model is reliable. This distinction is largely academic for single-shot inference, but becomes critical for agentic AI systems, where a single rephrased prompt can…

Machine Learning · Computer Science 2026-01-13 Aaron R. Flouro , Shawn P. Chadwick

Legal AI systems powered by retrieval-augmented generation (RAG) face a critical accountability challenge: when an AI assistant cites case law, statutes, or contractual clauses, practitioners need verifiable guarantees that generated text…

Machine Learning · Computer Science 2025-12-02 Valentin Noël , Elimane Yassine Seidou , Charly Ken Capo-Chichi , Ghanem Amari

Despite numerous attempts at mitigation since the inception of language models, hallucinations remain a persistent problem even in today's frontier LLMs. Why is this? We review existing definitions of hallucination and fold them into a…

Computation and Language · Computer Science 2026-02-04 Emmy Liu , Varun Gangal , Chelsea Zou , Michael Yu , Xiaoqi Huang , Alex Chang , Zhuofu Tao , Karan Singh , Sachin Kumar , Steven Y. Feng

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

We formalize hallucinations in generative models as failures to link an estimate to any plausible cause. Under this interpretation, we show that even loss-minimizing optimal estimators still hallucinate. We confirm this with a general high…

Machine Learning · Computer Science 2025-09-29 Hude Liu , Jerry Yao-Chieh Hu , Jennifer Yuntong Zhang , Zhao Song , Han Liu

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Hallucinations are outputs by Large Language Models (LLMs) that are factually incorrect yet appear plausible [1]. This paper investigates how such hallucinations influence users' trust in LLMs and users' interaction with LLMs. To explore…

Artificial Intelligence · Computer Science 2025-12-11 Adrian Ryser , Florian Allwein , Tim Schlippe

The performance of AI models on safety benchmarks does not indicate their real-world performance after deployment. This opaqueness of AI models impedes existing regulatory frameworks constituted on benchmark performance, leaving them…

Machine Learning · Computer Science 2025-12-16 Gabriel Stanovsky , Renana Keydar , Gadi Perl , Eliya Habba

Generative AI has made significant strides, yet concerns about the accuracy and reliability of its outputs continue to grow. Such inaccuracies can have serious consequences such as inaccurate decision-making, the spread of false…

Databases · Computer Science 2023-10-12 Nan Tang , Chenyu Yang , Ju Fan , Lei Cao , Yuyu Luo , Alon Halevy

With increasing awareness of the hallucination risks of generative artificial intelligence (AI), we see a growing shift toward providing information tooling to help users determine the veracity of AI-generated answers for themselves. User…

Human-Computer Interaction · Computer Science 2026-03-13 Jessica Irons , Patrick Cooper , Necva Bolucu , Roelien Timmer , Huichen Yang , Changhyun Lee , Brian Jin , Andreas Duenser , Stephen Wan

The troubling rise of hallucination presents perhaps the most significant impediment to the advancement of responsible AI. In recent times, considerable research has focused on detecting and mitigating hallucination in Large Language Models…

Artificial Intelligence · Computer Science 2024-04-02 Anku Rani , Vipula Rawte , Harshad Sharma , Neeraj Anand , Krishnav Rajbangshi , Amit Sheth , Amitava Das

Hallucinations are a type of output error produced by deep neural networks. While this has been studied in natural language processing, they have not been researched previously in automatic speech recognition. Here, we define hallucinations…

Computation and Language · Computer Science 2024-01-04 Rita Frieske , Bertram E. Shi

Generative AI can turn scientific articles into narratives for diverse audiences, but evaluating these stories remains challenging. Storytelling demands abstraction, simplification, and pedagogical creativity-qualities that are not often…

Computation and Language · Computer Science 2026-03-20 Alex Argese , Pasquale Lisena , Raphaël Troncy