English
Related papers

Related papers: Hallucination as Exploit: Evidence-Carrying Multim…

200 papers

Large Language Models (LLMs) are increasingly deployed as autonomous agents that reason, use tools, and act over multiple steps. Yet most hallucination benchmarks still evaluate only the final output, missing failures that originate in…

Artificial Intelligence · Computer Science 2026-05-27 Harshada Badave , Santosh Borse , Andrea Gomez , Harshitha Narahari , Sara Carter , Vishwa Bhatt , Aishani Rachakonda , Shuxin Lin , Dhaval Patel

While recent years have seen rapid progress in image-conditioned text generation, image captioning still suffers from the fundamental issue of hallucinations, namely, the generation of spurious details that cannot be inferred from the given…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Assaf Ben-Kish , Moran Yanuka , Morris Alper , Raja Giryes , Hadar Averbuch-Elor

Language models exhibit remarkable natural language generation capabilities but remain prone to hallucinations, generating factually incorrect information despite producing syntactically coherent responses. This study introduces the…

Computation and Language · Computer Science 2025-11-11 Simeon Emanuilov , Richard Ackermann

Multi-implementation systems are increasingly audited against natural-language specifications. Differential testing scales well when implementations disagree, but it provides little signal when all implementations converge on the same…

Cryptography and Security · Computer Science 2026-02-11 Masato Kamba , Akiyoshi Sannai

LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce unacceptable risks where errors carry legal, financial, or safety consequences. This paper…

Artificial Intelligence · Computer Science 2026-05-27 Paul Sigloch , Christoph Benzmüller

Legal practice has witnessed a sharp rise in products incorporating artificial intelligence (AI). Such tools are designed to assist with a wide range of core legal tasks, from search and summarization of caselaw to document drafting. But…

Computation and Language · Computer Science 2024-06-03 Varun Magesh , Faiz Surani , Matthew Dahl , Mirac Suzgun , Christopher D. Manning , Daniel E. Ho

Generative AI increasingly supports scientific inference, from protein structure prediction to weather forecasting. Yet its distinctive failure mode, hallucination, raises epistemic alarm bells. I argue that this failure mode can be…

Computers and Society · Computer Science 2026-01-14 Charles Rathkopf

With the advent of rich visual representations and pre-trained language models, video captioning has seen continuous improvement over time. Despite the performance improvement, video captioning models are prone to hallucination.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Nasib Ullah , Partha Pratim Mohanta

As LLM-based agents operate over sequential multi-step reasoning, hallucinations arising at intermediate steps risk propagating along the trajectory, thus degrading overall reliability. Unlike hallucination detection in single-turn…

Computation and Language · Computer Science 2026-01-13 Xuannan Liu , Xiao Yang , Zekun Li , Peipei Li , Ran He

Hallucination remains a critical challenge in large language models (LLMs), hindering the development of reliable multimodal LLMs (MLLMs). Existing solutions often rely on human intervention or underutilize the agent's ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zhongyu Yang , Yingfang Yuan , Xuanming Jiang , Baoyi An , Wei Pang

We present a novel approach for claim verification from tabular data documents. Recent LLM-based approaches either employ complex pretraining/fine-tuning or decompose verification into subtasks, often lacking comprehensive explanations and…

Computation and Language · Computer Science 2026-04-21 Rudra Ranajee Saha , Laks V. S. Lakshmanan , Raymond T. Ng

Large language models (LLMs) produce fluent but unsupported answers - hallucinations - limiting safe deployment in high-stakes domains. We propose ECLIPSE, a framework that treats hallucination as a mismatch between a model's semantic…

Machine Learning · Computer Science 2025-12-04 Mainak Singha

Large language models can follow complex procedures yet fail at a seemingly trivial final step: reporting a value they themselves computed moments earlier. We study this phenomenon as \emph{procedural hallucination}: failure to execute a…

Machine Learning · Statistics 2026-02-24 Ahmed Karim , Fatima Sheaib , Zein Khamis , Maggie Chlon , Jad Awada , Leon Chlon

OpenAI has recently argued that hallucinations in large language models result primarily from misaligned evaluation incentives that reward confident guessing rather than epistemic humility. On this view, hallucination is a contingent…

Computation and Language · Computer Science 2025-12-18 Richard Ackermann , Simeon Emanuilov

Large Language Models (LLMs) have shown remarkable capabilities in tool calling and tool usage, but suffer from hallucinations where they choose incorrect tools, provide malformed parameters and exhibit 'tool bypass' behavior by performing…

Artificial Intelligence · Computer Science 2026-01-09 Kait Healy , Bharathi Srinivasan , Visakh Madathil , Jing Wu

Hallucination continues to pose a major obstacle in the reasoning capabilities of large language models (LLMs). Although the Multi-Agent Debate (MAD) paradigm offers a promising solution by promoting consensus among multiple agents to…

Artificial Intelligence · Computer Science 2025-11-17 Dayong Liang , Xiao-Yong Wei , Changmeng Zheng

Agentic language models operate in a fundamentally different safety regime than chat models: they must plan, call tools, and execute long-horizon actions where a single misstep, such as accessing files or entering credentials, can cause…

Computation and Language · Computer Science 2026-03-04 Aradhye Agarwal , Gurdit Siyan , Yash Pandya , Joykirat Singh , Akshay Nambi , Ahmed Awadallah

Hallucinations, the tendency for large language models to provide responses with factually incorrect and unsupported claims, is a serious problem within natural language processing for which we do not yet have an effective solution to…

Computation and Language · Computer Science 2026-05-08 Brandon C. Colelough , Davis Bartels , Dina Demner-Fushman

Large language models often produce unsupported claims. We frame this as a misclassification error at the output boundary, where internally generated completions are emitted as if they were grounded in evidence. This motivates a composite…

Computation and Language · Computer Science 2026-04-09 Angelina Hintsanen

Empowered by large language models (LLMs), intelligent agents have become a popular paradigm for interacting with open environments to facilitate AI deployment. However, hallucinations generated by LLMs-where outputs are inconsistent with…

Machine Learning · Computer Science 2025-07-23 Siyuan Liu , Wenjing Liu , Zhiwei Xu , Xin Wang , Bo Chen , Tao Li