English
Related papers

Related papers: Hallucination as output-boundary misclassification…

200 papers

Contextual hallucinations -- statements unsupported by given context -- remain a significant challenge in AI. We demonstrate a practical interpretability insight: a generator-agnostic observer model detects hallucinations via a single…

Machine Learning · Computer Science 2025-08-01 Charles O'Neill , Slava Chalnev , Chi Chi Zhao , Max Kirkby , Mudith Jayasekara

The ability of language models in RAG systems to selectively refuse to answer based on flawed context is critical for safety, yet remains a significant failure point. Our large-scale study reveals that even frontier models struggle in this…

Computation and Language · Computer Science 2025-10-14 Aashiq Muhamed , Leonardo F. R. Ribeiro , Markus Dreyer , Virginia Smith , Mona T. Diab

While GPT-4V(ision) impressively models both visual and textual information simultaneously, it's hallucination behavior has not been systematically assessed. To bridge this gap, we introduce a new benchmark, namely, the Bias and…

Machine Learning · Computer Science 2023-11-08 Chenhang Cui , Yiyang Zhou , Xinyu Yang , Shirley Wu , Linjun Zhang , James Zou , Huaxiu Yao

Large language models are increasingly being used in patient-facing medical question answering, where hallucinated outputs can vary widely in potential harm. However, existing hallucination standards and evaluation metrics focus primarily…

Computation and Language · Computer Science 2026-03-02 Savan Doshi

Addressing the issue of hallucinations in large language models (LLMs) is a critical challenge. As the cognitive mechanisms of hallucination have been related to memory, here we explore hallucination for LLM that is enabled with explicit…

Computation and Language · Computer Science 2024-07-25 Georgios Kollias , Payel Das , Subhajit Chaudhury

We show for invertible problems that transform data from a source domain (for example, Logic Condition Tables (LCTs)) to a destination domain (for example, Hardware Description Language (HDL) code), an approach of using Large Language…

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

Computation and Language · Computer Science 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

Computation and Language · Computer Science 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

Computation and Language · Computer Science 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

We localize the policy routing mechanism in alignment-trained language models. An intermediate-layer attention gate reads detected content and triggers deeper amplifier heads that boost the signal toward refusal. In smaller models the gate…

Computation and Language · Computer Science 2026-05-04 Gregory N. Frank

Large language models (LLMs) rarely admit uncertainty, often producing fluent but misleading answers, rather than abstaining (i.e., refusing to answer). This weakness is even evident in temporal question answering, where models frequently…

Computation and Language · Computer Science 2026-03-05 Xinyu Zhou , Chang Jin , Carsten Eickhoff , Zhijiang Guo , Seyed Ali Bahrainian

This paper investigates false positive constructions: grammatical structures which an LLM hallucinates as distinct constructions but which human introspection does not support. Both a behavioural probing task using contextual embeddings and…

Computation and Language · Computer Science 2025-08-26 Jonathan Dunn , Mai Mohamed Eida

Hallucinations in LLMs present a critical barrier to their reliable usage. Existing research usually categorizes hallucination by their external properties rather than by the LLMs' underlying internal properties. This external focus…

Computation and Language · Computer Science 2025-10-29 Adi Simhi , Jonathan Herzig , Itay Itzhak , Dana Arad , Zorik Gekhman , Roi Reichart , Fazl Barez , Gabriel Stanovsky , Idan Szpektor , Yonatan Belinkov

Large language models (LLMs) often generate hallucinations -- unsupported content that undermines reliability. While most prior works frame hallucination detection as a binary task, many real-world applications require identifying…

Large Language Models (LLMs) are powerful linguistic engines but remain susceptible to hallucinations: plausible-sounding outputs that are factually incorrect or unsupported. In this work, we present a mathematically grounded framework to…

Computation and Language · Computer Science 2025-11-20 Moses Kiprono

Multimodal Chain-of-Thought (MCoT) models have demonstrated impressive capability in complex visual reasoning tasks. Unfortunately, recent studies reveal that they suffer from severe hallucination problems due to diminished visual attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang

We propose a geometric taxonomy of large language model hallucinations based on observable signatures in token embedding cluster structure. By analyzing the static embedding spaces of 11 transformer models spanning encoder (BERT, RoBERTa,…

Computation and Language · Computer Science 2026-02-17 Matic Korun

Prompt-based verification is widely used to mitigate hallucinations in large vision-language models (LVLMs), yet when it helps remains poorly understood. We systematically study verification prompting across two representative LVLM…

Computation and Language · Computer Science 2026-05-28 Yuang Huang , Yafeng Zhang , Yu Zilan

Hallucination remains a central failure mode of large language models, but existing benchmarks operationalize it inconsistently across summarization, question answering, retrieval-augmented generation, and agentic interaction. This…

Computation and Language · Computer Science 2026-05-20 Emmy Liu , Varun Gangal , Michael Yu , Zhuofu Tao , Karan Singh , Sachin Kumar , Steven Y. Feng

LLM-based autonomous research agents report false claims: tasks marked "complete" despite missing artifacts, contradictory metrics, or failed executions. EviBound is an evidence-bound execution framework that eliminates false claims through…

Artificial Intelligence · Computer Science 2025-11-11 Ruiying Chen