English
Related papers

Related papers: TRACE: Trajectory Correction from Cross-layer Evid…

200 papers

Retrieval-Augmented Generation (RAG) models are critically undermined by citation hallucinations, a deceptive failure where a model cites a source that fails to support its claim. While existing work attributes hallucination to a simple…

Computation and Language · Computer Science 2026-03-31 Maxime Dassen , Rebecca Kotula , Kenton Murray , Andrew Yates , Dawn Lawrie , Efsun Kayi , James Mayfield , Kevin Duh

Vision-Language Models (VLMs) frequently "hallucinate" - generate plausible yet factually incorrect statements - posing a critical barrier to their trustworthy deployment. In this work, we propose a new paradigm for diagnosing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lexiang Xiong , Qi Li , Jingwen Ye , Xinchao Wang

Multi-hop Knowledge Graph Question Answering (KGQA) requires coherent reasoning across relational paths, yet existing methods often treat each reasoning step independently and fail to effectively leverage experience from prior explorations,…

Computation and Language · Computer Science 2026-04-14 Yingxu Wang , Jiaxin Huang , Mengzhu Wang , Nan Yin

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

In the context of multi-step reasoning, e.g., with chain-of-thought, language models (LMs) can easily assign a high likelihood to incorrect steps. As a result, decoding strategies that optimize for solution likelihood often yield incorrect…

Computation and Language · Computer Science 2026-01-06 Muhammad Khalifa , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Lu Wang

This paper presents the technical solution developed by team CRUISE for the KDD Cup 2025 Meta Comprehensive RAG Benchmark for Multi-modal, Multi-turn (CRAG-MM) challenge. The challenge aims to address a critical limitation of modern Vision…

Computation and Language · Computer Science 2026-01-21 Baiyu Chen , Wilson Wongso , Xiaoqian Hu , Yue Tan , Flora Salim

Trajectory similarity measures act as query predicates in trajectory databases, making them the key player in determining the query results. They also have a heavy impact on the query efficiency. An ideal measure should have the capability…

Databases · Computer Science 2023-02-21 Yanchuan Chang , Jianzhong Qi , Yuxuan Liang , Egemen Tanin

Recent studies on hallucination detection have shown that hallucination-related signals are more strongly encoded in intermediate layers than in the final layer of large language models (LLMs). Although a growing body of work has sought to…

Artificial Intelligence · Computer Science 2026-05-29 Xinpeng Wang , William Cao , Andrew Gordon Wilson , Zhe Zeng

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Refusal-Aware Instruction Tuning (RAIT) aims to enhance Large Language Models (LLMs) by improving their ability to refuse responses to questions beyond their knowledge, thereby reducing hallucinations and improving reliability. Effective…

Computation and Language · Computer Science 2025-02-11 Runchuan Zhu , Zinco Jiang , Jiang Wu , Zhipeng Ma , Jiahe Song , Fengshuo Bai , Dahua Lin , Lijun Wu , Conghui He

Language models can use verifiable rewards to improve at a wide variety of reasoning tasks. However, both parametric (e.g. RLVR) and non-parametric (e.g. prompt optimization) approaches to doing so typically require hundreds of training…

Artificial Intelligence · Computer Science 2026-05-28 Linas Nasvytis , Simon Jerome Han , Ben Prystawski , Satchel Grant , Noah D. Goodman , Judith E. Fan

Delayed feedback poses a core challenge for online CVR prediction, forcing a trade-off between label accuracy and data freshness. Existing methods address this through delay modeling or sample reweighting, yet neglect how post-click…

Machine Learning · Computer Science 2026-04-28 Xinyue Zhang , Yuanhao Ding , Xiang Ao

Large Language Models (LLMs) often generate incorrect or unsupported content, known as hallucinations. Existing detection methods rely on heuristics or simple models over isolated computational traces such as activations, or attention maps.…

Machine Learning · Computer Science 2025-09-30 Fabrizio Frasca , Guy Bar-Shalom , Yftah Ziser , Haggai Maron

Hallucinations in LLMs present a critical barrier to their reliable usage. Existing research usually categorizes hallucination by their external properties rather than by the LLMs' underlying internal properties. This external focus…

Computation and Language · Computer Science 2025-10-29 Adi Simhi , Jonathan Herzig , Itay Itzhak , Dana Arad , Zorik Gekhman , Roi Reichart , Fazl Barez , Gabriel Stanovsky , Idan Szpektor , Yonatan Belinkov

This paper presents new methods that have the potential to improve privacy process efficiency with LLM and RAG. To reduce hallucination, we continually pre-train the base LLM model with a privacy-specific knowledge base and then augment it…

Large language models (LLMs) have demonstrated limitations in handling combinatorial optimization problems involving long-range reasoning, partially due to causal hallucinations and huge search space. As for causal hallucinations, i.e., the…

Artificial Intelligence · Computer Science 2024-10-03 Kangsheng Wang , Xiao Zhang , Hao Liu , Songde Han , Huimin Ma , Tianyu Hu

Hallucinations in Large Language Models (LLMs) pose a major barrier to their reliable use in critical decision-making. Although existing hallucination detection methods have improved accuracy, they still struggle with disentangling semantic…

Computation and Language · Computer Science 2026-04-02 Junjie Hu , Gang Tu , ShengYu Cheng , Jinxin Li , Jinting Wang , Rui Chen , Zhilong Zhou , Dongbo Shan

Hallucinations in medical large language models (LLMs) remain a safety-critical issue, particularly when available evidence is insufficient or conflicting. We study this problem in diabetic retinopathy (DR) decision settings and introduce…

Artificial Intelligence · Computer Science 2026-04-08 Zhe Yu , Wenpeng Xing , Meng Han

We introduce TRACE, a cross-domain engineering framework for trustworthy agentic AI in operationally critical domains. TRACE combines a four-layer reference architecture with an explicit classical-ML vs. LLM-validator split (L2a/L2b), a…

Computation and Language · Computer Science 2026-05-06 Serhii Zabolotnii