English
Related papers

Related papers: Harnessing Reasoning Trajectories for Hallucinatio…

200 papers

Large Language Models (LLMs) have shown promising performance on diverse medical benchmarks, highlighting their potential in supporting real-world clinical tasks. Retrieval-Augmented Generation (RAG) has emerged as a key approach for…

Computation and Language · Computer Science 2025-09-30 Kaishuai Xu , Wenjun Hou , Yi Cheng , Wenjie Li

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Computation and Language · Computer Science 2025-03-12 Zonghao Ying , Deyue Zhang , Zonglei Jing , Yisong Xiao , Quanchen Zou , Aishan Liu , Siyuan Liang , Xiangzheng Zhang , Xianglong Liu , Dacheng Tao

We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a non-sensical or…

Automatic Speech Recognition (ASR) error correction aims to correct recognition errors while preserving accurate text. Although traditional approaches demonstrate moderate effectiveness, LLMs offer a paradigm that eliminates the need for…

Computation and Language · Computer Science 2025-12-24 Yangui Fang , Baixu Chen , Jing Peng , Xu Li , Yu Xi , Chengwei Zhang , Guohui Zhong

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

Computation and Language · Computer Science 2024-10-25 Aryo Pradipta Gema , Chen Jin , Ahmed Abdulaal , Tom Diethe , Philip Teare , Beatrice Alex , Pasquale Minervini , Amrutha Saseendran

Hallucination is a major concern in LLM-driven service systems, necessitating explicit knowledge grounding for compliance-guaranteed responses. In this paper, we introduce Retrieval-Augmented Learning-to-Match (RAL2M), a novel framework…

Computation and Language · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Jiangtao Wen , Zhiyang Su , Yawen Li , Yanjie Sun , Guan Wang , Chen Jason Zhang

Diffusion large language models (D-LLMs) have recently emerged as a promising alternative to auto-regressive LLMs (AR-LLMs). However, the hallucination problem in D-LLMs remains underexplored, limiting their reliability in real-world…

Computation and Language · Computer Science 2025-10-03 Shenxu Chang , Junchi Yu , Weixing Wang , Yongqiang Chen , Jialin Yu , Philip Torr , Jindong Gu

Large reasoning models (LRMs) achieve strong performance through extended reasoning traces, but they often exhibit overthinking behavior for low-complexity queries. Existing efforts to mitigate this issue are fundamentally limited by…

Machine Learning · Computer Science 2026-02-27 Zihang Xu , Haozhi Xie , Ziqi Miao , Wuxuan Gong , Chen Qian , Lijun Li

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

Computation and Language · Computer Science 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

Large Vision-Language Models (LVLMs) have achieved impressive performance in multimodal tasks, but they still suffer from hallucinations, i.e., generating content that is grammatically accurate but inconsistent with visual inputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Chenxi Li , Yichen Guo , Benfang Qian , Jinhao You , Kai Tang , Yaosong Du , Zonghao Zhang , Xiande Huang

Large language models (LLMs) exhibit extensive medical knowledge but are prone to hallucinations and inaccurate citations, which pose a challenge to their clinical adoption and regulatory compliance. Current methods, such as Retrieval…

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Although Speech Large Language Models have achieved notable progress, a substantial modality reasoning gap remains: their reasoning performance on speech inputs is markedly weaker than on text. This gap could be associated with…

Computation and Language · Computer Science 2026-04-21 Chaoren Wang , Heng Lu , Xueyao Zhang , Shujie Liu , Yan Lu , Jinyu Li , Zhizheng Wu

Large Language Models (LLMs) have demonstrated remarkable fluency across a range of natural language tasks, yet remain vulnerable to hallucinations - factual inaccuracies that undermine trust in real world deployment. We present…

Computation and Language · Computer Science 2025-07-16 Kaushik Dwivedi , Padmanabh Patanjali Mishra

The development of Reasoning Large Language Models (RLLMs) has significantly improved multi-step reasoning capabilities, but it has also made hallucination problems more frequent and harder to eliminate. While existing approaches mitigate…

Computers and Society · Computer Science 2025-12-29 Haolang Lu , Yilian Liu , Jingxin Xu , Guoshun Nan , Yuanlong Yu , Zhican Chen , Kun Wang

Large Language Models (LLMs) are increasingly deployed in safety-critical domains, yet remain susceptible to hallucinations. While prior works have proposed confidence representation methods for hallucination detection, most of these…

Machine Learning · Computer Science 2025-11-17 Elyes Hajji , Aymen Bouguerra , Fabio Arnez

Hallucination remains one of the key obstacles to the reliable deployment of large language models (LLMs), particularly in real-world applications. Among various mitigation strategies, Retrieval-Augmented Generation (RAG) and reasoning…

Computation and Language · Computer Science 2025-10-29 Yihan Li , Xiyuan Fu , Ghanshyam Verma , Paul Buitelaar , Mingming Liu

There is growing evidence that independently trained AI systems come to represent the world in the same way. In other words, independently trained embeddings from text, vision, audio, and neural signals share an underlying geometry. We call…

Neurons and Cognition · Quantitative Biology 2026-02-19 Akhil Ramidi , Kevin Scharp

This work characterizes large language models' chain-of-thought generation as a structured trajectory through representation space. We show that mathematical reasoning traverses functionally ordered, step-specific subspaces that become…

Computation and Language · Computer Science 2026-04-08 Lihao Sun , Hang Dong , Bo Qiao , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan