English
Related papers

Related papers: Semantic Entropy Probes: Robust and Cheap Hallucin…

200 papers

Large language models (LLMs) are increasingly deployed on complex reasoning tasks, yet little is known about their ability to internally evaluate problem difficulty, which is an essential capability for adaptive reasoning and efficient…

Computation and Language · Computer Science 2025-10-14 Sunbowen Lee , Qingyu Yin , Chak Tou Leong , Jialiang Zhang , Yicheng Gong , Shiwen Ni , Min Yang , Xiaoyu Shen

Hallucinations in Large Language Models (LLMs), i.e., the tendency to generate plausible but non-factual content, pose a significant challenge for their reliable deployment in high-stakes environments. However, existing hallucination…

Computation and Language · Computer Science 2026-01-29 Yitong Qiao , Licheng Pan , Yu Mi , Lei Liu , Yue Shen , Fei Sun , Zhixuan Chu

Open-domain semantic parsing remains a challenging task, as neural models often rely on heuristics and struggle to handle unseen concepts. In this paper, we investigate the potential of large language models (LLMs) for this task and…

Computation and Language · Computer Science 2025-08-21 Xiao Zhang , Qianru Meng , Johan Bos

This paper presents the contributions of the ATLANTIS team to SemEval-2025 Task 3, focusing on detecting hallucinated text spans in question answering systems. Large Language Models (LLMs) have significantly advanced Natural Language…

Computation and Language · Computer Science 2025-08-08 Catherine Kobus , François Lancelot , Marion-Cécile Martin , Nawal Ould Amer

Hallucination is a major challenge for large language models (LLMs), preventing their further application in some fields. The skeptical thinking of humankind could be useful for LLMs to self-cognition, self-reflection and alleviate their…

Computation and Language · Computer Science 2025-04-29 Yetao Wu , Yihong Wang , Teng Chen , Ningyuan Xi , Qingqing Gu , Hongyang Lei , Luo Ji

Large Language Models have revolutionized information processing, yet their reliability is severely compromised by faithfulness hallucinations. While current approaches attempt to mitigate this issue through node-level adjustments or coarse…

Computation and Language · Computer Science 2026-01-06 Chenxu Wang , Chaozhuo Li , Pengbo Wang , Litian Zhang , Songyang Liu , Ji Qi , Jiahui Hu , Yushan Cai , Hao Zhao , Rui Pu

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks. Previous studies suggest that LLMs' generation process involves uncertainty. However, existing approaches to…

Computation and Language · Computer Science 2024-09-06 Yu-Hsiang Wang , Andrew Bai , Che-Ping Tsai , Cho-Jui Hsieh

Large Language Models (LLMs) possess latent multi-token prediction (MTP) abilities despite being trained only for next-token generation. We introduce ESP (Embedding-Space Probing), a simple and training-free MTP method that probes an LLM…

Computation and Language · Computer Science 2026-05-29 Raghavv Goel , Mukul Gagrani , Mingu Lee , Chris Lott

While the problem of hallucinations in neural machine translation has long been recognized, so far the progress on its alleviation is very little. Indeed, recently it turned out that without artificially encouraging models to hallucinate,…

Computation and Language · Computer Science 2022-12-21 David Dale , Elena Voita , Loïc Barrault , Marta R. Costa-jussà

In Text-to-SQL generation, large language models (LLMs) have shown strong generalization and adaptability. However, LLMs sometimes generate hallucinations, i.e.,unrealistic or illogical content, which leads to incorrect SQL queries and…

Software Engineering · Computer Science 2025-12-30 Bo Yang , Yinfen Xia , Weisong Sun , Yang Liu

While large language models (LLMs) have demonstrated increasing power, they have also called upon studies on their hallucinated outputs that deviate from factually correct statements. In this paper, we focus on one important scenario of…

Computation and Language · Computer Science 2025-01-23 Nan Xu , Xuezhe Ma

Prompt tuning based on Context Optimization (CoOp) effectively adapts visual-language models (VLMs) to downstream tasks by inferring additional learnable prompt tokens. However, these tokens are less discriminative as they are independent…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hantao Yao , Rui Zhang , Lu Yu , Yongdong Zhang , Changsheng Xu

Large vision-language models (LVLMs) have achieved remarkable performance on multimodal tasks. However, they still suffer from hallucinations, generating text inconsistent with visual input, posing significant risks in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhenglin Hua , Jinghan He , Zijun Yao , Tianxu Han , Haiyun Guo , Yuheng Jia , Junfeng Fang

To mitigate the impact of hallucination nature of LLMs, many studies propose detecting hallucinated generation through uncertainty estimation. However, these approaches predominantly operate at the sentence or paragraph level, failing to…

Computation and Language · Computer Science 2025-09-05 Min-Hsuan Yeh , Max Kamachee , Seongheon Park , Yixuan Li

Large language models (LLMs) have demonstrated impressive performance in both research and real-world applications, but they still struggle with hallucination. Existing hallucination detection methods often perform poorly on sentence-level…

Computation and Language · Computer Science 2025-09-01 Weizhi Gao , Xiaorui Liu , Feiyi Wang , Dan Lu , Junqi Yin

Multi-step processes via large language models (LLMs) have proven effective for solving complex reasoning tasks. However, the depth of exploration of the reasoning procedure can significantly affect the task performance. Existing methods to…

Artificial Intelligence · Computer Science 2025-06-19 Jinghan Zhang , Xiting Wang , Fengran Mo , Yeyang Zhou , Wanfu Gao , Kunpeng Liu

Event-based semantic segmentation has gained popularity due to its capability to deal with scenarios under high-speed motion and extreme lighting conditions, which cannot be addressed by conventional RGB cameras. Since it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Linglin Jing , Yiming Ding , Yunpeng Gao , Zhigang Wang , Xu Yan , Dong Wang , Gerald Schaefer , Hui Fang , Bin Zhao , Xuelong Li

Multimodal large language models (MLLMs) have shown strong potential for medical Visual Question Answering (VQA), yet they remain prone to hallucinations, defined as generating responses that contradict the input image, posing serious risks…

Artificial Intelligence · Computer Science 2026-03-24 Mohammad Asadi , Tahoura Nedaee , Jack W. O'Sullivan , Euan Ashley , Ehsan Adeli

Large language models (LLMs) have demonstrated remarkable capabilities, but they still frequently produce hallucinations. These hallucinations are difficult to detect in reasoning-intensive tasks, where the content appears coherent but…

Computation and Language · Computer Science 2026-05-13 Rui Min , Tianyu Pang , Chao Du , Minhao Cheng , Yi R. Fung

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo