中文
相关论文

相关论文: Cross-Layer Attention Probing for Fine-Grained Hal…

200 篇论文

Large Language Models have demonstrated remarkable capabilities across diverse tasks, yet they frequently generate hallucinations outputs that are fluent but factually incorrect or unsupported. We propose Counterfactual Probing, a novel…

计算与语言 · 计算机科学 2025-08-05 Yijun Feng

Large language models (LLMs) have garnered significant interest in AI community. Despite their impressive generation capabilities, they have been found to produce misleading or fabricated information, a phenomenon known as hallucinations.…

机器学习 · 计算机科学 2025-10-21 Wenyun Li , Zheng Zhang , Dongmei Jiang , Xiangyuan Lan

Large Language Models (LLMs) often generate incorrect or unsupported content, known as hallucinations. Existing detection methods rely on heuristics or simple models over isolated computational traces such as activations, or attention maps.…

机器学习 · 计算机科学 2025-09-30 Fabrizio Frasca , Guy Bar-Shalom , Yftah Ziser , Haggai Maron

Hallucination in large language models (LLMs) continues to be a significant issue, particularly in tasks like question answering, where models often generate plausible yet incorrect or irrelevant information. Although various methods have…

计算与语言 · 计算机科学 2026-04-09 Ziqin Luo , Yihao Quan , Xiaofeng Zhang , Xiaosong Yuan , Chen Shen

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

计算与语言 · 计算机科学 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Hallucinations in Large Vision-Language Models (LVLMs) significantly undermine their reliability, motivating researchers to explore the causes of hallucination. However, most studies primarily focus on the language aspect rather than the…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangqi Jiang , Junkai Chen , Beier Zhu , Tingjin Luo , Yankun Shen , Xu Yang

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

计算与语言 · 计算机科学 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

Large language models are extensively applied across a wide range of tasks, such as customer support, content creation, educational tutoring, and providing financial guidance. However, a well-known drawback is their predisposition to…

计算与语言 · 计算机科学 2024-07-08 Noa Nonkes , Sergei Agaronian , Evangelos Kanoulas , Roxana Petcu

Large language models (LLMs) exhibit excellent performance in natural language processing (NLP), but remain highly sensitive to the quality of input queries, especially when these queries contain misleading or inaccurate information.…

计算与语言 · 计算机科学 2025-06-02 Guocong Li , Weize Liu , Yihang Wu , Ping Wang , Shuaihan Huang , Hongxia Xu , Jian Wu

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

计算与语言 · 计算机科学 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to…

计算与语言 · 计算机科学 2024-04-03 Yu Xia , Xu Liu , Tong Yu , Sungchul Kim , Ryan A. Rossi , Anup Rao , Tung Mai , Shuai Li

Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect. We introduce HICD, a novel method designed to induce hallucinations for contrastive decoding to mitigate…

计算与语言 · 计算机科学 2025-05-26 Xinyan Jiang , Hang Ye , Yongxin Zhu , Xiaoying Zheng , Zikang Chen , Jun Gong

Hallucination in large language models (LLMs) remains a critical barrier to their safe deployment. For hallucination detection to be practical in real-world scenarios, the use of efficient small models is essential to ensure low latency and…

人工智能 · 计算机科学 2026-03-05 Zepeng Bao , Shen Zhou , Qiankun Pi , Jianhao Chen , Mayi Xu , Ming Zhong , Yuanyuan Zhu , Tieyun Qian

Recent decoding methods improve the factuality of large language models (LLMs) by refining how the next token is selected during generation. These methods typically operate at the token level, leveraging internal representations to suppress…

计算与语言 · 计算机科学 2025-09-16 Hongxiang Zhang , Hao Chen , Muhao Chen , Tianyi Zhang

Concerns regarding the propensity of Large Language Models (LLMs) to produce inaccurate outputs, also known as hallucinations, have escalated. Detecting them is vital for ensuring the reliability of applications relying on LLM-generated…

计算与语言 · 计算机科学 2024-05-31 Ernesto Quevedo , Jorge Yero , Rachel Koerner , Pablo Rivas , Tomas Cerny

Hallucinations in large language models (LLMs) pose significant challenges in tasks requiring complex multi-step reasoning, such as mathematical problem-solving. Existing approaches primarily detect the presence of hallucinations but lack a…

计算与语言 · 计算机科学 2025-09-19 Ruosen Li , Ziming Luo , Xinya Du

Large Vision-Language Models (LVLMs) are susceptible to object hallucinations, an issue in which their generated text contains non-existent objects, greatly limiting their reliability and practicality. Current approaches often rely on the…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Ailin Deng , Zhirui Chen , Bryan Hooi

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

机器学习 · 计算机科学 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

人工智能 · 计算机科学 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang