中文
相关论文

相关论文: Empowering Small Language Models with Factual Hall…

200 篇论文

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

计算与语言 · 计算机科学 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Uncertainty estimation is a necessary component when implementing AI in high-risk settings, such as autonomous cars, medicine, or insurances. Large Language Models (LLMs) have seen a surge in popularity in recent years, but they are subject…

机器学习 · 计算机科学 2024-12-09 Gabriel Y. Arteaga , Thomas B. Schön , Nicolas Pielawski

Large Language Models (LLMs) suffer from critical reasoning gaps, including a tendency to hallucinate and poor accuracy in classifying logical fallacies. This limitation stems from their default System 1 processing, which is fast and…

人工智能 · 计算机科学 2025-10-14 Olivia Peiyu Wang , Tashvi Bansal , Ryan Bai , Emily M. Chui , Leilani H. Gilpin

Large Language Models (LLMs) are known to hallucinate and generate non-factual outputs which can undermine user trust. Traditional methods to directly mitigate hallucinations, such as representation editing and contrastive decoding, often…

机器学习 · 计算机科学 2025-03-11 Prasenjit Dey , Srujana Merugu , Sivaramakrishnan Kaveri

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Large Language Models (LLMs) are increasingly deployed in automated software engineering for tasks such as API migration. While LLMs are able to identify migration patterns, they often make mistakes and fail to produce correct glue code to…

软件工程 · 计算机科学 2026-04-23 Marcos Tileria , Santanu Kumar Dash , Profir-Petru Pârţachi , Earl T. Barr

Large language models (LLMs) exhibit excellent performance in natural language processing (NLP), but remain highly sensitive to the quality of input queries, especially when these queries contain misleading or inaccurate information.…

计算与语言 · 计算机科学 2025-06-02 Guocong Li , Weize Liu , Yihang Wu , Ping Wang , Shuaihan Huang , Hongxia Xu , Jian Wu

Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendency to produce mistakes or inconsistent answers during…

计算与语言 · 计算机科学 2025-08-19 Yuanfeng Xu , Zehui Dai , Jian Liang , Jiapeng Guan , Guangrun Wang , Liang Lin , Xiaohui Lv

Large language models (LLMs) are susceptible to hallucinations -- factually incorrect outputs -- leading to a large body of work on detecting and mitigating such cases. We argue that it is important to distinguish between two types of…

计算与语言 · 计算机科学 2025-02-19 Adi Simhi , Jonathan Herzig , Idan Szpektor , Yonatan Belinkov

A common approach to hallucination detection casts it as a natural language inference (NLI) task, often using LLMs to classify whether the generated text is entailed by corresponding reference texts. Since entailment classification is a…

计算与语言 · 计算机科学 2025-06-06 Ron Eliav , Arie Cattan , Eran Hirsch , Shahaf Bassan , Elias Stengel-Eskin , Mohit Bansal , Ido Dagan

Large Language Models (LLMs) are prone to hallucination with non-factual or unfaithful statements, which undermines the applications in real-world scenarios. Recent researches focus on uncertainty-based hallucination detection, which…

计算与语言 · 计算机科学 2025-04-08 Kedi Chen , Qin Chen , Jie Zhou , Xinqi Tao , Bowen Ding , Jingwen Xie , Mingchen Xie , Peilong Li , Feng Zheng , Liang He

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or…

机器学习 · 计算机科学 2026-05-07 Dan Wilson , Mohamed Akrout

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

计算与语言 · 计算机科学 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

人工智能 · 计算机科学 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

计算与语言 · 计算机科学 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Recently, there has been increased interest in Small Language Models (SLMs), which are fast, show good performance, and have lower hardware demands than large language models (LLMs). However, SLMs hallucinate more frequently than LLMs,…

计算与语言 · 计算机科学 2026-05-28 Saptarshi Sengupta , Suhang Wang

Large Language Models (LLMs) have shown propensity to generate hallucinated outputs, i.e., texts that are factually incorrect or unsupported. Existing methods for alleviating hallucinations typically require costly human annotations to…

计算与语言 · 计算机科学 2024-04-03 Yu Xia , Xu Liu , Tong Yu , Sungchul Kim , Ryan A. Rossi , Anup Rao , Tung Mai , Shuai Li

Automatic Speech Recognition (ASR) error correction aims to correct recognition errors while preserving accurate text. Although traditional approaches demonstrate moderate effectiveness, LLMs offer a paradigm that eliminates the need for…

计算与语言 · 计算机科学 2025-12-24 Yangui Fang , Baixu Chen , Jing Peng , Xu Li , Yu Xi , Chengwei Zhang , Guohui Zhong