中文
相关论文

相关论文: Mitigating Large Language Model Hallucination with…

200 篇论文

Multimodal large language models (MLLMs) have attracted increasing attention in the past few years, but they may still generate descriptions that include objects not present in the corresponding images, a phenomenon known as object…

计算与语言 · 计算机科学 2024-09-24 Shangyu Xing , Fei Zhao , Zhen Wu , Tuo An , Weihao Chen , Chunhui Li , Jianbing Zhang , Xinyu Dai

Large language models (LLMs) achieve remarkable fluency across linguistic and reasoning tasks but remain systematically prone to hallucination. Prevailing accounts attribute hallucinations to data gaps, limited context, or optimization…

计算机与社会 · 计算机科学 2025-09-23 Richard Ackermann , Simeon Emanuilov

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large Language Models (LLMs) excel in fluency but risk producing inaccurate content, called "hallucinations." This paper outlines a standardized process for categorizing fine-grained hallucination types and proposes an innovative…

计算与语言 · 计算机科学 2024-07-02 Kunquan Deng , Zeyu Huang , Chen Li , Chenghua Lin , Min Gao , Wenge Rong

Large Language Models (LLMs) sometimes suffer from producing hallucinations, especially LLMs may generate untruthful responses despite knowing the correct knowledge. Activating the truthfulness within LLM is the key to fully unlocking LLM's…

计算与语言 · 计算机科学 2024-06-06 Shaolei Zhang , Tian Yu , Yang Feng

While large language models (LLMs) have demonstrated remarkable capabilities across a range of downstream tasks, a significant concern revolves around their propensity to exhibit hallucinations: LLMs occasionally generate content that…

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

During the pretraining phase, large language models (LLMs) acquire vast amounts of knowledge from extensive text corpora. Nevertheless, in later stages such as fine-tuning and inference, the model may encounter knowledge not covered in the…

计算与语言 · 计算机科学 2024-10-10 Bozhou Li , Hao Liang , Yang Li , Fangcheng Fu , Hongzhi Yin , Conghui He , Wentao Zhang

Hallucination occurs when large language models exhibit behavior that deviates from the boundaries of their knowledge during response generation. To address this critical issue, previous learning-based methods attempt to finetune models but…

计算与语言 · 计算机科学 2025-05-27 Xueru Wen , Jie Lou , Xinyu Lu , Ji Yuqiu , Xinyan Guan , Yaojie Lu , Hongyu Lin , Ben He , Xianpei Han , Debing Zhang , Le Sun

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

计算与语言 · 计算机科学 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Large language models (LLMs) have been able to perform various forms of reasoning tasks in a wide range of scenarios, but are they truly engaging in task abstraction and rule-based reasoning beyond mere memorization? To answer this…

机器学习 · 计算机科学 2025-12-09 Guanyu Chen , Peiyang Wang , Yizhou Jiang , Yuqian Liu , Chujie Zhao , Ying Fang , Tianren Zhang , Feng Chen

Despite their remarkable capabilities, Large Language Models (LLMs) are prone to generate responses that contradict verifiable facts, i.e., unfaithful hallucination content. Existing efforts generally focus on optimizing model parameters or…

计算与语言 · 计算机科学 2025-01-28 Dingkang Yang , Dongling Xiao , Jinjie Wei , Mingcheng Li , Zhaoyu Chen , Ke Li , Lihua Zhang

Recent development of Large Vision-Language Models (LVLMs) has attracted growing attention within the AI landscape for its practical implementation potential. However, ``hallucination'', or more specifically, the misalignment between…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Hanchao Liu , Wenyuan Xue , Yifei Chen , Dapeng Chen , Xiutian Zhao , Ke Wang , Liping Hou , Rongjun Li , Wei Peng

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

计算与语言 · 计算机科学 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

State-of-the-art language models (LMs) sometimes generate non-factual hallucinations that misalign with world knowledge. To explore the mechanistic causes of these hallucinations, we create diagnostic datasets with subject-relation queries…

计算与语言 · 计算机科学 2024-06-19 Lei Yu , Meng Cao , Jackie Chi Kit Cheung , Yue Dong

Large language models (LLMs) often produce errors, including factual inaccuracies, biases, and reasoning failures, collectively referred to as "hallucinations". Recent studies have demonstrated that LLMs' internal states encode information…

计算与语言 · 计算机科学 2025-05-20 Hadas Orgad , Michael Toker , Zorik Gekhman , Roi Reichart , Idan Szpektor , Hadas Kotek , Yonatan Belinkov

Large language models (LLMs) have demonstrated impressive capabilities across a variety of tasks, but their increasing autonomy in real-world applications raises concerns about their trustworthiness. While hallucinations-unintentional…

机器学习 · 计算机科学 2025-09-04 Haoran Huan , Mihir Prabhudesai , Mengning Wu , Shantanu Jaiswal , Deepak Pathak

Large language models (LLMs) have shown remarkable performance in natural language processing (NLP) tasks. To comprehend and execute diverse human instructions over image data, instruction-tuned large vision-language models (LVLMs) have…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Lei Wang , Jiabang He , Shenshen Li , Ning Liu , Ee-Peng Lim

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

计算与语言 · 计算机科学 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao