中文
相关论文

相关论文: Interpreting and Mitigating Hallucination in MLLMs…

200 篇论文

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal task reasoning. However, they often generate responses that appear plausible yet do not accurately reflect the visual content, a phenomenon known…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Jiaqi Wang , Yifei Gao , Jitao Sang

In the era of large language models (LLMs), hallucination (i.e., the tendency to generate factually incorrect content) poses great challenge to trustworthy and reliable deployment of LLMs in real-world applications. To tackle the LLM…

计算与语言 · 计算机科学 2024-01-09 Junyi Li , Jie Chen , Ruiyang Ren , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged--Reasoning Hallucination--where logically coherent but…

人工智能 · 计算机科学 2025-05-20 Zhongxiang Sun , Qipeng Wang , Haoyu Wang , Xiao Zhang , Jun Xu

Hallucinations are one of the major issues affecting LLMs, hindering their wide adoption in production systems. While current research solutions for detecting hallucinations are mainly based on heuristics, in this paper we introduce a…

计算与语言 · 计算机科学 2025-02-14 Emanuele Ricco , Lorenzo Cima , Roberto Di Pietro

Hallucination is a long-standing problem that has been actively investigated in Vision-Language Models (VLMs). Existing research commonly attributes hallucinations to technical limitations or sycophancy bias, where the latter means the…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Xiangrui Liu , Man Luo , Agneet Chatterjee , Hua Wei , Chitta Baral , Yezhou Yang

The hallucination problem in multimodal large language models (MLLMs) remains a common issue. Although image tokens occupy a majority of the input sequence of MLLMs, there is limited research to explore the relationship between image tokens…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Xiaofeng Zhang , Yihao Quan , Chaochen Gu , Chen Shen , Xiaosong Yuan , Shaotian Yan , Hao Cheng , Kaijie Wu , Jieping Ye

Recent methodologies utilizing synthetic datasets have aimed to address inconsistent hallucinations in large language models (LLMs); however,these approaches are primarily tailored to specific tasks, limiting their generalizability.…

人工智能 · 计算机科学 2025-02-28 Xinxin You , Xien Liu , Qixin Sun , Huan Zhang , Kaiyin Zhou , Shaohui Liu , GuoPing Hu , ShiJin Wang , Si Liu , Ji Wu

Object hallucination is a significant challenge that hinders the application of large vision-language models (LVLMs) in practice. We hypothesize that one possible origin of hallucination is the model's tendency to prioritize text generation…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Meng Shen , Minghao Wu , Deepu Rajan

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

Modern large language models (LLMs) like ChatGPT have shown remarkable performance on general language tasks but still struggle on complex reasoning tasks, which drives the research on cognitive behaviors of LLMs to explore human-like…

计算与语言 · 计算机科学 2024-10-10 Tian Liang , Zhiwei He , Wenxiang Jiao , Xing Wang , Yan Wang , Rui Wang , Yujiu Yang , Shuming Shi , Zhaopeng Tu

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

计算与语言 · 计算机科学 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

The rise of Large Language Models (LLMs) has significantly advanced various applications on software engineering tasks, particularly in code generation. Despite the promising performance, LLMs are prone to generate hallucinations, which…

软件工程 · 计算机科学 2026-01-22 Fang Liu , Yang Liu , Lin Shi , Zhen Yang , Li Zhang , Xiaoli Lian , Zhongqi Li , Yuchi Ma

Vision-Language Models (VLMs) excel at visual understanding but often suffer from visual hallucinations, where they generate descriptions of nonexistent objects, actions, or concepts, posing significant risks in safety-critical…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Tsung-Han Wu , Heekyung Lee , Jiaxin Ge , Joseph E. Gonzalez , Trevor Darrell , David M. Chan

Multimodal Large Language Models (MLLMs) have emerged as a central focus in both industry and academia, but often suffer from biases introduced by visual and language priors, which can lead to multimodal hallucination. These biases arise…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Guanyu Zhou , Yibo Yan , Xin Zou , Kun Wang , Aiwei Liu , Xuming Hu

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

计算与语言 · 计算机科学 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

计算与语言 · 计算机科学 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Hallucination is often regarded as a major impediment for using large language models (LLMs), especially for knowledge-intensive tasks. Even when the training corpus consists solely of true statements, language models still generate…

计算与语言 · 计算机科学 2024-07-12 Yuji Zhang , Sha Li , Jiateng Liu , Pengfei Yu , Yi R. Fung , Jing Li , Manling Li , Heng Ji

Multimodal Large Language Models (MLLMs) excel in numerous vision-language tasks yet suffer from hallucinations, producing content inconsistent with input visuals, that undermine reliability in precision-sensitive domains. This issue stems…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Nan Sun , Zhenyu Zhang , Xixun Lin , Kun Wang , Yanmin Shang , Naibin Gu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang , Yanan Cao