中文
相关论文

相关论文: Hallucination as Exploit: Evidence-Carrying Multim…

200 篇论文

AI agents with tool-use capabilities show promise for integrating the domain expertise of various tools. In the medical field, however, tools are usually AI models that are inherently error-prone and can produce contradictory responses.…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Zheang Huai , Honglong Yang , Xiaomeng Li

Recent advancements in Large Vision-Language Models (LVLMs) have significantly expanded their utility in tasks like image captioning and visual question answering. However, they still struggle with object hallucination, where models…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Yeongjae Cho , Keonwoo Kim , Taebaek Hwang , Sungzoon Cho

Hallucinations remain a persistent challenge for vision-language models (VLMs), which often describe nonexistent objects or fabricate facts. Existing detection methods typically operate after text generation, making intervention both costly…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Sai Akhil Kogilathota , Sripadha Vallabha E G , Luzhe Sun , Jiawei Zhou

Computer-Use Agents (CUAs) are an increasingly deployed class of agents that take actions on GUIs to accomplish user goals. In this paper, we show that CUAs consistently exhibit Blind Goal-Directedness (BGD): a bias to pursue goals…

Despite recent advances in multimodal pre-training for visual description, state-of-the-art models still produce captions containing errors, such as hallucinating objects not present in a scene. The existing prominent metric for object…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Suzanne Petryk , David M. Chan , Anish Kachinthaya , Haodi Zou , John Canny , Joseph E. Gonzalez , Trevor Darrell

While the problem of hallucinations in neural machine translation has long been recognized, so far the progress on its alleviation is very little. Indeed, recently it turned out that without artificially encouraging models to hallucinate,…

计算与语言 · 计算机科学 2022-12-21 David Dale , Elena Voita , Loïc Barrault , Marta R. Costa-jussà

Language models (LMs) often struggle to pay enough attention to the input context, and generate texts that are unfaithful or contain hallucinations. To mitigate this issue, we present context-aware decoding (CAD), which follows a…

计算与语言 · 计算机科学 2023-05-25 Weijia Shi , Xiaochuang Han , Mike Lewis , Yulia Tsvetkov , Luke Zettlemoyer , Scott Wen-tau Yih

Visual Language Action (VLA) models are a multi-modal class of Artificial Intelligence (AI) systems that integrate visual perception, natural language understanding, and action planning to enable agents to interpret their environment,…

软件工程 · 计算机科学 2025-08-04 Pablo Valle , Chengjie Lu , Shaukat Ali , Aitor Arrieta

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen

Multimodal large language models (MLLMs) have shown strong potential for medical Visual Question Answering (VQA), yet they remain prone to hallucinations, defined as generating responses that contradict the input image, posing serious risks…

人工智能 · 计算机科学 2026-03-24 Mohammad Asadi , Tahoura Nedaee , Jack W. O'Sullivan , Euan Ashley , Ehsan Adeli

Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form…

Hallucinations pose a significant obstacle to the reliability and widespread adoption of language models, yet their accurate measurement remains a persistent challenge. While many task- and domain-specific metrics have been proposed to…

LLM deployment in critical domains is currently impeded by persistent hallucinations--generating plausible but factually incorrect assertions. While scaling laws drove significant improvements in general capabilities, theoretical frameworks…

机器学习 · 计算机科学 2026-01-29 Jiayun Wu , Jiashuo Liu , Zhiyuan Zeng , Tianyang Zhan , Tianle Cai , Wenhao Huang

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

计算与语言 · 计算机科学 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

This paper introduces EmbodiedAgent, a hierarchical framework for heterogeneous multi-robot control. EmbodiedAgent addresses critical limitations of hallucination in impractical tasks. Our approach integrates a next-action prediction…

机器人学 · 计算机科学 2025-08-18 Hanwen Wan , Yifei Chen , Yixuan Deng , Zeyu Wei , Dongrui Li , Zexin Lin , Donghao Wu , Jiu Cheng , Xiaoqiang Ji

Hallucination--defined here as generating statements unsupported or contradicted by available evidence or conversational context--remains a major obstacle to deploying conversational AI systems in settings that demand factual reliability.…

计算与语言 · 计算机科学 2026-04-22 Ashley Lewis , Andrew Perrault , Eric Fosler-Lussier , Michael White

Long-context and memory systems usually treat personalization as a recall problem. In practice, many failures occur later, when a system commits: it turns noisy hints into hard constraints, drops rare witnesses, forgets downstream…

人工智能 · 计算机科学 2026-05-20 Rui Tang , Yichi Zhang , Xi Chen , Chen Dong , Youwei Yang , Yumeng Shen , Qiangqiang Liu

Agentic AI systems execute a sequence of actions, such as reasoning steps or tool calls, in response to a user prompt. To evaluate the success of their trajectories, researchers have developed verifiers, such as LLM judges and…

机器学习 · 计算机科学 2026-05-29 Shuvom Sadhuka , Drew Prinster , Clara Fannjiang , Gabriele Scalia , Bonnie Berger , Aviv Regev , Hanchen Wang

To address the hallucination in generative question answering (GQA) where the answer can not be derived from the document, we propose a novel evidence-enhanced triplet generation framework, EATQA, encouraging the model to predict all the…

计算与语言 · 计算机科学 2024-08-28 Haowei Du , Huishuai Zhang , Dongyan Zhao

Despite rapid progress, Video Large Language Models (Video-LLMs) remain unreliable due to hallucinations, which are outputs that contradict either video evidence (faithfulness) or verifiable world knowledge (factuality). Existing benchmarks…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Junqi Yang , Yuecong Min , Jie Zhang , Shiguang Shan , Xilin Chen