中文
相关论文

相关论文: Can Hallucination Correction Improve Video-Languag…

200 篇论文

Large language models (LLMs) have significantly advanced natural language processing tasks, yet they are susceptible to generating inaccurate or unreliable responses, a phenomenon known as hallucination. In critical domains such as health…

计算与语言 · 计算机科学 2024-09-20 Sumera Anjum , Hanzhi Zhang , Wenjun Zhou , Eun Jin Paek , Xiaopeng Zhao , Yunhe Feng

Despite significant progress in video-language modeling, hallucinations remain a persistent challenge in Video Large Language Models (Vid-LLMs), referring to outputs that appear plausible yet contradict the content of the input video. This…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Yiyang Huang , Yitian Zhang , Yizhou Wang , Mingyuan Zhang , Liang Shi , Huimin Zeng , Yun Fu

Large language models and vision transformers have demonstrated impressive zero-shot capabilities, enabling significant transferability in downstream tasks. The fusion of these models has resulted in multi-modal architectures with enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Andrés Villa , Juan León Alcázar , Motasem Alfarra , Vladimir Araujo , Alvaro Soto , Bernard Ghanem

Large language models (LLMs) have demonstrated exceptional proficiency in language understanding. However, when LLMs align their outputs with deceptive and/or misleading prompts, the generated responses could deviate from the de facto…

计算与语言 · 计算机科学 2025-09-03 Zixuan Shangguan , Yanjie Dong , Lanjun Wang , Xiaoyi Fan , Victor C. M. Leung , Xiping Hu

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Existing Large Vision-Language Models (LVLMs) primarily align image features of vision encoder with Large Language Models (LLMs) to leverage their superior text generation capabilities. However, the scale disparity between vision encoder…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Shi Liu , Kecheng Zheng , Wei Chen

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in visual understanding and multimodal reasoning. However, LVLMs frequently exhibit hallucination phenomena, manifesting as the generated textual responses that…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Ziyun Dai , Xiaoqiang Li , Shaohua Zhang , Yuanchen Wu , Jide Li

Object hallucination in Large Vision-Language Models (LVLMs) severely compromises their reliability in real-world applications, posing a critical barrier to their deployment in high-stakes scenarios such as autonomous driving and medical…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Han Sun , Qin Li , Peixin Wang , Min Zhang

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Large language models (LLMs) often generate hallucinated content that lacks factual or contextual grounding, limiting their reliability in critical applications. Existing approaches such as supervised fine-tuning and reinforcement learning…

计算与语言 · 计算机科学 2025-12-23 Jensen Zhang , Ningyuan Liu , Yijia Fan , Zihao Huang , Qinglin Zeng , Kaitong Cai , Jian Wang , Keze Wang

Vision-Language-Action systems follow instructions to execute multi-step tasks in multimodal environments. Recent VLA approaches typically rely on post-hoc correction mechanisms or operate under fixed task decompositions and alignment…

人工智能 · 计算机科学 2026-05-12 Xiyin Zeng , Yuyu Sun , Haoyang Li , Shouqiang Liu , Hao Wang

Hallucinations, the tendency for large language models to provide responses with factually incorrect and unsupported claims, is a serious problem within natural language processing for which we do not yet have an effective solution to…

计算与语言 · 计算机科学 2026-05-08 Brandon C. Colelough , Davis Bartels , Dina Demner-Fushman

Despite improvements in performances on different natural language generation tasks, deep neural models are prone to hallucinating facts that are incorrect or nonexistent. Different hypotheses are proposed and examined separately for…

计算与语言 · 计算机科学 2021-03-30 Yijun Xiao , William Yang Wang

Instruction-following Vision Large Language Models (VLLMs) have achieved significant progress recently on a variety of tasks. These approaches merge strong pre-trained vision models and large language models (LLMs). Since these components…

机器学习 · 计算机科学 2024-02-20 Yiyang Zhou , Chenhang Cui , Rafael Rafailov , Chelsea Finn , Huaxiu Yao

Recent advancements in multimodal large language models have enhanced document understanding by integrating textual and visual information. However, existing models exhibit incompleteness within their paradigm in real-world scenarios,…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Zhentao He , Can Zhang , Ziheng Wu , Zhenghao Chen , Yufei Zhan , Yifan Li , Zhao Zhang , Xian Wang , Minghui Qiu

Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect. We introduce HICD, a novel method designed to induce hallucinations for contrastive decoding to mitigate…

计算与语言 · 计算机科学 2025-05-26 Xinyan Jiang , Hang Ye , Yongxin Zhu , Xiaoying Zheng , Zikang Chen , Jun Gong

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

人工智能 · 计算机科学 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

计算与语言 · 计算机科学 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

Large Vision-Language Models (LVLMs) have made significant progress in recent years but are also prone to hallucination issues. They exhibit more hallucinations in longer, free-form responses, often attributed to accumulated uncertainties.…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Ge Zheng , Jiaye Qian , Jiajin Tang , Sibei Yang

The rapid advancements in Large Language Models (LLMs) and Large Visual-Language Models (LVLMs) have opened up new opportunities for integrating visual and linguistic modalities. However, effectively aligning these modalities remains…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Sihan Yang , Chenhang Cui , Zihao Zhao , Yiyang Zhou , Weilong Yan , Ying Wei , Huaxiu Yao