中文
相关论文

相关论文: DeepSeek on a Trip: Inducing Targeted Visual Hallu…

200 篇论文

Large language models (LLMs) have significantly advanced natural language processing tasks, yet they are susceptible to generating inaccurate or unreliable responses, a phenomenon known as hallucination. In critical domains such as health…

计算与语言 · 计算机科学 2024-09-20 Sumera Anjum , Hanzhi Zhang , Wenjun Zhou , Eun Jin Paek , Xiaopeng Zhao , Yunhe Feng

Large Language Model (LLM) hallucinations are usually treated as defects of the model or its decoding strategy. Drawing on classical linguistics, we argue that a query's form can also shape a listener's (and model's) response. We…

计算与语言 · 计算机科学 2026-02-25 William Watson , Nicole Cho , Sumitra Ganesh , Manuela Veloso

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Vision language models (VLMs) perceive the world through a combination of a visual encoder and a large language model (LLM). The visual encoder, pre-trained on large-scale vision-text datasets, provides zero-shot generalization to visual…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Tae-Hyun Oh

Despite their impressive capabilities, large language models (LLMs) have been observed to generate responses that include inaccurate or fabricated information, a phenomenon commonly known as ``hallucination''. In this work, we propose a…

计算与语言 · 计算机科学 2024-03-12 Yue Zhang , Leyang Cui , Wei Bi , Shuming Shi

Multimodal large language models (MLLMs) struggle with hallucinations, particularly with fine-grained queries, a challenge underrepresented by existing benchmarks that focus on coarse image-related questions. We introduce FIne-grained…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Rui Xiao , Sanghwan Kim , Yongqin Xian , Zeynep Akata , Stephan Alaniz

Large Vision Language Models (LVLMs) have shown remarkable capabilities in multimodal tasks like visual question answering or image captioning. However, inconsistencies between the visual information and the generated text, a phenomenon…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Laura Fieback , Jakob Spiegelberg , Hanno Gottschalk

Multimodal large language models (MLLMs) are increasingly adopted in remote sensing (RS) and have shown strong performance on tasks such as RS visual grounding (RSVG), RS visual question answering (RSVQA), and multimodal dialogue. However,…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Zihui Zhou , Yong Feng , Yanying Chen , Guofan Duan , Zhenxi Song , Mingliang Zhou , Weijia Jia

While Vision-Language Models (VLMs) have garnered increasing attention in the AI community due to their promising practical applications, they exhibit persistent hallucination issues, generating outputs misaligned with visual inputs. Recent…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jiayu Hu , Beibei Li , Jiangwei Xia , Yanjun Qin , Bing Ji , Zhongshi He

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

计算与语言 · 计算机科学 2025-09-19 Martin Preiß

Multimodal large language models (MLLMs) have recently shown significant advancements in video understanding, excelling in content reasoning and instruction-following tasks. However, hallucination, where models generate inaccurate or…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Chaoyu Li , Eun Woo Im , Pooyan Fazli

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

图像与视频处理 · 电气工程与系统科学 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Multimodal Large Language Models (MLLMs) are known to hallucinate, which limits their practical applications. Recent works have attempted to apply Direct Preference Optimization (DPO) to enhance the performance of MLLMs, but have shown…

计算与语言 · 计算机科学 2024-11-18 Yuhan Fu , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Xirong Li

Large language models (LLMs) show promise in healthcare, but hallucinations remain a major barrier to clinical use. We present CHECK, a continuous-learning framework that integrates structured clinical databases with a classifier grounded…

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

人工智能 · 计算机科学 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Multi-modal Large Language Models (MLLMs) tuned on machine-generated instruction-following data have demonstrated remarkable performance in various multi-modal understanding and generation tasks. However, the hallucinations inherent in…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Qifan Yu , Juncheng Li , Longhui Wei , Liang Pang , Wentao Ye , Bosheng Qin , Siliang Tang , Qi Tian , Yueting Zhuang

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

声音 · 计算机科学 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

计算与语言 · 计算机科学 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Uncertainty estimation is a necessary component when implementing AI in high-risk settings, such as autonomous cars, medicine, or insurances. Large Language Models (LLMs) have seen a surge in popularity in recent years, but they are subject…

机器学习 · 计算机科学 2024-12-09 Gabriel Y. Arteaga , Thomas B. Schön , Nicolas Pielawski

Large vision-language models (LVLMs) often hallucinate content that is fluent yet unsupported by the image, limiting their reliability in real-world deployment. We show that a key failure mode arises from route competition: even when visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhe Cheng , Wenyu Chen , Fode Zhang , Dehuan Shen