English
Related papers

Related papers: CCD: Mitigating Hallucinations in Radiology MLLMs …

200 papers

Fine-grained Vision-Language Pre-training (FVLP) demonstrates significant potential in 3D medical image understanding by aligning anatomy-level visual representations with corresponding textual descriptions. However, existing FVLP paradigms…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Hanwen Zhang , Yao Liu , Die Dai , Jiaye Yang , Qiao Liu , Yutong Xie , Peng Wang

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Despite the impressive capabilities of multimodal large language models (MLLMs) in vision-language tasks, they are prone to hallucinations in real-world scenarios. This paper investigates the hallucination phenomenon in MLLMs from the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongmeng Zhang , Wengang Zhou , Jie Zhao , Houqiang Li

Hallucinations in large vision--language models (LVLMs) often arise when language priors dominate over visual evidence, leading to object misidentification and visually inconsistent descriptions. We address this problem by framing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yujin Jo , Sangyoon Bae , Taesup Kim

Despite the astonishing performance of recent Large Vision-Language Models (LVLMs), these models often generate inaccurate responses. To address this issue, previous studies have focused on mitigating hallucinations by employing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Sihyeon Kim , Boryeong Cho , Sangmin Bae , Sumyeong Ahn , Se-Young Yun

Recent methodologies utilizing synthetic datasets have aimed to address inconsistent hallucinations in large language models (LLMs); however,these approaches are primarily tailored to specific tasks, limiting their generalizability.…

Artificial Intelligence · Computer Science 2025-02-28 Xinxin You , Xien Liu , Qixin Sun , Huan Zhang , Kaiyin Zhou , Shaohui Liu , GuoPing Hu , ShiJin Wang , Si Liu , Ji Wu

Multimodal large language models (MLLMs) have achieved remarkable success across diverse vision-language tasks, yet they remain highly susceptible to hallucinations, producing content that is fluent but inconsistent with visual evidence.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Youxu Shi , Suorong Yang , Dong Liu

Automated radiology report generation using vision-language models (VLMs) is limited by the risk of prior-comparison hallucination, where the model generates historical findings unsupported by the current study. We address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ao Li , Rui Liu , Mingjie Li , Sheng Liu , Lei Wang , Xiaodan Liang , Lina Yao , Xiaojun Chang , Lei Xing

Video Large Language Models (VideoLLMs) have shown remarkable progress in video understanding. However, these models still struggle to effectively perceive and exploit rich temporal information in videos when responding to user queries.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chang-Hsun Wu , Kai-Po Chang , Yu-Yang Sheng , Hung-Kai Chung , Kuei-Chun Wang , Yu-Chiang Frank Wang

Multimodal Large Language Models (MLLMs) have made significant progress in bridging the gap between visual and language modalities. However, hallucinations in MLLMs, where the generated text does not align with image content, continue to be…

Artificial Intelligence · Computer Science 2024-08-05 Kohou Wang , Xiang Liu , Zhaoxiang Liu , Kai Wang , Shiguo Lian

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Large vision-language models (VLMs) demonstrate strong performance in medical image understanding, but frequently generate clinically plausible yet incorrect statements, raising significant safety concerns. Existing medical hallucination…

The synergistic mechanism based on Speculative Decoding (SD) has garnered considerable attention as a simple yet effective approach for accelerating the inference of large language models (LLMs). Nonetheless, the high rejection rates…

Computation and Language · Computer Science 2025-06-04 Chuanghao Ding , Jiaping Wang , Ziqing Yang , Xiaoliang Wang , Dahua Lin , Cam-Tu Nguyen , Fei Tan

With appropriate data selection and training techniques, Large Language Models (LLMs) have demonstrated exceptional success in various medical examinations and multiple-choice questions. However, the application of LLMs in medical dialogue…

Computation and Language · Computer Science 2024-03-12 Jiageng Wu , Xian Wu , Yefeng Zheng , Jie Yang

The proliferation of Deep Learning (DL)-based methods for radiographic image analysis has created a great demand for expert-labeled radiology data. Recent self-supervised frameworks have alleviated the need for expert labeling by obtaining…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 S. A. Rizvi , R. Tang , X. Jiang , X. Ma , X. Hu

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

Machine Learning · Computer Science 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Model hallucination is one of the most critical challenges faced by Large Language Models (LLMs), especially in high-stakes code intelligence tasks. As LLMs become increasingly integrated into software engineering tasks, understanding and…

Software Engineering · Computer Science 2025-11-04 Cuiyun Gao , Guodong Fan , Chun Yong Chong , Shizhan Chen , Chao Liu , David Lo , Zibin Zheng , Qing Liao

Generating accurate radiology reports from medical images is a clinically important but challenging task. While current Vision Language Models (VLMs) show promise, they are prone to generating hallucinations, potentially compromising…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Serena Zhang , Sraavya Sambara , Oishi Banerjee , Julian Acosta , L. John Fahrner , Pranav Rajpurkar

Masked diffusion language models (MDLMs) enable parallel decoding by predicting all masked positions at each denoising step, yet existing training-free samplers usually decide which positions to commit at token-level granularity. We revisit…

Machine Learning · Computer Science 2026-05-29 Heqiang Qi , Wei Huang , Mingyuan Bai , Xiangming Meng

Multimodal Chain-of-Thought (MCoT) models have demonstrated impressive capability in complex visual reasoning tasks. Unfortunately, recent studies reveal that they suffer from severe hallucination problems due to diminished visual attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang