English
Related papers

Related papers: Hallucination Filtering in Radiology Vision-Langua…

200 papers

Despite rapid advances, Large Vision-Language Models (LVLMs) still suffer from hallucinations, i.e., generating content inconsistent with input or established world knowledge, which correspond to faithfulness and factuality hallucinations,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Bei Yan , Zhiyuan Chen , Yuecong Min , Jie Zhang , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Latent diffusion models for medical image super-resolution universally inherit variational autoencoders designed for natural photographs. We show that this default choice, not the diffusion architecture, is the dominant constraint on…

The global shortage of healthcare workers has demanded the development of smart healthcare assistants, which can help monitor and alert healthcare workers when necessary. We examine the healthcare knowledge of existing Large Vision Language…

Computation and Language · Computer Science 2024-10-10 Sourjyadip Ray , Kushal Gupta , Soumi Kundu , Payal Arvind Kasat , Somak Aditya , Pawan Goyal

Contemporary vision-language models (VLMs) perform well on existing multimodal reasoning benchmarks (78-85\% accuracy on MMMU, MathVista). Yet, these results fail to sufficiently distinguish true scientific reasoning articulation…

Computation and Language · Computer Science 2025-11-13 Arka Mukherjee , Shreya Ghosh

Despite the remarkable multimodal capabilities of Large Vision-Language Models (LVLMs), discrepancies often occur between visual inputs and textual outputs--a phenomenon we term visual hallucination. This critical reliability gap poses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Tao Huang , Zhekun Liu , Rui Wang , Yang Zhang , Liping Jing

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Hallucinations of vision-language models (VLMs), which are misalignments between visual content and generated text, undermine the reliability of VLMs. One common approach for detecting them employs the same VLM, or a different one, to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Ofir Azachi , Kfir Eliyahu , Eyal El Ani , Rom Himelstein , Roi Reichart , Yuval Pinter , Nitay Calderon

Active Learning (AL) reduces annotation costs in medical imaging by selecting only the most informative samples for labeling, but suffers from cold-start when labeled data are scarce. Vision-Language Models (VLMs) address the cold-start…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Zhuofan Xie , Zishan Lin , Jinliang Lin , Jie Qi , Shaohua Hong , Shuo Li

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

Machine Learning · Computer Science 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

Deep learning models for medical image classification usually achieve promising results but typically rely on large, annotated datasets or standard transfer learning from ImageNet. Self-Supervised Learning (SSL) has emerged as a powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Joao Batista Florindo , Amanda Pontes de Oliveira Ornelas

Large vision-language models (LVLMs) have achieved remarkable performance on multimodal tasks. However, they still suffer from hallucinations, generating text inconsistent with visual input, posing significant risks in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Zhenglin Hua , Jinghan He , Zijun Yao , Tianxu Han , Haiyun Guo , Yuheng Jia , Junfeng Fang

Integrating large language models (LLMs) like DeepSeek R1 into healthcare requires rigorous evaluation of their reasoning alignment with clinical expertise. This study assesses DeepSeek R1's medical reasoning against expert patterns using…

Computation and Language · Computer Science 2025-04-02 Birger Moell , Fredrik Sand Aronsson , Sanian Akbar

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bidur Khanal , Sandesh Pokhrel , Sanjay Bhandari , Ramesh Rana , Nikesh Shrestha , Ram Bahadur Gurung , Cristian Linte , Angus Watson , Yash Raj Shrestha , Binod Bhattarai

While medical Multimodal Large Language Models (MLLMs) have shown promise in assisting diagnosis, they still frequently generate hallucinated responses that appear linguistically plausible but lack visual evidence. Such hallucinations pose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiayi Chen , Benteng Ma , Zehui Liao , Winston Chong , Yasmeen George , Jianfei Cai

Generative super-resolution (GSR) currently sets the state-of-the-art in terms of perceptual image quality, overcoming the "regression-to-the-mean" blur of prior non-generative models. However, from a human perspective, such models do not…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Weiming Ren , Raghav Goyal , Zhiming Hu , Tristan Ty Aumentado-Armstrong , Iqbal Mohomed , Alex Levinshtein

Large Language Models have revolutionized information processing, yet their reliability is severely compromised by faithfulness hallucinations. While current approaches attempt to mitigate this issue through node-level adjustments or coarse…

Computation and Language · Computer Science 2026-01-06 Chenxu Wang , Chaozhuo Li , Pengbo Wang , Litian Zhang , Songyang Liu , Ji Qi , Jiahui Hu , Yushan Cai , Hao Zhao , Rui Pu

Large language model hallucination represents a critical challenge where outputs deviate from factual accuracy due to distributional biases in training data. While recent investigations establish that specific hidden layers exhibit…

Computation and Language · Computer Science 2025-09-29 Wenkai Wang , Vincent Lee , Yizhen Zheng

Large language models (LLMs) often hallucinate, producing fluent but false information, partly because supervised fine-tuning (SFT) implicitly rewards always responding. We introduce $\textit{HypoTermInstruct}$, an SFT dataset (31,487…

Computation and Language · Computer Science 2026-03-19 Cem Uluoglakci , Tugba Taskaya Temizel

Large Language Models (LLMs) are prone to hallucinations, e.g., factually incorrect information, in their responses. These hallucinations present challenges for LLM-based applications that demand high factual accuracy. Existing…

Computation and Language · Computer Science 2025-03-13 Borui Yang , Md Afif Al Mamun , Jie M. Zhang , Gias Uddin

Large vision-language models (VLMs) enable joint processing of text and images. However, incorporating vision data significantly increases the prompt length, resulting in a longer time to first token (TTFT). This bottleneck can be…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Tharun Adithya Srikrishnan , Deval Shah , Timothy Hein , Ahmed Hasssan , Stephen Youn , Steven K. Reinhardt