English
Related papers

Related papers: Med-StepBench: A Hierarchical Reasoning Framework …

200 papers

While multimodal large language models (MLLMs) have achieved rapid progress in vision-language understanding, they remain prone to multimodal hallucinations, producing responses that are inconsistent with the visual input. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shizhe Zhou , Bohan Jia , Kai Wu , Yan Shen , Tongyun Li , Yuyang Wu , Shaohui Lin

Large language models (LLMs) offer transformative potential for clinical decision support in spine surgery but pose significant risks through hallucinations, which are factually inconsistent or contextually misaligned outputs that may…

Machine Learning · Computer Science 2025-11-21 Dong Chen , Yanzhe Wei , Zonglin He , Guan-Ming Kuang , Canhua Ye , Meiru An , Huili Peng , Yong Hu , Huiren Tao , Kenneth MC Cheung

Recent advances in microscopy have enabled the rapid generation of terabytes of image data in cell biology and biomedical research. Vision-language models (VLMs) offer a promising solution for large-scale biological image analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Alejandro Lozano , Jeffrey Nirschl , James Burgess , Sanket Rajan Gupte , Yuhui Zhang , Alyssa Unell , Serena Yeung-Levy

Recent advancements in multimodal large language models (MLLMs) have shown unprecedented capabilities in advancing various vision-language tasks. However, MLLMs face significant challenges with hallucinations, and misleading outputs that do…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Shengqiong Wu , Hao Fei , Liangming Pan , William Yang Wang , Shuicheng Yan , Tat-Seng Chua

Assessing whether an article supports an assertion is essential for hallucination detection and claim verification. While large language models (LLMs) have the potential to automate this task, achieving strong performance requires frontier…

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Despite the outstanding performance in multimodal tasks, Large Vision-Language Models (LVLMs) have been plagued by the issue of hallucination, i.e., generating content that is inconsistent with the corresponding visual inputs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Bei Yan , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

The hallucination of large multimodal models (LMMs), providing responses that appear correct but are actually incorrect, limits their reliability and applicability. This paper aims to study the hallucination problem of LMMs in video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hongcheng Gao , Jiashu Qu , Jingyi Tang , Baolong Bi , Yue Liu , Hongyu Chen , Li Liang , Li Su , Qingming Huang

Following the success of Large Language Models (LLMs), expanding their boundaries to new modalities represents a significant paradigm shift in multimodal understanding. Human perception is inherently multimodal, relying not only on text but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Kim Sung-Bin , Oh Hyun-Bin , JungMok Lee , Arda Senocak , Joon Son Chung , Tae-Hyun Oh

Medical vision-language models (VLMs) and AI agents have made significant progress in learning to analyze and reason about clinical images. However, existing medical visual question answering (VQA) benchmarks collapse model capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yixiong Chen , Wenjie Xiao , Pedro R. A. S. Bassi , Boyan Wang , Liang He , Xinze Zhou , Sezgin Er , Ibrahim Ethem Hamamci , Zongwei Zhou , Alan Yuille

Vision-language models have demonstrated impressive capabilities in general medical visual question answering, yet due to limited interpretability, it remains unclear whether their predictions reflect evidence-grounded clinical reasoning or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wen Ma , Fucheng Niu , Zhiting Fan , Zikai Xiao , Jiaxiang Liu , Zuozhu Liu

Vision-language models (VLMs) show promise in drafting radiology reports, yet they frequently suffer from logical inconsistencies, generating diagnostic impressions unsupported by their own perceptual findings or missing logically entailed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Vikash Singh , Debargha Ganguly , Haotian Yu , Chengwei Zhou , Prerna Singh , Brandon Lee , Vipin Chaudhary , Gourav Datta

Visual grounding is essential for precise perception and reasoning in multimodal large language models (MLLMs), especially in medical imaging domains. While existing medical visual grounding benchmarks primarily focus on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jingkun Yue , Siqi Zhang , Zinan Jia , Huihuan Xu , Zongbo Han , Xiaohong Liu , Guangyu Wang

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Vision Language Models (VLMs) are increasingly used for tasks like medical report generation and visual question answering. However, fluent diagnostic text does not guarantee safe visual understanding. In clinical practice, interpretation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Ufaq Khan , Umair Nawaz , L D M S S Teja , Numaan Saeed , Muhammad Bilal , Yutong Xie , Mohammad Yaqub , Muhammad Haris Khan

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Large Language Models (LLMs) have advanced machine translation but remain vulnerable to hallucinations. Unfortunately, existing MT benchmarks are not capable of exposing failures in multilingual LLMs. To disclose hallucination in…

Computation and Language · Computer Science 2025-10-29 Xinwei Wu , Heng Liu , Jiang Zhou , Xiaohu Zhao , Linlong Xu , Longyue Wang , Weihua Luo , Kaifu Zhang

Current vision-language models (VLMs) in medicine are primarily designed for categorical question answering (e.g., "Is this normal or abnormal?") or qualitative descriptive tasks. However, clinical decision-making often relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yongcheng Yao , Yongshuo Zong , Raman Dutt , Yongxin Yang , Sotirios A Tsaftaris , Timothy Hospedales

Existing medical reasoning benchmarks for vision-language models primarily focus on analyzing a patient's condition based on an image from a single visit. However, this setting deviates significantly from real-world clinical practice, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Junyi Zhang , Jia-Chen Gu , Wenbo Hu , Yu Zhou , Robinson Piramuthu , Nanyun Peng