English
Related papers

Related papers: CONRep: Uncertainty-Aware Vision-Language Report D…

200 papers

Multimodal Large Language Models (MLLMs) have shown strong potential for radiology report generation, yet their clinical translation is hindered by architectural heterogeneity and the prevalence of factual hallucinations. Standard…

Machine Learning · Computer Science 2026-01-13 Kun Zhao , Siyuan Dai , Pan Wang , Jifeng Song , Hui Ji , Chenghua Lin , Liang Zhan , Haoteng Tang

Deep learning has advanced medical image classification, but interpretability challenges hinder its clinical adoption. This study enhances interpretability in Chest X-ray (CXR) classification by using concept bottleneck models (CBMs) and a…

Information Retrieval · Computer Science 2025-04-30 Hasan Md Tusfiqur Alam , Devansh Srivastav , Md Abdul Kadir , Daniel Sonntag

Automating radiology report generation with Large Vision-Language Models (LVLMs) holds great potential, yet these models often produce clinically critical hallucinations, posing serious risks. Existing hallucination detection methods…

Computation and Language · Computer Science 2025-10-28 Alois Thomas , Maya Varma , Jean-Benoit Delbrouck , Curtis P. Langlotz

Vision-Language Models (VLMs) have significantly advanced automated Radiology Report Generation (RRG). However, existing methods implicitly assume high-quality inputs, overlooking the noise and artifacts prevalent in real-world clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Hongze Zhu , Chen Hu , Jiaxuan Jiang , Hong Liu , Yawen Huang , Ming Hu , Tianyu Wang , Zhijian Wu , Yefeng Zheng

Volumetry is one of the principal downstream applications of 3D medical image segmentation, for example, to detect abnormal tissue growth or for surgery planning. Conformal Prediction is a promising framework for uncertainty quantification,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

In this paper, we consider enhancing medical visual-language pre-training (VLP) with domain-specific knowledge, by exploiting the paired image-text reports from the radiological daily practice. In particular, we make the following…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

Advancements in generative Artificial Intelligence (AI) hold great promise for automating radiology workflows, yet challenges in interpretability and reliability hinder clinical adoption. This paper presents an automated radiology report…

Medical imaging plays a crucial role in diagnosis, with radiology reports serving as vital documentation. Automating report generation has emerged as a critical need to alleviate the workload of radiologists. While machine learning has…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Ibrahim Ethem Hamamci , Sezgin Er , Bjoern Menze

The growing prevalence of large language models (LLMs) and vision-language models (VLMs) has heightened the need for reliable techniques to determine whether a model has been fine-tuned from or is even identical to another. Existing…

Machine Learning · Computer Science 2025-09-30 Ruibo Chen , Sheng Zhang , Yihan Wu , Tong Zheng , Peihua Mai , Heng Huang

As VLMs are deployed in safety-critical applications, their ability to abstain from answering when uncertain becomes crucial for reliability, especially in Scene Text Visual Question Answering (STVQA) tasks. For example, OCR errors like…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jihan Yao , Achin Kulshrestha , Nathalie Rauschmayr , Reed Roberts , Banghua Zhu , Yulia Tsvetkov , Federico Tombari

Automating radiology report generation can significantly alleviate radiologists' workloads. Previous research has primarily focused on realizing highly concise observations while neglecting the precise attributes that determine the severity…

Computation and Language · Computer Science 2023-10-24 Wenjun Hou , Yi Cheng , Kaishuai Xu , Wenjie Li , Jiang Liu

Counterfactual explanations (CFXs) provide human-understandable justifications for model predictions, enabling actionable recourse and enhancing interpretability. To be reliable, CFXs must avoid regions of high predictive uncertainty, where…

Machine Learning · Computer Science 2025-10-24 Aman Bilkhoo , Mehran Hosseini , Milad Kazemi , Nicola Paoletti

The rapid advancements in Vision Language Models (VLMs) have prompted the development of multi-modal medical assistant systems. Despite this progress, current models still have inherent probabilistic uncertainties, often producing erroneous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xiao Liang , Di Wang , Zhicheng Jiao , Ronghan Li , Pengfei Yang , Quan Wang , Tat-Seng Chua

In the realm of medical report generation (MRG), the integration of natural language processing has emerged as a vital tool to alleviate the workload of radiologists. Despite the impressive capabilities demonstrated by large vision language…

Computation and Language · Computer Science 2026-01-23 Ruoqing Zhao , Runze Xia , Piji Li

Increasing demands on medical imaging departments are taking a toll on the radiologist's ability to deliver timely and accurate reports. Recent technological advances in artificial intelligence have demonstrated great potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Phillip Sloan , Philip Clatworthy , Edwin Simpson , Majid Mirmehdi

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

With the continuous expansion of Large Language Models (LLMs) and advances in reinforcement learning, LLMs have demonstrated exceptional reasoning capabilities, enabling them to address a wide range of complex problems. Inspired by these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hongrui Jia , Chaoya Jiang , Shikun Zhang , Wei Ye

Deep learning models for medical imaging often exhibit overconfidence, creating safety risks in ambiguous diagnostic scenarios. While Conformal Prediction (CP) provides distribution-free statistical guarantees, standard methods such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 One Octadion , Novanto Yudistira , Lailil Muflikhah

To leverage the full potential of Large Language Models (LLMs) it is crucial to have some information on their answers' uncertainty. This means that the model has to be able to quantify how certain it is in the correctness of a given…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mirko Borszukovszki , Ivo Pascal de Jong , Matias Valdenegro-Toro