English
Related papers

Related papers: MedConcept: Unsupervised Concept Discovery for Int…

200 papers

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub

Medical concept extraction from electronic health records underpins many downstream applications, yet remains challenging because medically meaningful concepts are frequently implied rather than explicitly stated in medical narratives.…

Computation and Language · Computer Science 2026-05-21 Zhichao Yang , Gregory D. Lyng , Sanjit Singh Batra , Robert E. Tillman

Concept-based models aim to explain model decisions with human-understandable concepts. However, most existing approaches treat concepts as numerical attributes, without providing complementary visual explanations that could localize the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Current vision-language models (VLMs) in medicine are primarily designed for categorical question answering (e.g., "Is this normal or abnormal?") or qualitative descriptive tasks. However, clinical decision-making often relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yongcheng Yao , Yongshuo Zong , Raman Dutt , Yongxin Yang , Sotirios A Tsaftaris , Timothy Hospedales

The lack of interpretability in the field of medical image analysis has significant ethical and legal implications. Existing interpretable methods in this domain encounter several challenges, including dependency on specific models,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Lijie Hu , Songning Lai , Wenshuo Chen , Hongru Xiao , Hongbin Lin , Lu Yu , Jingfeng Zhang , Di Wang

Vision Language Models (VLMs) are increasingly used for tasks like medical report generation and visual question answering. However, fluent diagnostic text does not guarantee safe visual understanding. In clinical practice, interpretation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Ufaq Khan , Umair Nawaz , L D M S S Teja , Numaan Saeed , Muhammad Bilal , Yutong Xie , Mohammad Yaqub , Muhammad Haris Khan

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate…

Computation and Language · Computer Science 2026-04-08 Han Jang , Junhyeok Lee , Heeseong Eum , Kyu Sung Choi

Models based on human-understandable concepts have received extensive attention to improve model interpretability for trustworthy artificial intelligence in the field of medical image analysis. These methods can provide convincing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hongmei Wang , Junlin Hou , Hao Chen

Radiology Report Generation (RRG) through Vision-Language Models (VLMs) promises to reduce documentation burden, improve reporting consistency, and accelerate clinical workflows. However, their clinical adoption remains limited by the lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Marco Salmè , Federico Siciliano , Fabrizio Silvestri , Paolo Soda , Rosa Sicilia , Valerio Guarrasi

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Multimodal Large Language Models (MLLMs) have tremendous potential to improve the accuracy, availability, and cost-effectiveness of healthcare by providing automated solutions or serving as aids to medical professionals. Despite promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Mohammad Shahab Sepehri , Zalan Fabian , Maryam Soltanolkotabi , Mahdi Soltanolkotabi

Large vision-language models (VLMs) demonstrate strong performance in medical image understanding, but frequently generate clinically plausible yet incorrect statements, raising significant safety concerns. Existing medical hallucination…

Machine unlearning in Vision-Language Models (VLMs) is typically performed at the image or instance level, making it difficult to precisely remove target knowledge without affecting unrelated semantics. This issue is especially pronounced…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Shen Lin , Jing Lin , Junhao Dong , Piotr Koniusz , Li Xu

Human-interpretable predictions are essential for deploying AI in medical imaging, yet most interpretable-by-design (IBD) frameworks require concept annotations for training data, which are costly and impractical to obtain in clinical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Md Nahiduzzaman , Steven Korevaar , Alireza Bab-Hadiashar , Ruwan Tennakoon

Medical Vision Language Pretraining (VLP) has recently emerged as a promising solution to the scarcity of labeled data in the medical domain. By leveraging paired/unpaired vision and text datasets through self-supervised learning, models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Prashant Shrestha , Sanskar Amgain , Bidur Khanal , Cristian A. Linte , Binod Bhattarai

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

The clinical adoption of artificial intelligence (AI) in medical imaging requires models that are both diagnostically accurate and interpretable to clinicians. While current multimodal biomedical foundation models prioritize performance,…

Recent studies suggest that transformer-based vision-language models (VLMs) capture the multimodality of concept processing in the human brain. However, a systematic evaluation exploring different types of VLM architectures and the role…

Computation and Language · Computer Science 2026-01-23 Anna Bavaresco , Marianne de Heer Kloots , Sandro Pezzelle , Raquel Fernández

The main challenges hindering the adoption of deep learning-based systems in clinical settings are the scarcity of annotated data and the lack of interpretability and trust in these systems. Concept Bottleneck Models (CBMs) offer inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Cristiano Patrício , Luís F. Teixeira , João C. Neves
‹ Prev 1 2 3 10 Next ›