English
Related papers

Related papers: Robust and Interpretable Medical Image Classifiers…

200 papers

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Neural networks for computer vision extract uninterpretable features despite achieving high accuracy on benchmarks. In contrast, humans can explain their predictions using succinct and intuitive descriptions. To incorporate explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Khalid Saifullah , Yuxin Wen , Jonas Geiping , Micah Goldblum , Tom Goldstein

The integration of vision-language models such as CLIP and Concept Bottleneck Models (CBMs) offers a promising approach to explaining deep neural network (DNN) decisions using concepts understandable by humans, addressing the black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Townim F. Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Minh-Son To , Yutong Xie , Anton van den Hengel , Johan W. Verjans , Zhibin Liao

Concept Bottleneck Models (CBMs) offer inherent interpretability by initially translating images into human-comprehensible concepts, followed by a linear combination of these concepts for classification. However, the annotation of concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Lei Zhu , Xinliang Zhang , Shuang Zeng , Qian Chen , Yanye Lu

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Concept bottleneck models (CBMs), which predict human-interpretable concepts (e.g., nucleus shapes in cell images) before predicting the final output (e.g., cell type), provide insights into the decision-making processes of the model.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Winnie Pang , Xueyi Ke , Satoshi Tsutsui , Bihan Wen

Black-box deep neural networks excel in text classification, yet their application in high-stakes domains is hindered by their lack of interpretability. To address this, we propose Text Bottleneck Models (TBM), an intrinsically…

Computation and Language · Computer Science 2024-04-04 Josh Magnus Ludan , Qing Lyu , Yue Yang , Liam Dugan , Mark Yatskar , Chris Callison-Burch

Deep neural networks for medical image classification often fail to generalize consistently in clinical practice due to violations of the i.i.d. assumption and opaque decision-making. This paper examines interpretability in deep neural…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Mohammad Hossein Najafi , Mohammad Morsali , Mohammadreza Pashanejad , Saman Soleimani Roudi , Mohammad Norouzi , Saeed Bagheri Shouraki

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

We are concerned with the challenge of reliably classifying and assessing intracranial aneurysms using deep learning without compromising clinical transparency. While traditional black-box models achieve high predictive accuracy, their lack…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Toqa Khaled , Ahmad Al-Kabbany

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Deep neural network models have been proven to be very successful in image classification tasks, also for medical diagnosis, but their main concern is its lack of interpretability. They use to work as intuition machines with high…

Machine Learning · Computer Science 2019-04-26 Jordi de la Torre , Aida Valls , Domenec Puig

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Nan Yang , Jiahao Huang , Jianlong Zhou , Fang Chen

The lack of interpretability in the field of medical image analysis has significant ethical and legal implications. Existing interpretable methods in this domain encounter several challenges, including dependency on specific models,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Lijie Hu , Songning Lai , Wenshuo Chen , Hongru Xiao , Hongbin Lin , Lu Yu , Jingfeng Zhang , Di Wang

We introduce Concept Bottleneck Large Language Models (CB-LLMs), a novel framework for building inherently interpretable Large Language Models (LLMs). In contrast to traditional black-box LLMs that rely on limited post-hoc interpretations,…

Computation and Language · Computer Science 2025-09-09 Chung-En Sun , Tuomas Oikarinen , Berk Ustun , Tsui-Wei Weng

(Renyi Qu's Master's Thesis) Recent advancements in interpretable models for vision-language tasks have achieved competitive performance; however, their interpretability often suffers due to the reliance on unstructured text outputs from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Renyi Qu , Mark Yatskar

The main challenges hindering the adoption of deep learning-based systems in clinical settings are the scarcity of annotated data and the lack of interpretability and trust in these systems. Concept Bottleneck Models (CBMs) offer inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Explaining Deep Learning models is becoming increasingly important in the face of daily emerging multimodal models, particularly in safety-critical domains like medical imaging. However, the lack of detailed investigations into the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Anees Ur Rehman Hashmi , Dwarikanath Mahapatra , Mohammad Yaqub