English
Related papers

Related papers: Radiologist-Guided Causal Concept Bottleneck Model…

200 papers

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

Artificial Intelligence · Computer Science 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Understanding model predictions is critical in healthcare, to facilitate rapid verification of model correctness and to guard against use of models that exploit confounding variables. We introduce the challenging new task of explainable…

Image and Video Processing · Electrical Eng. & Systems 2022-08-23 Rachel Lea Draelos , Lawrence Carin

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai

An essential step in deploying medical imaging models is ensuring alignment with clinical knowledge and interpretability. We focus on mapping clinical concepts into the latent space of generative models to identify Concept Activation…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Bulat Maksudov , Kathleen Curran , Alessandra Mileo

Chest radiography is a widely used imaging modality for thoracic disease diagnosis, yet its conventional interpretation remains time-consuming and heavily dependent on expert knowledge. While deep learning has improved diagnostic efficiency…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Duy Nguyen Huu , Duy Hoang Khuong , Ngu Huynh Cong Viet

The pursuit of decision safety in clinical applications highlights the potential of concept-based methods in medical imaging. While these models offer active interpretability, they often suffer from concept leakages, where unintended…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yibo Gao , Hangqi Zhou , Zheyao Gao , Bomin Wang , Shangqi Gao , Sihan Wang , Xiahai Zhuang

Current clinical decision support systems (CDSSs) typically base their predictions on correlation, not causation. In recent years, causal machine learning (ML) has emerged as a promising way to improve decision-making with CDSSs by offering…

Human-Computer Interaction · Computer Science 2026-04-17 Domenique Zipperling , Lukas Schmidt , Benedikt Hahn , Niklas Kühl , Steven Kimbrough

Detecting and classifying lesions in breast ultrasound images is a promising application of artificial intelligence (AI) for reducing the burden of cancer in regions with limited access to mammography. Such AI systems are more likely to be…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Arianna Bunnell , Yannik Glaser , Dustin Valdez , Thomas Wolfgruber , Aleen Altamirano , Carol Zamora González , Brenda Y. Hernandez , Peter Sadowski , John A. Shepherd

Automating report generation for medical imaging promises to reduce workload and assist diagnosis in clinical practice. Recent work has shown that deep learning models can successfully caption natural images. However, learning from medical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring , Ling Shao

One of the central elements of any causal inference is an object called structural causal model (SCM), which represents a collection of mechanisms and exogenous sources of random variation of the system under investigation (Pearl, 2000). An…

Machine Learning · Computer Science 2022-10-05 Kevin Xia , Kai-Zhan Lee , Yoshua Bengio , Elias Bareinboim

Developing an interpretable system for generating reports in chest X-ray (CXR) analysis is becoming increasingly crucial in Computer-aided Diagnosis (CAD) systems, enabling radiologists to comprehend the decisions made by these systems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Trong Thang Pham , Ngoc-Vuong Ho , Nhat-Tan Bui , Thinh Phan , Patel Brijesh , Donald Adjeroh , Gianfranco Doretto , Anh Nguyen , Carol C. Wu , Hien Nguyen , Ngan Le

In this paper, we introduce an explainable algorithm designed from a multi-modal foundation model, that performs fast and explainable image classification. Drawing inspiration from CLIP-based Concept Bottleneck Models (CBMs), our method…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

Machine Learning · Computer Science 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Existing deep learning models for chest radiology often neglect patient metadata, limiting diagnostic accuracy and fairness. To bridge this gap, we introduce MetaCheX, a novel multimodal framework that integrates chest X-ray images with…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Nathan He , Cody Chen

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learning (CIL), which is…

Machine Learning · Computer Science 2026-04-17 Amirhosein Javadi , Tuomas Oikarinen , Tara Javidi , Tsui-Wei Weng

Dynamic Causal Modeling (DCM) is a Bayesian framework for inferring on hidden (latent) neuronal states, based on measurements of brain activity. Since its introduction in 2003 for functional magnetic resonance imaging data, DCM has been…

Quantitative Methods · Quantitative Biology 2021-04-08 Inês Pereira , Stefan Frässle , Jakob Heinzle , Dario Schöbi , Cao Tri Do , Moritz Gruber , Klaas E. Stephan

Deep learning models for chest X-ray diagnosis are constrained by limited coverage of clinically meaningful concept combinations in publicly available training datasets. While synthetic image generation has been explored to increase data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Causal discovery for both cross-sectional and temporal data has traditionally followed a dataset-specific paradigm, where a new model is fitted for each individual dataset. Such an approach limits the potential of multi-dataset pretraining.…