English
Related papers

Related papers: Constructing Concept-based Models to Mitigate Spur…

200 papers

Concept-based explainability methods use human-understandable intermediaries to produce explanations for machine learning models. These methods assume concept predictions can help understand a model's internal reasoning. In this work, we…

Machine Learning · Computer Science 2025-06-26 Naveen Raman , Mateo Espinosa Zarlenga , Juyeon Heo , Mateja Jamnik

To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable…

Machine Learning · Computer Science 2025-06-04 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

Multimodal foundation models offer promising advancements for enhancing driving perception systems, but their high computational and financial costs pose challenges. We develop a method that leverages foundation models to refine predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yunhao Yang , Yuxin Hu , Mao Ye , Zaiwei Zhang , Zhichao Lu , Yi Xu , Ufuk Topcu , Ben Snyder

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

Concept-Based Models (CBMs) are a class of deep learning models that provide interpretability by explaining predictions through high-level concepts. These models first predict concepts and then use them to perform a downstream task.…

Machine Learning · Computer Science 2025-06-27 David Debot , Pietro Barbiero , Gabriele Dominici , Giuseppe Marra

Interpretability and explainability of neural networks is continuously increasing in importance, especially within safety-critical domains and to provide the social right to explanation. Concept based explanations align well with how humans…

Machine Learning · Computer Science 2023-09-11 Rishabh Jain

Developing high-performing, yet interpretable models remains a critical challenge in modern AI. Concept-based models (CBMs) attempt to address this by extracting human-understandable concepts from a global encoding (e.g., image encoding)…

Machine Learning · Computer Science 2025-10-08 David Steinmann , Wolfgang Stammer , Antonia Wüst , Kristian Kersting

Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

We introduce the Concept Bottleneck Large Language Model (CB-LLM), a pioneering approach to creating inherently interpretable Large Language Models (LLMs). Unlike traditional black-box LLMs that rely on post-hoc interpretation methods with…

Computation and Language · Computer Science 2024-07-08 Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

Concept-based Models (CMs) enhance interpretability in deep learning by grounding predictions in human-understandable concepts. However, concept annotations are costly and rarely available at scale within a single data source. Federated…

Concept-based explanation approach is a popular model interpertability tool because it expresses the reasons for a model's predictions in terms of concepts that are meaningful for the domain experts. In this work, we study the problem of…

Machine Learning · Computer Science 2021-05-25 Mohammad Taha Bahadori , David E. Heckerman

This paper addresses explainable AI (XAI) through the lens of Concept Bottleneck Models (CBMs) that do not require explicit concept annotations, relying instead on concepts extracted using CLIP in a zero-shot manner. We show that CLIP,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Rémi Kazmierczak , Steve Azzolin , Eloïse Berthier , Goran Frehse , Gianni Franchi

Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 An Yan , Yu Wang , Yiwu Zhong , Zexue He , Petros Karypis , Zihan Wang , Chengyu Dong , Amilcare Gentili , Chun-Nan Hsu , Jingbo Shang , Julian McAuley

While RFML is expected to be a key enabler of future wireless standards, a significant challenge to the widespread adoption of RFML techniques is the lack of explainability in deep learning models. This work investigates the use of CB…

Signal Processing · Electrical Eng. & Systems 2021-01-06 Lauren J. Wong , Sean McPherson

Two traditions of interpretability have evolved side by side but seldom spoken to each other: Concept Bottleneck Models (CBMs), which prescribe what a concept should be, and Sparse Autoencoders (SAEs), which discover what concepts emerge.…

Artificial Intelligence · Computer Science 2025-12-09 Alexandre Rocchi--Henry , Thomas Fel , Gianni Franchi

Concept-based learning enhances prediction accuracy and interpretability by leveraging high-level, human-understandable concepts. However, existing CBL frameworks do not address survival analysis tasks, which involve predicting event times…

Machine Learning · Computer Science 2025-02-11 Stanislav R. Kirpichenko , Lev V. Utkin , Andrei V. Konstantinov , Natalya M. Verbova

Medical image segmentation typically demands extensive dense annotations for model training, which is both time-consuming and skill-intensive. To mitigate this burden, exemplar-based medical image segmentation methods have been introduced…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Qing En , Yuhong Guo

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learning (CIL), which is…

Machine Learning · Computer Science 2026-04-17 Amirhosein Javadi , Tuomas Oikarinen , Tara Javidi , Tsui-Wei Weng

Pretrained language models (PLMs) have made significant strides in various natural language processing tasks. However, the lack of interpretability due to their ``black-box'' nature poses challenges for responsible implementation. Although…

Computation and Language · Computer Science 2023-11-10 Zhen Tan , Lu Cheng , Song Wang , Yuan Bo , Jundong Li , Huan Liu

Model calibration seeks to ensure that models produce confidence scores that accurately reflect the true likelihood of their predictions being correct. However, existing calibration approaches are fundamentally tied to datasets of one-hot…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Haoyang Luo , Linwei Tao , Minjing Dong , Chang Xu