English
Related papers

Related papers: Concepts Worth Having: Refining VLM-Guided Concept…

200 papers

The recent mass adoption of DNNs, even in safety-critical scenarios, has shifted the focus of the research community towards the creation of inherently intrepretable models. Concept Bottleneck Models (CBMs) constitute a popular approach…

Machine Learning · Computer Science 2023-08-22 Konstantinos P. Panousis , Dino Ienco , Diego Marcos

While deep learning models often lack interpretability, concept bottleneck models (CBMs) provide inherent explanations via their concept representations. Moreover, they allow users to perform interventional interactions on these concepts by…

Machine Learning · Computer Science 2024-06-05 David Steinmann , Wolfgang Stammer , Felix Friedrich , Kristian Kersting

Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty…

Artificial Intelligence · Computer Science 2026-04-28 Tanmoy Mukherjee , Thomas Bailleux , Pierre Marquis , Zied Bouraoui

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable…

Machine Learning · Computer Science 2025-06-04 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

Large, publicly available clinical datasets have emerged as a novel resource for understanding disease heterogeneity and to explore personalization of therapy. These datasets are derived from data not originally collected for research…

Machine Learning · Computer Science 2025-08-14 Anish Narain , Ritam Majumdar , Nikita Narayanan , Dominic Marshall , Sonali Parbhoo

Concept bottleneck models (CBM) aim to improve model interpretability by predicting human level "concepts" in a bottleneck within a deep learning model architecture. However, how the predicted concepts are used in predicting the target…

Machine Learning · Computer Science 2025-04-15 Matthew Shen , Aliyah Hsu , Abhineet Agarwal , Bin Yu

Concept-based learning enhances prediction accuracy and interpretability by leveraging high-level, human-understandable concepts. However, existing CBL frameworks do not address survival analysis tasks, which involve predicting event times…

Machine Learning · Computer Science 2025-02-11 Stanislav R. Kirpichenko , Lev V. Utkin , Andrei V. Konstantinov , Natalya M. Verbova

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Explainable AI seeks to bring light to the decision-making processes of black-box models. Traditional saliency-based methods, while highlighting influential data segments, often lack semantic understanding. Recent advancements, such as…

Artificial Intelligence · Computer Science 2023-10-12 Bo Pan , Zhenke Liu , Yifei Zhang , Liang Zhao

Recent concept-based interpretable models have succeeded in providing meaningful explanations by pre-defined concept sets. However, the dependency on the pre-defined concepts restricts the application because of the limited number of…

Artificial Intelligence · Computer Science 2025-02-19 Shin'ya Yamaguchi , Kosuke Nishida

Recent studies suggest that transformer-based vision-language models (VLMs) capture the multimodality of concept processing in the human brain. However, a systematic evaluation exploring different types of VLM architectures and the role…

Computation and Language · Computer Science 2026-01-23 Anna Bavaresco , Marianne de Heer Kloots , Sandro Pezzelle , Raquel Fernández

Despite the transformative impact of deep learning across multiple domains, the inherent opacity of these models has driven the development of Explainable Artificial Intelligence (XAI). Among these efforts, Concept Bottleneck Models (CBMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Songning Lai , Jiayu Yang , Yu Huang , Lijie Hu , Tianlang Xue , Zhangyi Hu , Jiaxu Li , Haicheng Liao , Yutao Yue

Concept bottleneck model (CBM) is a ubiquitous method that can interpret neural networks using concepts. In CBM, concepts are inserted between the output layer and the last intermediate layer as observable values. This helps in…

Machine Learning · Statistics 2023-03-17 Naoki Hayashi , Yoshihide Sawada

Deep learning has advanced NLP, but interpretability remains limited, especially in healthcare and finance. Concept bottleneck models tie predictions to human concepts in vision, but NLP versions either use binary activations that harm text…

Computation and Language · Computer Science 2026-03-31 Yibo Yang

This paper addresses explainable AI (XAI) through the lens of Concept Bottleneck Models (CBMs) that do not require explicit concept annotations, relying instead on concepts extracted using CLIP in a zero-shot manner. We show that CLIP,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Rémi Kazmierczak , Steve Azzolin , Eloïse Berthier , Goran Frehse , Gianni Franchi

Automated ICD-10 coding from clinical discharge summaries requires models that are both accurate on long-tailed multi-label classification tasks and interpretable to clinicians. Concept Bottleneck Models (CBMs) offer a principled framework…

Machine Learning · Computer Science 2026-05-12 Mohammed Sameer Syed , Xuan Lu

In zero-shot image recognition tasks, humans demonstrate remarkable flexibility in classifying unseen categories by composing known simpler concepts. However, existing vision-language models (VLMs), despite achieving significant progress…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hui Liu , Wenya Wang , Kecheng Chen , Jie Liu , Yibing Liu , Tiexin Qin , Peisong He , Xinghao Jiang , Haoliang Li