English
Related papers

Related papers: V2C-CBM: Building Concept Bottlenecks with Vision-…

200 papers

Concept Bottleneck Models (CBMs) enable interpretable image classification by structuring predictions around human-understandable concepts, but extending this paradigm to video remains challenging due to the difficulty of extracting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Patrick Knab , Sascha Marton , Philipp J. Schubert , Drago Guggiana , Christian Bartelt

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

Deep learning has achieved remarkable success in image recognition, yet their inherent opacity poses challenges for deployment in critical domains. Concept-based interpretations aim to address this by explaining model reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shizhan Gong , Xiaofan Zhang , Qi Dou

Concept bottleneck models (CBM) aim to produce inherently interpretable models that rely on human-understandable concepts for their predictions. However, existing approaches to design interpretable generative models based on CBMs are not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Akshay Kulkarni , Ge Yan , Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) try to make the decision-making process transparent by exploring an intermediate concept space between the input image and the output prediction. Existing CBMs just learn coarse-grained relations between the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Yan Xie , Zequn Zeng , Hao Zhang , Yucheng Ding , Yi Wang , Zhengjue Wang , Bo Chen , Hongwei Liu

Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verify whether learned concepts align with the human's intended…

Machine Learning · Computer Science 2026-05-22 Stefano Colamonaco , David Debot , Pietro Barbiero , Giuseppe Marra

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

The Concept Bottleneck Models (CBMs) of Koh et al. [2020] provide a means to ensure that a neural network based classifier bases its predictions solely on human understandable concepts. The concept labels, or rationales as we refer to them,…

Machine Learning · Computer Science 2022-12-20 Joshua Lockhart , Daniele Magazzeni , Manuela Veloso

The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs), are not designed to solve relational problems, while…

Machine Learning · Computer Science 2024-10-28 Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

Machine Learning · Computer Science 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Concept Bottleneck Models (CBMs) aim to enhance interpretability by predicting human-understandable concepts as intermediates for decision-making. However, these models often face challenges in ensuring reliable concept representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Yuxuan Cai , Xiyu Wang , Satoshi Tsutsui , Winnie Pang , Bihan Wen

The main challenges hindering the adoption of deep learning-based systems in clinical settings are the scarcity of annotated data and the lack of interpretability and trust in these systems. Concept Bottleneck Models (CBMs) offer inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Cristiano Patrício , Luís F. Teixeira , João C. Neves

We introduce the Concept Bottleneck Large Language Model (CB-LLM), a pioneering approach to creating inherently interpretable Large Language Models (LLMs). Unlike traditional black-box LLMs that rely on post-hoc interpretation methods with…

Computation and Language · Computer Science 2024-07-08 Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

We propose a novel, flexible, and efficient framework for designing Concept Bottleneck Models (CBMs) that enables practitioners to explicitly encode and extend their prior knowledge and beliefs about the concept-concept ($C-C$) and…

Machine Learning · Computer Science 2026-04-14 Nektarios Kalampalikis , Kavya Gupta , Georgi Vitanov , Isabel Valera

Concept Bottleneck Models (CBMs) first map raw input(s) to a vector of human-defined concepts, before using this vector to predict a final classification. We might therefore expect CBMs capable of predicting concepts based on distinct…

Artificial Intelligence · Computer Science 2023-02-08 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

Machine learning accelerates molecular property prediction, yet state-of-the-art Large Language Models and Graph Neural Networks operate as black boxes. In drug discovery, where safety is critical, this opacity risks masking false…

Machine Learning · Computer Science 2026-03-03 Oscar Rivera , Ziqing Wang , Matthieu Dagommer , Abhishek Pandey , Kaize Ding

Advancements in foundation models (FMs) have led to a paradigm shift in machine learning. The rich, expressive feature representations from these pre-trained, large-scale FMs are leveraged for multiple downstream tasks, usually via…

Machine Learning · Computer Science 2024-12-19 Jihye Choi , Jayaram Raghuram , Yixuan Li , Somesh Jha

Concept Bottleneck Models (CBMs) have emerged as a promising interpretable method whose final prediction is based on intermediate, human-understandable concepts rather than the raw input. Through time-consuming manual interventions, a user…

Machine Learning · Computer Science 2024-10-18 Moritz Vandenhirtz , Sonia Laguna , Ričards Marcinkevičs , Julia E. Vogt

Concept Bottleneck Models (CBMs) introduce interpretability to black-box deep learning models by predicting labels through human-understandable concepts. However, unlike humans, who identify objects at different levels of abstraction using…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Haodong Xie , Yujun Cai , Rahul Singh Maharjan , Yiwei Wang , Federico Tavella , Angelo Cangelosi