English
Related papers

Related papers: Cross-Modal Conceptualization in Bottleneck Models

200 papers

Concept Bottleneck Models (CBMs) have garnered increasing attention due to their ability to provide concept-based explanations for black-box deep learning models while achieving high final prediction accuracy using human-like concepts.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Lijie Hu , Tianhao Huang , Huanyi Xie , Xilin Gong , Chenyang Ren , Zhengyu Hu , Lu Yu , Ping Ma , Di Wang

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

The main challenges limiting the adoption of deep learning-based solutions in medical workflows are the availability of annotated data and the lack of interpretability of such systems. Concept Bottleneck Models (CBMs) tackle the latter by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Cristiano Patrício , Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira , João C. Neves

Concept bottleneck models (CBMs) improve neural network interpretability by introducing an intermediate layer that maps human-understandable concepts to predictions. Recent work has explored the use of vision-language models (VLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xingbo Du , Qiantong Dou , Lei Fan , Rui Zhang

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim

Concept Bottleneck Models (CBMs) enhance interpretability by introducing a layer of human-understandable concepts between inputs and predictions. While recent methods automate concept generation using Large Language Models (LLMs) and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Delong Zhao , Qiang Huang , Di Yan , Yiqun Sun , Jun Yu

Concept Bottleneck Models (CBMs) decompose image classification into a process governed by interpretable, human-readable concepts. Recent advances in CBMs have used Large Language Models (LLMs) to generate candidate concepts. However, a…

Computation and Language · Computer Science 2025-06-03 Yiwen Jiang , Deval Mehta , Wei Feng , Zongyuan Ge

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

Concept Bottleneck Models (CBMs) introduce interpretability to black-box deep learning models by predicting labels through human-understandable concepts. However, unlike humans, who identify objects at different levels of abstraction using…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Haodong Xie , Yujun Cai , Rahul Singh Maharjan , Yiwei Wang , Federico Tavella , Angelo Cangelosi

Concept Bottleneck Models (CBMs) in medical imaging aim to improve model interpretability by predicting intermediate clinical concepts before final diagnoses. However, most existing CBMs treat concepts as discriminative predictors of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs), are not designed to solve relational problems, while…

Machine Learning · Computer Science 2024-10-28 Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

We propose a novel, flexible, and efficient framework for designing Concept Bottleneck Models (CBMs) that enables practitioners to explicitly encode and extend their prior knowledge and beliefs about the concept-concept ($C-C$) and…

Machine Learning · Computer Science 2026-04-14 Nektarios Kalampalikis , Kavya Gupta , Georgi Vitanov , Isabel Valera

The increasing use of neural networks in various applications has lead to increasing apprehensions, underscoring the necessity to understand their operations beyond mere final predictions. As a solution to enhance model transparency,…

Machine Learning · Computer Science 2023-11-21 Ivaxi Sheth , Samira Ebrahimi Kahou

Concept Bottleneck Models (CBMs) first map raw input(s) to a vector of human-defined concepts, before using this vector to predict a final classification. We might therefore expect CBMs capable of predicting concepts based on distinct…

Artificial Intelligence · Computer Science 2023-02-08 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a humanunderstandable concept layer. However, most previous studies focused on cases where the data, including…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Zhengyu Hu , Hongbin Lin , Cheng-Long Wang , Hui Xiong , Jingfeng Zhang , Di Wang

The main challenges hindering the adoption of deep learning-based systems in clinical settings are the scarcity of annotated data and the lack of interpretability and trust in these systems. Concept Bottleneck Models (CBMs) offer inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Cristiano Patrício , Luís F. Teixeira , João C. Neves