English
Related papers

Related papers: Mitigating Bias in Concept Bottleneck Models for F…

200 papers

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Concept Bottleneck Models (CBMs) enhance interpretability by introducing a layer of human-understandable concepts between inputs and predictions. While recent methods automate concept generation using Large Language Models (LLMs) and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Delong Zhao , Qiang Huang , Di Yan , Yiqun Sun , Jun Yu

Recently impressive performance has been achieved in Concept Bottleneck Models (CBM) by utilizing the image-text alignment learned by a large pre-trained vision-language model (i.e. CLIP). However, there exist two key limitations in concept…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Minghong Zhong , Guoshuai Zou , Kanghao Chen , Dexia Chen , Ruixuan Wang

Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making…

Machine Learning · Computer Science 2024-04-18 Chenming Shang , Shiji Zhou , Hengyuan Zhang , Xinzhe Ni , Yujiu Yang , Yuwang Wang

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a human-understandable concept layer. However, most previous studies focused on static scenarios where the data and…

Machine Learning · Computer Science 2026-01-05 Hongbin Lin , Chenyang Ren , Juangui Xu , Zhengyu Hu , Cheng-Long Wang , Yao Shu , Hui Xiong , Jingfeng Zhang , Di Wang , Lijie Hu

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

Deep learning has achieved remarkable success in image recognition, yet their inherent opacity poses challenges for deployment in critical domains. Concept-based interpretations aim to address this by explaining model reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shizhan Gong , Xiaofan Zhang , Qi Dou

The Concept Bottleneck Models (CBMs) of Koh et al. [2020] provide a means to ensure that a neural network based classifier bases its predictions solely on human understandable concepts. The concept labels, or rationales as we refer to them,…

Machine Learning · Computer Science 2022-12-20 Joshua Lockhart , Daniele Magazzeni , Manuela Veloso

Biases in machine learning pose significant challenges, particularly when models amplify disparities that affect disadvantaged groups. Traditional bias mitigation techniques often lead to a {\itshape leveling-down effect}, whereby improving…

Machine Learning · Computer Science 2025-09-03 Lucas Mansilla , Rodrigo Echeveste , Camila Gonzalez , Diego H. Milone , Enzo Ferrante

Concept Bottleneck Models (CBMs) try to make the decision-making process transparent by exploring an intermediate concept space between the input image and the output prediction. Existing CBMs just learn coarse-grained relations between the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Yan Xie , Zequn Zeng , Hao Zhang , Yucheng Ding , Yi Wang , Zhengjue Wang , Bo Chen , Hongwei Liu

Deep vision models often rely on biases learned from spurious correlations in datasets. To identify these biases, methods that interpret high-level, human-understandable concepts are more effective than those relying primarily on low-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 David Méndez , Gianpaolo Bontempo , Elisa Ficarra , Roberto Confalonieri , Natalia Díaz-Rodríguez

Concept Bottleneck Models (CBMs) provide inherent interpretability by first predicting a set of human-understandable concepts and then mapping them to labels through a simple classifier. While users can intervene in the concept space to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Hangzhou He , Lei Zhu , Kaiwen Li , Xinliang Zhang , Jiakui Hu , Ourui Fu , Zhengjian Yao , Yanye Lu

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

Concept Bottleneck Models (CBM) map images to human-interpretable concepts before making class predictions. Recent approaches automate CBM construction by prompting Large Language Models (LLMs) to generate text concepts and employing Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Nithish Muthuchamy Selvaraj , Xiaobao Guo , Adams Wai-Kin Kong , Alex Kot

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Schrasing Tong , Lalana Kagal

Concept-bottleneck models (CBMs) are neural classifiers that compute predictions from high-level concepts extracted from the input. CBMs ensure stakeholders can understand the concepts -- and the predictions they entail -- by learning these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Nicola Debole , Andrea Passerini , Stefano Teso , Andrea Pugnana , Emanuele Marconato

Concept Bottleneck Models (CBMs) map the inputs onto a set of interpretable concepts (``the bottleneck'') and use the concepts to make predictions. A concept bottleneck enhances interpretability since it can be investigated to understand…

Machine Learning · Computer Science 2023-02-03 Mert Yuksekgonul , Maggie Wang , James Zou