English
Related papers

Related papers: Mitigating Spurious Background Bias in Multimedia …

200 papers

Concept Bottleneck Models (CBMs) have recently been proposed to address the 'black-box' problem of deep neural networks, by first mapping images to a human-understandable concept space and then linearly combining concepts for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Sukrut Rao , Sweta Mahajan , Moritz Böhle , Bernt Schiele

Concept Bottleneck Models (CBMs) map the inputs onto a set of interpretable concepts (``the bottleneck'') and use the concepts to make predictions. A concept bottleneck enhances interpretability since it can be investigated to understand…

Machine Learning · Computer Science 2023-02-03 Mert Yuksekgonul , Maggie Wang , James Zou

Concept Bottleneck Models (CBMs) have emerged as a promising interpretable method whose final prediction is based on intermediate, human-understandable concepts rather than the raw input. Through time-consuming manual interventions, a user…

Machine Learning · Computer Science 2024-10-18 Moritz Vandenhirtz , Sonia Laguna , Ričards Marcinkevičs , Julia E. Vogt

Interpretable deep learning aims at developing neural architectures whose decision-making processes could be understood by their users. Among these techniqes, Concept Bottleneck Models enhance the interpretability of neural networks by…

Machine Learning · Computer Science 2024-05-28 Gabriele Dominici , Pietro Barbiero , Francesco Giannini , Martin Gjoreski , Marc Langhenirich

Machine learning is a vital part of many real-world systems, but several concerns remain about the lack of interpretability, explainability and robustness of black-box AI systems. Concept Bottleneck Models (CBM) address some of these…

Machine Learning · Statistics 2025-10-24 Hidde Fokkema , Tim van Erven , Sara Magliacane

Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of high-level semantic concepts. However, they require target…

Machine Learning · Computer Science 2026-04-06 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa , Yasutoshi Ida

Concept Bottleneck Models (CBMs) ground predictions in human-understandable concepts but face fundamental limitations: the absence of a metric to pre-evaluate concept relevance, the "linearity problem" causing recent CBMs to bypass the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Merve Tapli , Quentin Bouniot , Wolfgang Stammer , Zeynep Akata , Emre Akbas

Concept Bottleneck Models (CBMs) have emerged as a prominent paradigm for interpretable deep learning, learning by grounding predictions in human-understandable concepts. However, their practical deployment is hindered by the high cost of…

Machine Learning · Computer Science 2026-05-29 Ziye Chen , Hongbin Lin , Jie Li , Lijie Hu

Concept Bottleneck Models (CBMs) aim to deliver interpretable and interventionable predictions by bridging features and labels with human-understandable concepts. While recent CBMs show promising potential, they suffer from information…

Machine Learning · Computer Science 2024-02-12 Ao Sun , Yuanyuan Yuan , Pingchuan Ma , Shuai Wang

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohamed Harmanani , Bining Long , Zhuoxin Guo , Paul F. R. Wilson , Amirhossein Sabour , Minh Nguyen Nhat To , Gabor Fichtinger , Purang Abolmaesumi , Parvin Mousavi

Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-level concepts (e.g., visible objects and their properties)…

Machine Learning · Computer Science 2026-05-12 Nicola Debole , Pietro Barbiero , Francesco Giannini , Andrea Passerini , Stefano Teso , Emanuele Marconato

Concept Bottleneck Models (CBMs), which break down the reasoning process into the input-to-concept mapping and the concept-to-label prediction, have garnered significant attention due to their remarkable interpretability achieved by the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Qihan Huang , Jie Song , Jingwen Hu , Haofei Zhang , Yong Wang , Mingli Song

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Concept bottleneck models (CBMs) are interpretable models that first predict a set of semantically meaningful features, i.e., concepts, from observations that are subsequently used to condition a downstream task. However, the model's…

Machine Learning · Computer Science 2023-12-04 Renos Zabounidis , Ini Oguntola , Konghao Zhao , Joseph Campbell , Simon Stepputtis , Katia Sycara

Concept Bottleneck Models (CBM) map images to human-interpretable concepts before making class predictions. Recent approaches automate CBM construction by prompting Large Language Models (LLMs) to generate text concepts and employing Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Nithish Muthuchamy Selvaraj , Xiaobao Guo , Adams Wai-Kin Kong , Alex Kot

Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted interventions in their decision-making process. However, when…

Language Bottleneck Models (LBMs) are proposed to achieve interpretable image recognition by classifying images based on textual concept bottlenecks. However, current LBMs simply list all concepts together as the bottleneck layer, leading…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Jianyang Zhang , Qianli Luo , Guowu Yang , Wenjing Yang , Weide Liu , Guosheng Lin , Fengmao Lv

Deep learning-based medical image classification techniques are rapidly advancing in medical image analysis, making it crucial to develop accurate and trustworthy models that can be efficiently deployed across diverse clinical scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hangzhou He , Jiachen Tang , Lei Zhu , Kaiwen Li , Yanye Lu

Deep learning has achieved remarkable success in image recognition, yet their inherent opacity poses challenges for deployment in critical domains. Concept-based interpretations aim to address this by explaining model reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shizhan Gong , Xiaofan Zhang , Qi Dou

In recent years, Visual Anomaly Detection (VAD) has gained significant attention due to its ability to identify defects using only normal images during training. Many VAD models work without supervision but are still able to provide visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Arianna Stropeni , Valentina Zaccaria , Francesco Borsatti , Davide Dalle Pezze , Manuel Barusco , Gian Antonio Susto