English
Related papers

Related papers: Do Concept Bottleneck Models Respect Localities?

200 papers

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

Recent research on graph neural network (GNN) models successfully applied GNNs to classical graph algorithms and combinatorial optimisation problems. This has numerous benefits, such as allowing applications of algorithms when preconditions…

Machine Learning · Computer Science 2021-07-16 Dobrik Georgiev , Pietro Barbiero , Dmitry Kazhdan , Petar Veličković , Pietro Liò

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Machine learning is a vital part of many real-world systems, but several concerns remain about the lack of interpretability, explainability and robustness of black-box AI systems. Concept Bottleneck Models (CBM) address some of these…

Machine Learning · Statistics 2025-10-24 Hidde Fokkema , Tim van Erven , Sara Magliacane

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

Computation and Language · Computer Science 2025-07-17 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

Concept Bottleneck Models (CBMs) aim to deliver interpretable predictions by routing decisions through a human-understandable concept layer, yet they often suffer reduced accuracy and concept leakage that undermines faithfulness. We…

Machine Learning · Computer Science 2026-02-17 Karim Galliamov , Syed M Ahsan Kazmi , Adil Khan , Adín Ramírez Rivera

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry

Concept-based Models aim to improve interpretability by predicting high-level intermediate concepts, representing a promising approach for deployment in high-risk scenarios. However, they are known to suffer from information leakage,…

Machine Learning · Computer Science 2026-03-25 Enrico Parisini , Tapabrata Chakraborti , Chris Harbron , Ben D. MacArthur , Christopher R. S. Banerji

Concept Bottleneck Models (CBMs) aim for ante-hoc interpretability by learning a bottleneck layer that predicts interpretable concepts before the decision. State-of-the-art approaches typically select which concepts to learn via human…

Machine Learning · Computer Science 2026-03-10 Antonio De Santis , Schrasing Tong , Marco Brambilla , Lalana Kagal

Concept-based explanations work by mapping complex model computations to human-understandable concepts. Evaluating such explanations is very difficult, as it includes not only the quality of the induced space of possible concepts but also…

Computation and Language · Computer Science 2025-06-05 Antonin Poché , Alon Jacovi , Agustin Martin Picard , Victor Boutin , Fanny Jourdan

Large language models have exhibited impressive performance across a broad range of downstream tasks in natural language processing. However, how a language model predicts the next token and generates content is not generally understandable…

Concept explanation is a popular approach for examining how human-interpretable concepts impact the predictions of a model. However, most existing methods for concept explanations are tailored to specific models. To address this issue, this…

Machine Learning · Computer Science 2024-01-17 Zhili Feng , Michal Moshkovitz , Dotan Di Castro , J. Zico Kolter

Automated Machine Learning-based systems' integration into a wide range of tasks has expanded as a result of their performance and speed. Although there are numerous advantages to employing ML-based systems, if they are not interpretable,…

Machine Learning · Computer Science 2022-12-08 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Enhancing model interpretability can address spurious correlations by revealing how models draw their predictions. Concept Bottleneck Models (CBMs) can provide a principled way of disclosing and guiding model behaviors through…

Machine Learning · Computer Science 2024-07-15 Jeeyung Kim , Ze Wang , Qiang Qiu

Concept Bottleneck Models (CBMs) promote interpretability by grounding predictions in human-understandable concepts. However, existing CBMs typically fix their task predictor to a single linear or Boolean expression, limiting both…

Concept Bottleneck Models (CBMs) provide inherent interpretability by first mapping input samples to high-level semantic concepts, followed by a combination of these concepts for the final classification. However, the annotation of…

Machine Learning · Computer Science 2026-03-02 Yangyi Li , Mengdi Huai

The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, these models are often treated as black boxes, with limited systematic investigation of their…

Machine Learning · Computer Science 2026-05-13 Konstantinos P. Panousis , Diego Marcos

Local model interpretation methods explain individual predictions by assigning an importance value to each input feature. This value is often determined by measuring the change in confidence when a feature is removed. However, the…

Computation and Language · Computer Science 2018-11-08 Eric Wallace , Shi Feng , Jordan Boyd-Graber

The local and global interpretability of various ML models has been studied extensively in recent years. However, despite significant progress in the field, many known results remain informal or lack sufficient mathematical rigor. We…

Machine Learning · Computer Science 2024-06-10 Shahaf Bassan , Guy Amir , Guy Katz

Machine Learning (ML) provides important techniques for classification and predictions. Most of these are black-box models for users and do not provide decision-makers with an explanation. For the sake of transparency or more validity of…

Machine Learning · Computer Science 2021-02-26 Léonard Kwuida , Dmitry I. Ignatov