English
Related papers

Related papers: Do Concept Bottleneck Models Respect Localities?

200 papers

Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are generally challenging to obtain, making it crucial to leverage…

Machine Learning · Computer Science 2024-11-06 Alba Carballo-Castro , Sonia Laguna , Moritz Vandenhirtz , Julia E. Vogt

Concept-based interpretability methods offer a lens into the internals of foundation models by decomposing their embeddings into high-level concepts. These concept representations are most useful when they are compositional, meaning that…

Computation and Language · Computer Science 2024-06-27 Adam Stein , Aaditya Naik , Yinjun Wu , Mayur Naik , Eric Wong

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods…

Machine Learning · Computer Science 2023-03-17 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

Concept Bottleneck Models (CBMs) enable interpretable image classification by structuring predictions around human-understandable concepts, but extending this paradigm to video remains challenging due to the difficulty of extracting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Patrick Knab , Sascha Marton , Philipp J. Schubert , Drago Guggiana , Christian Bartelt

In this paper, we explore connections between interpretable machine learning and learning theory through the lens of local approximation explanations. First, we tackle the traditional problem of performance generalization and bound the…

Machine Learning · Computer Science 2020-11-03 Jeffrey Li , Vaishnavh Nagarajan , Gregory Plumb , Ameet Talwalkar

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

Prototype-based interpretability methods provide intuitive explanations of model prediction by comparing samples to a reference set of memorized exemplars or typical representatives in terms of similarity. In the field of sequential data…

Machine Learning · Computer Science 2023-03-20 Yifei Zhang , Neng Gao , Cunqing Ma

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Concept Bottleneck Models (CBMs) ground image classification on human-understandable concepts to allow for interpretable model decisions. Crucially, the CBM design inherently allows for human interventions, in which expert users are given…

Machine Learning · Computer Science 2024-08-07 Nishad Singhi , Jae Myung Kim , Karsten Roth , Zeynep Akata

Mechanistic interpretability identifies internal circuits responsible for model behaviors, yet translating these findings into human-understandable explanations remains an open problem. We present a pipeline that bridges circuit-level…

Computation and Language · Computer Science 2026-03-12 Ajay Pravin Mahale

To build intelligent machine learning systems, there are two broad approaches. One approach is to build inherently interpretable models, as endeavored by the growing field of causal representation learning. The other approach is to build…

Machine Learning · Computer Science 2024-12-10 Goutham Rajendran , Simon Buchholz , Bryon Aragam , Bernhard Schölkopf , Pradeep Ravikumar

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper

Model interpretability is an increasingly important component of practical machine learning. Some of the most common forms of interpretability systems are example-based, local, and global explanations. One of the main challenges in…

Machine Learning · Computer Science 2019-01-08 Gregory Plumb , Denali Molitor , Ameet Talwalkar

There is a need of ensuring machine learning models that are interpretable. Higher interpretability of the model means easier comprehension and explanation of future predictions for end-users. Further, interpretable machine learning models…

Machine Learning · Computer Science 2020-08-17 Gregor Stiglic , Primoz Kocbek , Nino Fijacko , Marinka Zitnik , Katrien Verbert , Leona Cilar