English
Related papers

Related papers: Failing Conceptually: Concept-Based Explanations o…

200 papers

Concept Bottleneck Models (CBMs) aim to enhance interpretability by structuring predictions around human-understandable concepts. However, unintended information leakage, where predictive signals bypass the concept bottleneck, compromises…

Machine Learning · Computer Science 2025-07-22 Mikael Makonnen , Moritz Vandenhirtz , Sonia Laguna , Julia E Vogt

Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jessica Echterhoff , An Yan , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

The term dataset shift refers to the situation where the data used to train a machine learning model is different from where the model operates. While several types of shifts naturally occur, existing shift detectors are usually designed to…

Machine Learning · Computer Science 2021-06-29 Simona Maggio , Léo Dreyfus-Schmidt

This note continues study of exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the observations. Such processes can be used for detecting violations of the IID assumption, which is…

Machine Learning · Computer Science 2020-12-29 Vladimir Vovk

Concept-based models are an emerging paradigm in deep learning that constrains the inference process to operate through human-interpretable variables, facilitating explainability and human interaction. However, these architectures, on par…

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

Concept Drift has been extensively studied within the context of Stream Learning. However, it is often assumed that the deployed model's predictions play no role in the concept drift the system experiences. Closer inspection reveals that…

Machine Learning · Computer Science 2025-04-02 Brandon Gower-Winter , Georg Krempl , Sergey Dragomiretskiy , Tineke Jelsma , Arno Siebes

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

In the context of image classification, Concept Bottleneck Models (CBMs) first embed images into a set of human-understandable concepts, followed by an intrinsically interpretable classifier that predicts labels based on these intermediate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Haifei Zhang , Patrick Barry , Eduardo Brandao

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

Non-stationarity of an underlying data generating process that leads to distributional changes over time is a key characteristic of Data Streams. This phenomenon, commonly referred to as Concept Drift, has been intensively studied, and…

Machine Learning · Computer Science 2026-02-09 Brandon Gower-Winter , Misja Groen , Georg Krempl

Concept bottleneck models are interpretable predictive models that are often used in domains where model trust is a key priority, such as healthcare. They identify a small number of human-interpretable concepts in the data, which they then…

Machine Learning · Computer Science 2024-12-25 Katrina Brown , Marton Havasi , Finale Doshi-Velez

Supervised learning techniques typically assume training data originates from the target population. Yet, in reality, dataset shift frequently arises, which, if not adequately taken into account, may decrease the performance of their…

Deep learning representations are often difficult to interpret, which can hinder their deployment in sensitive applications. Concept Bottleneck Models (CBMs) have emerged as a promising approach to mitigate this issue by learning…

Machine Learning · Computer Science 2026-01-30 Antonio Almudévar , José Miguel Hernández-Lobato , Alfonso Ortega

Machine learning on data streams is increasingly more present in multiple domains. However, there is often data distribution shift that can lead machine learning models to make incorrect decisions. While there are automatic methods to…

Machine Learning · Computer Science 2022-05-02 João Palmeiro , Beatriz Malveiro , Rita Costa , David Polido , Ricardo Moreira , Pedro Bizarro

Concept bottleneck models (CBMs) improve neural network interpretability by introducing an intermediate layer that maps human-understandable concepts to predictions. Recent work has explored the use of vision-language models (VLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xingbo Du , Qiantong Dou , Lei Fan , Rui Zhang

As AI models grow larger, the demand for accountability and interpretability has become increasingly critical for understanding their decision-making processes. Concept Bottleneck Models (CBMs) have gained attention for enhancing…

Machine Learning · Computer Science 2024-10-10 Angelos Ragkousis , Sonali Parbhoo

Concept shift occurs when the distribution of labels conditioned on the features changes between domains, which can make even a well-tuned ML model miscalibrated on a new domain. Identifying these shifted features provides unique insight…

Machine Learning · Computer Science 2026-05-29 Ruiqi Lyu , Alistair Turcan , Bryan Wilder

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their…

Machine Learning · Computer Science 2026-01-16 Reza M. Asiyabi , SEOSAW Partnership , Steven Hancock , Casey Ryan