English
Related papers

Related papers: Concept Boundary Vectors

200 papers

Concept-based Models are neural networks that learn a concept extractor to map inputs to high-level concepts and an inference layer to translate these into predictions. Ensuring these modules produce interpretable concepts and behave…

Machine Learning · Computer Science 2026-01-15 Samuele Bortolotti , Emanuele Marconato , Paolo Morettin , Andrea Passerini , Stefano Teso

Concept bottleneck models (CBMs) are interpretable neural networks that first predict labels for human-interpretable concepts relevant to the prediction task, and then predict the final label based on the concept label predictions. We…

Machine Learning · Computer Science 2023-04-28 Kushal Chauhan , Rishabh Tiwari , Jan Freyberg , Pradeep Shenoy , Krishnamurthy Dvijotham

Concept-based Models are a class of inherently explainable networks that improve upon standard Deep Neural Networks by providing a rationale behind their predictions using human-understandable `concepts'. With these models being highly…

Machine Learning · Computer Science 2025-06-06 Sanchit Sinha , Aidong Zhang

Concept Bottleneck Models (CBMs) are regarded as inherently interpretable because they first predict a set of human-defined concepts which are used to predict a task label. For inherent interpretability to be fully realised, and ensure…

Machine Learning · Computer Science 2024-07-31 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

Machine Learning · Computer Science 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

There is a lot of research interest in encoding variable length sentences into fixed length vectors, in a way that preserves the sentence meanings. Two common methods include representations based on averaging word vectors, and…

Computation and Language · Computer Science 2017-02-10 Yossi Adi , Einat Kermany , Yonatan Belinkov , Ofer Lavi , Yoav Goldberg

Concept-based explainability methods use human-understandable intermediaries to produce explanations for machine learning models. These methods assume concept predictions can help understand a model's internal reasoning. In this work, we…

Machine Learning · Computer Science 2025-06-26 Naveen Raman , Mateo Espinosa Zarlenga , Juyeon Heo , Mateja Jamnik

A large body of recent work has identified transformations in the latent spaces of generative adversarial networks (GANs) that consistently and interpretably transform generated images. But existing techniques for identifying these…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Sarah Schwettmann , Evan Hernandez , David Bau , Samuel Klein , Jacob Andreas , Antonio Torralba

Boundaries are among the primary visual cues used by human and computer vision systems. One of the key problems in boundary detection is the label representation, which typically leads to class imbalance and, as a consequence, to thick…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Edoardo Mello Rella , Ajad Chhatkuli , Yun Liu , Ender Konukoglu , Luc Van Gool

Concept Bottleneck Models (CBMs) assume that training examples (e.g., x-ray images) are annotated with high-level concepts (e.g., types of abnormalities), and perform classification by first predicting the concepts, followed by predicting…

Computation and Language · Computer Science 2023-12-19 Danis Alukaev , Semen Kiselev , Ilya Pershin , Bulat Ibragimov , Vladimir Ivanov , Alexey Kornaev , Ivan Titov

Transformer language models (LMs) have been shown to represent concepts as directions in the latent space of hidden activations. However, for any human-interpretable concept, how can we find its direction in the latent space? We present a…

Computation and Language · Computer Science 2024-04-02 David Chanin , Anthony Hunter , Oana-Maria Camburu

The notion of concept has been studied for centuries, by philosophers, linguists, cognitive scientists, and researchers in artificial intelligence (Margolis & Laurence, 1999). There is a large literature on formal, mathematical models of…

Artificial Intelligence · Computer Science 2021-01-14 Stephen Clark , Alexander Lerchner , Tamara von Glehn , Olivier Tieleman , Richard Tanburn , Misha Dashevskiy , Matko Bosnjak

Explicit concept space models have proven efficacy for text representation in many natural language and text mining applications. The idea is to embed textual structures into a semantic space of concepts which captures the main ideas,…

Computation and Language · Computer Science 2018-12-21 Walid Shalaby , Wlodek Zadrozny

Neural networks deliver impressive predictive performance across a variety of tasks, but they are often opaque in their decision-making processes. Despite a growing interest in mechanistic interpretability, tools for systematically…

Machine Learning · Computer Science 2026-04-09 Ricardo Knauer , Andre Beinrucker , Erik Rodner

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

Artificial Intelligence · Computer Science 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Recurrent neural networks have been very successful at predicting sequences of words in tasks such as language modeling. However, all such models are based on the conventional classification framework, where the model is trained against…

Machine Learning · Computer Science 2017-03-14 Hakan Inan , Khashayar Khosravi , Richard Socher

Concept bottleneck models (CBMs) are a class of interpretable neural network models that predict the target response of a given input based on its high-level concepts. Unlike the standard end-to-end models, CBMs enable domain experts to…

Machine Learning · Computer Science 2023-07-04 Sungbin Shin , Yohan Jo , Sungsoo Ahn , Namhoon Lee

Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-level concepts (e.g., visible objects and their properties)…

Machine Learning · Computer Science 2026-05-12 Nicola Debole , Pietro Barbiero , Francesco Giannini , Andrea Passerini , Stefano Teso , Emanuele Marconato

Recent empirical evidence shows that LLM representations encode human-interpretable concepts. Nevertheless, the mechanisms by which these representations emerge remain largely unexplored. To shed further light on this, we introduce a novel…

Machine Learning · Computer Science 2026-03-03 Yuhang Liu , Dong Gong , Yichao Cai , Erdun Gao , Zhen Zhang , Biwei Huang , Mingming Gong , Anton van den Hengel , Javen Qinfeng Shi

We explore the interpretability of 3D geometric deep learning models in the context of Computer-Aided Design (CAD). The field of parametric CAD can be limited by the difficulty of expressing high-level design concepts in terms of a few…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Stefan Druc , Aditya Balu , Peter Wooldridge , Adarsh Krishnamurthy , Soumik Sarkar