English
Related papers

Related papers: Learning Bottleneck Concepts in Image Classificati…

200 papers

In this paper, we introduce an explainable algorithm designed from a multi-modal foundation model, that performs fast and explainable image classification. Drawing inspiration from CLIP-based Concept Bottleneck Models (CBMs), our method…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Concept Bottleneck Models (CBMs) first map raw input(s) to a vector of human-defined concepts, before using this vector to predict a final classification. We might therefore expect CBMs capable of predicting concepts based on distinct…

Artificial Intelligence · Computer Science 2023-02-08 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

Explainable AI (XAI) has become essential in computer vision to make the decision-making processes of deep learning models transparent. However, current visual explanation (XAI) methods face a critical trade-off between the high fidelity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Gwanghee Lee , Sungyoon Jeong , Kyoungson Jhang

We propose an interpretable Capsule Network, iCaps, for image classification. A capsule is a group of neurons nested inside each layer, and the one in the last layer is called a class capsule, which is a vector whose norm indicates a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Dahuin Jung , Jonghyun Lee , Jihun Yi , Sungroh Yoon

Concept Bottleneck Models (CBMs) are machine learning models that improve interpretability by grounding their predictions on human-understandable concepts, allowing for targeted interventions in their decision-making process. However, when…

In this paper, we introduce a novel interpreting framework that learns an interpretable model based on an ontology-based sampling technique to explain agnostic prediction models. Different from existing approaches, our algorithm considers…

Machine Learning · Computer Science 2020-04-02 Phung Lai , NhatHai Phan , Han Hu , Anuja Badeti , David Newman , Dejing Dou

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

Recognizing target objects using an event-based camera draws more and more attention in recent years. Existing works usually represent the event streams into point-cloud, voxel, image, etc, and learn the feature representations using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Chengguo Yuan , Yu Jin , Zongzhen Wu , Fanting Wei , Yangzirui Wang , Lan Chen , Xiao Wang

We propose an automated genomic interpretation module that transforms raw DNA sequences into actionable, interpretable decisions suitable for integration into medical automation and robotic systems. Our framework combines Chaos Game…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zijun Li , Jinchang Zhang , Ming Zhang , Guoyu Lu

Concept Bottleneck Models (CBMs) map dense feature representations into human-interpretable concepts which are then combined linearly to make a prediction. However, modern CBMs rely on the CLIP model to obtain image-concept annotations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fawaz Sammani , Jonas Fischer , Nikos Deligiannis

We present a new Deep Dictionary Learning and Coding Network (DDLCN) for image recognition tasks with limited data. The proposed DDLCN has most of the standard deep learning layers (e.g., input/output, pooling, fully connected, etc.), but…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Hao Tang , Hong Liu , Wei Xiao , Nicu Sebe

Interpretation and explanation of deep models is critical towards wide adoption of systems that rely on them. In this paper, we propose a novel scheme for both interpretation as well as explanation in which, given a pretrained model, we…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Jose Oramas , Kaili Wang , Tinne Tuytelaars

Deep learning models have achieved strong performance in medical image analysis, but their internal decision processes remain difficult to interpret. Concept Bottleneck Models (CBMs) partially address this limitation by structuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Getamesay Dagnaw , Xuefei Yin , Muhammad Hassan Maqsood , Yanming Zhu , Alan Wee-Chung Liew

A cognitive model of human learning provides information about skills a learner must acquire to perform accurately in a task domain. Cognitive models of learning are not only of scientific interest, but are also valuable in adaptive online…

Machine Learning · Computer Science 2018-06-22 Devendra Singh Chaplot , Christopher MacLellan , Ruslan Salakhutdinov , Kenneth Koedinger

We propose a novel architecture and method of explainable classification with Concept Bottleneck Models (CBMs). While SOTA approaches to Image Classification task work as a black box, there is a growing demand for models that would provide…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Andrei Semenov , Vladimir Ivanov , Aleksandr Beznosikov , Alexander Gasnikov

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

Machine Learning · Computer Science 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

We propose a novel approach to performing fine-grained 3D manipulation of image content via a convolutional neural network, which we call the Transformable Bottleneck Network (TBN). It applies given spatial transformations directly to a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Kyle Olszewski , Sergey Tulyakov , Oliver Woodford , Hao Li , Linjie Luo

Convolutional Neural Networks (CNNs) have proven to be state-of-the-art models for supervised computer vision tasks, such as image classification. However, large labeled data sets are generally needed for the training and validation of such…

Machine Learning · Computer Science 2020-10-28 Patrick Hemmer , Niklas Kühl , Jakob Schöffer

The last decade has seen huge progress in the development of advanced machine learning models; however, those models are powerless unless human users can interpret them. Here we show how the mind's construction of concepts and meaning can…

Machine Learning · Statistics 2016-07-04 Nick Condry