English
Related papers

Related papers: Concept-Centric Transformers: Enhancing Model Inte…

200 papers

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

We study the problem of concept induction in visual reasoning, i.e., identifying concepts and their hierarchical relationships from question-answer pairs associated with images; and achieve an interpretable model via working on the induced…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Zhonghao Wang , Kai Wang , Mo Yu , Jinjun Xiong , Wen-mei Hwu , Mark Hasegawa-Johnson , Humphrey Shi

Although neural models have achieved remarkable performance, they still encounter doubts due to the intransparency. To this end, model prediction explanation is attracting more and more attentions. However, current methods rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yong Guan , Freddy Lecue , Jiaoyan Chen , Ru Li , Jeff Z. Pan

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

In the context of image classification, Concept Bottleneck Models (CBMs) first embed images into a set of human-understandable concepts, followed by an intrinsically interpretable classifier that predicts labels based on these intermediate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Haifei Zhang , Patrick Barry , Eduardo Brandao

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

As artificial intelligence is increasingly affecting all parts of society and life, there is growing recognition that human interpretability of machine learning models is important. It is often argued that accuracy or other similar…

Machine Learning · Statistics 2018-06-27 Kush R. Varshney , Prashant Khanduri , Pranay Sharma , Shan Zhang , Pramod K. Varshney

An approach to improve network interpretability is via clusterability, i.e., splitting a model into disjoint clusters that can be studied independently. We find pretrained models to be highly unclusterable and thus train models to be more…

Machine Learning · Computer Science 2025-07-29 Satvik Golechha , Dylan Cope , Nandi Schoots

Concept bottleneck models (CBMs) improve neural network interpretability by introducing an intermediate layer that maps human-understandable concepts to predictions. Recent work has explored the use of vision-language models (VLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Xingbo Du , Qiantong Dou , Lei Fan , Rui Zhang

Continual learning aims to update models under distribution shift without forgetting, yet many high-stakes deployments, such as healthcare, also require interpretability. In practice, models that adapt well (e.g., deep networks) are often…

Machine Learning · Computer Science 2026-04-21 Dongkyu Cho , Xiyue Li , Samrachana Adhikari , Rumi Chunara

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Concept-based interpretability for Convolutional Neural Networks (CNNs) aims to align internal model representations with high-level semantic concepts, but existing approaches largely overlook the semantic roles of individual filters and…

Machine Learning · Computer Science 2025-09-24 Xinyu Mu , Hui Dou , Furao Shen , Jian Zhao

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

Machine Learning · Computer Science 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

Deep Neural Networks (DNNs) are often considered black boxes due to their opaque decision-making processes. To reduce their opacity Concept Models (CMs), such as Concept Bottleneck Models (CBMs), were introduced to predict human-defined…

Human-Computer Interaction · Computer Science 2025-12-02 Jack Furby , Dan Cunnington , Dave Braines , Alun Preece

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

Artificial Intelligence · Computer Science 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

While concept-based interpretability methods have traditionally focused on local explanations of neural network predictions, we propose a novel framework and interactive tool that extends these methods into the domain of mechanistic…

Machine Learning · Computer Science 2025-07-09 Sofiia Chorna , Kateryna Tarelkina , Eloïse Berthier , Gianni Franchi

To increase the trustworthiness of deep neural networks, it is critical to improve the understanding of how they make decisions. This paper introduces a novel unsupervised concept-based model for image classification, named Learnable…

Machine Learning · Computer Science 2025-06-04 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

Using attention weights to identify information that is important for models' decision-making is a popular approach to interpret attention-based neural networks. This is commonly realized in practice through the generation of a heat-map for…

Information Retrieval · Computer Science 2021-06-01 Tian Shi , Xuchao Zhang , Ping Wang , Chandan K. Reddy

Following the major success of neural language models (LMs) such as BERT or GPT-2 on a variety of language understanding tasks, recent work focused on injecting (structured) knowledge from external resources into these models. While on the…

Computation and Language · Computer Science 2020-10-13 Anne Lauscher , Olga Majewska , Leonardo F. R. Ribeiro , Iryna Gurevych , Nikolai Rozanov , Goran Glavaš

Deep learning methods are highly accurate, yet their opaque decision process prevents them from earning full human trust. Concept-based models aim to address this issue by learning tasks based on a set of human-understandable concepts.…