English
Related papers

Related papers: E-TCAV: Formalizing Penultimate Proxies for Effici…

200 papers

Concept Activation Vectors (CAVs) provide a powerful approach for interpreting deep neural networks by quantifying their sensitivity to human-defined concepts. However, when computed independently at different layers, CAVs often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zhenghao He , Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

The interpretation of deep learning models is a challenge due to their size, complexity, and often opaque internal state. In addition, many systems, such as image classifiers, operate on low-level features rather than high-level concepts.…

Machine Learning · Statistics 2019-04-05 Been Kim , Martin Wattenberg , Justin Gilmer , Carrie Cai , James Wexler , Fernanda Viegas , Rory Sayres

Convolutional Neural Networks (CNNs) have seen significant performance improvements in recent years. However, due to their size and complexity, they function as black-boxes, leading to transparency concerns. State-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Antonio De Santis , Riccardo Campi , Matteo Bianchi , Marco Brambilla

Concept Activation Vectors (CAVs) are a fundamental tool for concept-based explainability in deep learning, yet their practical utility is limited by statistical instability. We analyze the stochastic nature of CAVs and the Testing with…

Machine Learning · Statistics 2026-05-18 Ekkehard Schnoor , Jawher Said , Malik Tiomoko , Wojciech Samek , Alexander Jung

To interpret deep learning models, one mainstream is to explore the learned concepts by networks. Testing with Concept Activation Vector (TCAV) presents a powerful tool to quantify the contribution of query concepts (represented by…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Andong Wang , Wei-Ning Lee

The interpretability of machine learning models has been an essential area of research for the safe deployment of machine learning systems. One particular approach is to attribute model decisions to high-level concepts that humans can…

Machine Learning · Computer Science 2022-09-14 Varsha Pendyala , Jihye Choi

Interpretability methods for image classification assess model trustworthiness by attempting to expose whether the model is systematically biased or attending to the same cues as a human would. Saliency methods for feature attribution…

Machine Learning · Statistics 2021-04-08 Jacob Pfau , Albert T. Young , Jerome Wei , Maria L. Wei , Michael J. Keiser

Concept-based explanations translate the internal representations of deep learning models into a language that humans are familiar with: concepts. One popular method for finding concepts is Concept Activation Vectors (CAVs), which are…

Machine Learning · Computer Science 2025-02-14 Angus Nicolson , Lisa Schut , J. Alison Noble , Yarin Gal

Concepts such as objects, patterns, and shapes are how humans understand the world. Building on this intuition, concept-based explainability methods aim to study representations learned by deep neural networks in relation to…

Machine Learning · Computer Science 2025-05-26 Laines Schmalwasser , Niklas Penzel , Joachim Denzler , Julia Niebling

Interpreting neural network decisions and the information learned in intermediate layers is still a challenge due to the opaque internal state and shared non-linear interactions. Although (Kim et al, 2017) proposed to interpret intermediate…

Machine Learning · Computer Science 2020-02-27 Rahul Soni , Naresh Shah , Chua Tat Seng , Jimmy D. Moore

Concept-based interpretability methods are a popular form of explanation for deep learning models which provide explanations in the form of high-level human interpretable concepts. These methods typically find concept activation vectors…

Machine Learning · Computer Science 2024-08-19 Angus Nicolson , Yarin Gal , J. Alison Noble

Concept Activation Vectors (CAVs) offer insights into neural network decision-making by linking human friendly concepts to the model's internal feature extraction process. However, when a new set of CAVs is discovered, they must still be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Laines Schmalwasser , Jakob Gawlikowski , Joachim Denzler , Julia Niebling

Convolutional neural network (CNN) models for computer vision are powerful but lack explainability in their most basic form. This deficiency remains a key challenge when applying CNNs in important domains. Recent work on explanations…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Ruihan Zhang , Prashan Madumal , Tim Miller , Krista A. Ehinger , Benjamin I. P. Rubinstein

Image Classification and Video Action Recognition are perhaps the two most foundational tasks in computer vision. Consequently, explaining the inner workings of trained deep neural networks is of prime importance. While numerous efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Avinab Saha , Shashank Gupta , Sravan Kumar Ankireddy , Karl Chahine , Joydeep Ghosh

In explainable AI, Concept Activation Vectors (CAVs) are typically obtained by training linear classifier probes to detect human-understandable concepts as directions in the activation space of deep neural networks. It is widely assumed…

Artificial Intelligence · Computer Science 2025-11-07 Jacob Lysnæs-Larsen , Marte Eggen , Inga Strümke

With a growing interest in understanding neural network prediction strategies, Concept Activation Vectors (CAVs) have emerged as a popular tool for modeling human-understandable concepts in the latent space. Commonly, CAVs are computed by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Frederik Pahde , Maximilian Dreyer , Leander Weber , Moritz Weckbecker , Christopher J. Anders , Thomas Wiegand , Wojciech Samek , Sebastian Lapuschkin

Concept Activation Vectors (CAVs) are a tool from explainable AI, offering a promising approach for understanding how human-understandable concepts are encoded in a model's latent spaces. They are computed from hidden-layer activations of…

Machine Learning · Statistics 2026-01-28 Ekkehard Schnoor , Malik Tiomoko , Jawher Said , Alex Jung , Wojciech Samek

Robustness of machine learning models on ever-changing real-world data is critical, especially for applications affecting human well-being such as content moderation. New kinds of abusive language continually emerge in online discussions in…

Computation and Language · Computer Science 2022-04-06 Isar Nejadgholi , Kathleen C. Fraser , Svetlana Kiritchenko

Humans use abstract concepts for understanding instead of hard features. Recent interpretability research has focused on human-centered concept explanations of neural networks. Concept Activation Vectors (CAVs) estimate a model's…

Machine Learning · Computer Science 2023-11-28 Avani Gupta , Saurabh Saini , P J Narayanan

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath
‹ Prev 1 2 3 10 Next ›