English
Related papers

Related papers: FastCAV: Efficient Computation of Concept Activati…

200 papers

Concept Activation Vectors (CAVs) are a fundamental tool for concept-based explainability in deep learning, yet their practical utility is limited by statistical instability. We analyze the stochastic nature of CAVs and the Testing with…

Machine Learning · Statistics 2026-05-18 Ekkehard Schnoor , Jawher Said , Malik Tiomoko , Wojciech Samek , Alexander Jung

The interpretability of machine learning models has been an essential area of research for the safe deployment of machine learning systems. One particular approach is to attribute model decisions to high-level concepts that humans can…

Machine Learning · Computer Science 2022-09-14 Varsha Pendyala , Jihye Choi

Traditional deep learning interpretability methods which are suitable for model users cannot explain network behaviors at the global level and are inflexible at providing fine-grained explanations. As a solution, concept-based explanations…

Human-Computer Interaction · Computer Science 2022-10-26 Jinbin Huang , Aditi Mishra , Bum Chul Kwon , Chris Bryan

Concept-based explanation methods, such as Concept Activation Vectors, are potent means to quantify how abstract or high-level characteristics of input data influence the predictions of complex deep neural networks. However, applying them…

Machine Learning · Computer Science 2023-10-18 Thomas Decker , Michael Lebacher , Volker Tresp

Concept-based explainable AI is promising as a tool to improve the understanding of complex models at the premises of a given user, viz.\ as a tool for personalized explainability. An important class of concept-based explainability methods…

Neural Networks and related Deep Learning methods are currently at the leading edge of technologies used for classifying objects. However, they generally demand large amounts of time and data for model training; and their learned models can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Malcolm C. A. White , Kushal Sharma , Ang Li , T. K. Satish Kumar , Nori Nakata

TCAV (Testing with Concept Activation Vectors) is an interpretability method that assesses the alignment between the internal representations of a trained neural network and human-understandable, high-level concepts. Though effective, TCAV…

Artificial Intelligence · Computer Science 2026-05-12 Hasib Aslam , Muhammad Ali Chattha , Muhammad Taha Mukhtar , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

With the rise of deep neural networks, especially in safety-critical applications, robustness and interpretability are crucial to ensure their trustworthiness. Recent advances in 3D-aware classifiers that map image features to volumetric…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Nhi Pham , Artur Jesslen , Bernt Schiele , Adam Kortylewski , Jonas Fischer

How can we understand classification decisions made by deep neural networks? Many existing explainability methods rely solely on correlations and fail to account for confounding, which may result in potentially misleading explanations. To…

Machine Learning · Computer Science 2020-03-02 Yash Goyal , Amir Feder , Uri Shalit , Been Kim

Concept Activation Vectors (CAVs) are widely used to model human-understandable concepts as directions within the latent space of neural networks. They are trained by identifying directions from the activations of concept samples to those…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Eren Erogullari , Sebastian Lapuschkin , Wojciech Samek , Frederik Pahde

Recent research in deep learning methodology has led to a variety of complex modelling techniques in computer vision (CV) that reach or even outperform human performance. Although these black-box deep learning models have obtained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Anh Pham Thi Minh

The interpretation of deep neural networks (DNNs) has become a key topic as more and more people apply them to solve various problems and making critical decisions. Concept-based explanations have recently become a popular approach for…

Human-Computer Interaction · Computer Science 2021-08-10 Zhenge Zhao , Panpan Xu , Carlos Scheidegger , Liu Ren

Image Classification and Video Action Recognition are perhaps the two most foundational tasks in computer vision. Consequently, explaining the inner workings of trained deep neural networks is of prime importance. While numerous efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Avinab Saha , Shashank Gupta , Sravan Kumar Ankireddy , Karl Chahine , Joydeep Ghosh

Concept-based explanations permit to understand the predictions of a deep neural network (DNN) through the lens of concepts specified by users. Existing methods assume that the examples illustrating a concept are mapped in a fixed direction…

Machine Learning · Computer Science 2022-09-30 Jonathan Crabbé , Mihaela van der Schaar

Plant diseases remain a considerable threat to food security and agricultural sustainability. Rapid and early identification of these diseases has become a significant concern motivating several studies to rely on the increasing global…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Jihen Amara , Birgitta König-Ries , Sheeba Samuel

Recurrent Neural Networks (RNNs) are often used for sequential modeling of adverse outcomes in electronic health records (EHRs) due to their ability to encode past clinical states. These deep, recurrent architectures have displayed…

An essential step in deploying medical imaging models is ensuring alignment with clinical knowledge and interpretability. We focus on mapping clinical concepts into the latent space of generative models to identify Concept Activation…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Bulat Maksudov , Kathleen Curran , Alessandra Mileo

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Neural network models are widely used in a variety of domains, often as black-box solutions, since they are not directly interpretable for humans. The field of explainable artificial intelligence aims at developing explanation methods to…

Machine Learning · Computer Science 2023-07-25 Patrik Hammersborg , Inga Strümke

This thesis explores advanced approaches to improve explainability in computer vision by analyzing and modeling the features exploited by deep neural networks. Initially, it evaluates attribution methods, notably saliency maps, by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Thomas Fel