English
Related papers

Related papers: Interpretability Beyond Feature Attribution: Quant…

200 papers

The interpretability of machine learning models has been an essential area of research for the safe deployment of machine learning systems. One particular approach is to attribute model decisions to high-level concepts that humans can…

Machine Learning · Computer Science 2022-09-14 Varsha Pendyala , Jihye Choi

Image Classification and Video Action Recognition are perhaps the two most foundational tasks in computer vision. Consequently, explaining the inner workings of trained deep neural networks is of prime importance. While numerous efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Avinab Saha , Shashank Gupta , Sravan Kumar Ankireddy , Karl Chahine , Joydeep Ghosh

Robustness of machine learning models on ever-changing real-world data is critical, especially for applications affecting human well-being such as content moderation. New kinds of abusive language continually emerge in online discussions in…

Computation and Language · Computer Science 2022-04-06 Isar Nejadgholi , Kathleen C. Fraser , Svetlana Kiritchenko

In explainable AI, Concept Activation Vectors (CAVs) are typically obtained by training linear classifier probes to detect human-understandable concepts as directions in the activation space of deep neural networks. It is widely assumed…

Artificial Intelligence · Computer Science 2025-11-07 Jacob Lysnæs-Larsen , Marte Eggen , Inga Strümke

Learning useful representations of complex data has been the subject of extensive research for many years. With the diffusion of Deep Neural Networks, Variational Autoencoders have gained lots of attention since they provide an explicit…

Machine Learning · Computer Science 2020-09-15 Marco Maggipinto , Matteo Terzi , Gian Antonio Susto

Recent research in deep learning methodology has led to a variety of complex modelling techniques in computer vision (CV) that reach or even outperform human performance. Although these black-box deep learning models have obtained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Anh Pham Thi Minh

Plant diseases remain a considerable threat to food security and agricultural sustainability. Rapid and early identification of these diseases has become a significant concern motivating several studies to rely on the increasing global…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Jihen Amara , Birgitta König-Ries , Sheeba Samuel

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

An essential step in deploying medical imaging models is ensuring alignment with clinical knowledge and interpretability. We focus on mapping clinical concepts into the latent space of generative models to identify Concept Activation…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Bulat Maksudov , Kathleen Curran , Alessandra Mileo

Concept activation vector (CAV) has attracted broad research interest in explainable AI, by elegantly attributing model predictions to specific concepts. However, the training of CAV often necessitates a large number of high-quality images,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Qihan Huang , Jie Song , Mengqi Xue , Haofei Zhang , Bingde Hu , Huiqiong Wang , Hao Jiang , Xingen Wang , Mingli Song

Concept Activation Vectors (CAVs) are widely used to model human-understandable concepts as directions within the latent space of neural networks. They are trained by identifying directions from the activations of concept samples to those…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Eren Erogullari , Sebastian Lapuschkin , Wojciech Samek , Frederik Pahde

The rapid adoption of transformer-based models in computational pathology has enabled prediction of molecular and clinical biomarkers from H&E whole-slide images, yet interpretability has not kept pace with model complexity. While…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Marco Gustav , Fabian Wolf , Christina Glasner , Nic G. Reitsam , Stefan Schulz , Kira Aschenbroich , Bruno Märkl , Sebastian Foersch , Jakob Nikolas Kather

With the rise of deep neural networks, especially in safety-critical applications, robustness and interpretability are crucial to ensure their trustworthiness. Recent advances in 3D-aware classifiers that map image features to volumetric…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Nhi Pham , Artur Jesslen , Bernt Schiele , Adam Kortylewski , Jonas Fischer

Deep learning methods for classifying medical images have demonstrated impressive accuracy in a wide range of tasks but often these models are hard to interpret, limiting their applicability in clinical practice. In this work we introduce a…

Image and Video Processing · Electrical Eng. & Systems 2019-08-13 James R. Clough , Ilkay Oksuz , Esther Puyol-Anton , Bram Ruijsink , Andrew P. King , Julia A. Schnabel

Convolutional neural networks have been shown to develop internal representations, which correspond closely to semantically meaningful objects and parts, although trained solely on class labels. Class Activation Mapping (CAM) is a recent…

Computer Vision and Pattern Recognition · Computer Science 2016-05-26 Amir Rosenfeld , Shimon Ullman

Decisions made by convolutional neural networks(CNN) can be understood and explained by visualizing discriminative regions on images. To this end, Class Activation Map (CAM) based methods were proposed as powerful interpretation tools,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yi Liao , Yongsheng Gao , Weichuan Zhang

Concept-based explanations permit to understand the predictions of a deep neural network (DNN) through the lens of concepts specified by users. Existing methods assume that the examples illustrating a concept are mapped in a fixed direction…

Machine Learning · Computer Science 2022-09-30 Jonathan Crabbé , Mihaela van der Schaar

Methods for model explainability have become increasingly critical for testing the fairness and soundness of deep learning. Concept-based interpretability techniques, which use a small set of human-interpretable concept exemplars in order…

Machine Learning · Computer Science 2022-07-27 Davis Brown , Henry Kvinge

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao