English
Related papers

Related papers: Advancing Attribution-Based Neural Network Explain…

200 papers

Interpreting the decisions of complex computer vision models is crucial to establish trust and accountability, especially in safety-critical domains. An established approach to interpretability is generating visual attribution maps that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 David Schinagl , Christian Fruhwirth-Reisinger , Alexander Prutsch , Samuel Schulter , Horst Possegger

In this paper, we tackle the problem of explanations in a deep-learning based model for recommendations by leveraging the technique of layer-wise relevance propagation. We use a Deep Convolutional Neural Network to extract relevant features…

Machine Learning · Computer Science 2018-07-18 Homanga Bharadhwaj

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Feature attribution maps are a popular approach to highlight the most important pixels in an image for a given prediction of a model. Despite a recent growth in popularity and available methods, little attention is given to the objective…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Arne Gevaert , Axel-Jan Rousseau , Thijs Becker , Dirk Valkenborg , Tijl De Bie , Yvan Saeys

The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential…

Image and Video Processing · Electrical Eng. & Systems 2019-10-02 Irina Grigorescu , Lucilio Cordero-Grande , A David Edwards , Jo Hajnal , Marc Modat , Maria Deprez

Feature attribution methods attempt to explain neural network predictions by identifying relevant features. However, establishing a cohesive framework for assessing feature attribution remains a challenge. There are several views through…

Machine Learning · Computer Science 2024-11-26 Yawei Li , Yang Zhang , Kenji Kawaguchi , Ashkan Khakzar , Bernd Bischl , Mina Rezaei

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

Machine learning-based imaging diagnostics has recently reached or even superseded the level of clinical experts in several clinical domains. However, classification decisions of a trained machine learning system are typically…

Deep neural networks are the default choice of learning models for computer vision tasks. Extensive work has been carried out in recent years on explaining deep models for vision tasks such as classification. However, recent work has shown…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Anindya Sarkar , Anirban Sarkar , Vineeth N Balasubramanian

Explaining recommendations enables users to understand whether recommended items are relevant to their needs and has been shown to increase their trust in the system. More generally, if designing explainable machine learning models is key…

Machine Learning · Computer Science 2020-08-27 Darius Afchar , Romain Hennequin

Deep neural networks are very successful on many vision tasks, but hard to interpret due to their black box nature. To overcome this, various post-hoc attribution methods have been proposed to identify image regions most influential to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Sukrut Rao , Moritz Böhle , Bernt Schiele

Automatic speech recognition (ASR) is improving ever more at mimicking human speech processing. The functioning of ASR, however, remains to a large extent obfuscated by the complex structure of the deep neural networks (DNNs) they are based…

Machine Learning · Computer Science 2022-02-03 Karla Markert , Romain Parracone , Mykhailo Kulakov , Philip Sperl , Ching-Yu Kao , Konstantin Böttinger

Numerous explanation methods have been recently developed to interpret the decisions made by deep neural network (DNN) models. For image classifiers, these methods typically provide an attribution score to each pixel in the image to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Ruo Yang , Binghui Wang , Mustafa Bilgic

We study the problem of attributing the prediction of a deep network to its input features, a problem previously studied by several other works. We identify two fundamental axioms---Sensitivity and Implementation Invariance that attribution…

Machine Learning · Computer Science 2017-06-14 Mukund Sundararajan , Ankur Taly , Qiqi Yan

Layer-wise relevance propagation is a framework which allows to decompose the prediction of a deep neural network computed over a sample, e.g. an image, down to relevance scores for the single input dimensions of the sample such as…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Alexander Binder , Grégoire Montavon , Sebastian Bach , Klaus-Robert Müller , Wojciech Samek

Responsible use of Authorship Verification (AV) systems not only requires high accuracy but also interpretable solutions. More importantly, for systems to be used to make decisions with real-world consequences requires the model's…

Computation and Language · Computer Science 2025-10-08 Peter Zeng , Pegah Alipoormolabashi , Jihu Mun , Gourab Dey , Nikita Soni , Niranjan Balasubramanian , Owen Rambow , H. Schwartz

We present an application of the Layer-wise Relevance Propagation (LRP) algorithm to state of the art deep convolutional neural networks and Fisher Vector classifiers to compare the image perception and prediction strategies of both…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Sebastian Bach , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Text documents can be described by a number of abstract concepts such as semantic category, writing style, or sentiment. Machine learning (ML) models have been trained to automatically map documents to these abstract concepts, allowing to…

Computation and Language · Computer Science 2017-11-01 Leila Arras , Franziska Horn , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

Attribution methods aim to explain a neural network's prediction by highlighting the most relevant image areas. A popular approach is to backpropagate (BP) a custom relevance score using modified rules, rather than the gradient. We analyze…

Machine Learning · Computer Science 2024-02-20 Leon Sixt , Maximilian Granz , Tim Landgraf

Attributing the output of a neural network to the contribution of given input elements is a way of shedding light on the black-box nature of neural networks. Due to the complexity of current network architectures, current gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Ashkan Khakzar , Soroosh Baselizadeh , Saurabh Khanduja , Christian Rupprecht , Seong Tae Kim , Nassir Navab