English
Related papers

Related papers: Forward Learning for Gradient-based Black-box Sali…

200 papers

Most saliency estimation methods aim to explicitly model low-level conspicuity cues such as edges or blobs and may additionally incorporate top-down cues using face or text detection. Data-driven methods for training saliency models using…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Saumya Jetley , Naila Murray , Eleonora Vig

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Carola Figueroa-Flores , David Berga , Joost van der Weijer , Bogdan Raducanu

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

Gradients of neural networks encode valuable information for optimization, editing, and analysis of models. Therefore, practitioners often treat gradients as inputs to task-specific algorithms, e.g. for pruning or optimization. Recent works…

Machine Learning · Computer Science 2025-10-14 Yoav Gelberg , Yam Eitan , Aviv Navon , Aviv Shamsian , Theo , Putterman , Michael Bronstein , Haggai Maron

Visual saliency models have recently begun to incorporate deep learning to achieve predictive capacity much greater than previous unsupervised methods. However, most existing models predict saliency using local mechanisms limited to the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Samuel Dodge , Lina Karam

In this paper, an enhancement technique for the class activation mapping methods such as gradient-weighted class activation maps or excitation backpropagation is proposed to present the visual explanations of decisions from convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Tomasz Szandala

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model…

Machine Learning · Statistics 2017-05-23 Piotr Dabkowski , Yarin Gal

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

This paper addresses the visualisation of image classification models, learnt using deep Convolutional Networks (ConvNets). We consider two visualisation techniques, based on computing the gradient of the class score with respect to the…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

The black-box nature of Deep Neural Networks (DNNs) severely hinders its performance improvement and application in specific scenes. In recent years, class activation mapping-based method has been widely used to interpret the internal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Chunyan Zeng , Kang Yan , Zhifeng Wang , Yan Yu , Shiyan Xia , Nan Zhao

Gaining insight into how deep convolutional neural network models perform image classification and how to explain their outputs have been a concern to computer vision researchers and decision makers. These deep models are often referred to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Daniel Omeiza , Skyler Speakman , Celia Cintas , Komminist Weldermariam

This paper proposes a new gradient-based XAI method called Guided AbsoluteGrad for saliency map explanations. We utilize both positive and negative gradient magnitudes and employ gradient variance to distinguish the important areas for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jun Huang , Yan Liu

Gradient-based optimization is the foundation of deep learning and reinforcement learning. Even when the mechanism being optimized is unknown or not differentiable, optimization using high-variance or biased gradient estimates is still…

Machine Learning · Computer Science 2018-02-27 Will Grathwohl , Dami Choi , Yuhuai Wu , Geoffrey Roeder , David Duvenaud

Traditional saliency map methods, popularized in computer vision, highlight individual points (pixels) of the input that contribute the most to the model's output. However, in time series, they offer limited insights, as semantically…

Machine Learning · Computer Science 2026-05-08 Christodoulos Kechris , Jonathan Dan , David Atienza

Feature maps in deep neural network generally contain different semantics. Existing methods often omit their characteristics that may lead to sub-optimal results. In this paper, we propose a novel end-to-end deep saliency network which…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Fengdong Sun , Wenhui Li , Yuanyuan Guan

Saliency maps have become one of the most widely used interpretability techniques for convolutional neural networks (CNN) due to their simplicity and the quality of the insights they provide. However, there are still some doubts about…

Artificial Intelligence · Computer Science 2023-09-25 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Alexandre Englebert , Olivier Cornu , Christophe De Vleeschouwer

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Computation and Language · Computer Science 2023-06-08 Nils Feldhus , Leonhard Hennig , Maximilian Dustin Nasert , Christopher Ebert , Robert Schwarzenberg , Sebastian Möller