English
Related papers

Related papers: Efficient Saliency Maps for Explainable AI

200 papers

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Hengyue Pan , Bo Wang , Hui Jiang

In this work, we investigate methods to reduce the noise in deep saliency maps coming from convolutional downsampling. Those methods make the investigated models more interpretable for gradient-based saliency maps, computed in hidden…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Rudolf Herdt , Maximilian Schmidt , Daniel Otero Baguer , Peter Maaß

In this paper, we propose a fast deep learning method for object saliency detection using convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify the input images based on the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Hengyue Pan , Hui Jiang

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

This paper proposes a novel saliency detection method by developing a deeply-supervised recurrent convolutional neural network (DSRCNN), which performs a full image-to-image saliency prediction. For saliency detection, the local, global,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Youbao Tang , Xiangqian Wu , Wei Bu

Gradient-based saliency maps are widely used to explain deep neural network decisions. However, as models become deeper and more black-box, such as in closed-source APIs like ChatGPT, computing gradients become challenging, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zeliang Zhang , Mingqian Feng , Jinyang Jiang , Rongyi Zhu , Yijie Peng , Chenliang Xu

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which require clear…

Machine Learning · Computer Science 2026-05-05 Daniel da Silva Costa , Pedro Nuno de Souza Moura , Adriana C. F. Alvim

High-quality saliency maps are essential in several machine learning application areas including explainable AI and weakly supervised object detection and segmentation. Many techniques have been developed to generate better saliency using…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Osman Tursun , Simon Denman , Sridha Sridharan , Clinton Fookes

The classification decisions of neural networks can be misled by small imperceptible perturbations. This work aims to explain the misled classifications using saliency methods. The idea behind saliency methods is to explain the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jindong Gu , Volker Tresp

Despite the tremendous achievements of deep convolutional neural networks (CNNs) in many computer vision tasks, understanding how they actually work remains a significant challenge. In this paper, we propose a novel two-step understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Heyi Li , Yunke Tian , Klaus Mueller , Xin Chen

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

The Convolutional Neural Network (CNN) is a widely used deep learning architecture for computer vision. However, its black box nature makes it difficult to interpret the behavior of the model. To mitigate this issue, AI practitioners have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Seok-Yong Byun , Wonju Lee

Saliency methods seek to explain the predictions of a model by producing an importance map across each input sample. A popular class of such methods is based on backpropagating a signal and analyzing the resulting gradient. Despite much…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Andrea Vedaldi

Saliency methods have been widely used to highlight important input features in model predictions. Most existing methods use backpropagation on a modified gradient function to generate saliency maps. Thus, noisy gradients can result in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Aya Abdelsalam Ismail , Héctor Corrada Bravo , Soheil Feizi

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this paper, we discover that a high-quality visual saliency model can be learned from multiscale features extracted using…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Guanbin Li , Yizhou Yu

The black-box nature of the deep networks makes the explanation for "why" they make certain predictions extremely challenging. Saliency maps are one of the most widely-used local explanation tools to alleviate this problem. One of the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Saeed Khorram , Tyler Lawson , Fuxin Li

Deep neural networks have shown their profound impact on achieving human level performance in visual saliency prediction. However, it is still unclear how they learn the task and what it means in terms of understanding human visual system.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Sai Phani Kumar Malladi , Jayanta Mukhopadhyay , Chaker Larabi , Santanu Chaudhury