English
Related papers

Related papers: Evaluating Input Perturbation Methods for Interpre…

200 papers

Adversarial algorithms have shown to be effective against neural networks for a variety of tasks. Some adversarial algorithms perturb all the pixels in the image minimally for the image classification task in image classification. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Carola Figueroa-Flores , David Berga , Joost van der Weijer , Bogdan Raducanu

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Saliency methods interpret the prediction of a neural network by showing the importance of input elements for that prediction. A popular family of saliency methods utilize gradient information. In this work, we empirically show that two…

Machine Learning · Computer Science 2020-12-02 Ashkan Khakzar , Soroosh Baselizadeh , Nassir Navab

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

There is great interest in "saliency methods" (also called "attribution methods"), which give "explanations" for a deep net's decision, by assigning a "score" to each feature/pixel in the input. Their design usually involves…

Machine Learning · Computer Science 2019-06-10 Arushi Gupta , Sanjeev Arora

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which require clear…

Machine Learning · Computer Science 2026-05-05 Daniel da Silva Costa , Pedro Nuno de Souza Moura , Adriana C. F. Alvim

We propose a framework inspired by biological vision systems to produce saliency maps of digital images. Well-known computational models for receptive fields of areas in the visual cortex that are specialized for color and orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Reza Hojjaty Saeedy , Richard A. Messner

Saliency maps have become a widely used method to assess which areas of the input image are most pertinent to the prediction of a trained neural network. However, in the context of medical imaging, there is no study to our knowledge that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nishanth Thumbavanam Arun , Nathan Gaw , Praveer Singh , Ken Chang , Katharina Viktoria Hoebel , Jay Patel , Mishka Gidwani , Jayashree Kalpathy-Cramer

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion metrics are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Lars Nieradzik , Henrike Stephani , Janis Keuper

In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make…

Machine Learning · Computer Science 2018-03-26 Chiliang Zhang , Zhimou Yang , Zuochang Ye

Saliency methods are widely used to visualize which input features are deemed relevant to a model's prediction. However, their visual plausibility can obscure critical limitations. In this work, we propose a diagnostic test for class…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Dane Williamson , Yangfeng Ji , Matthew Dwyer

While deep learning is remarkably successful on perceptual tasks, it was also shown to be vulnerable to adversarial perturbations of the input. These perturbations denote noise added to the input that was generated specifically to fool the…

Machine Learning · Statistics 2017-08-02 Jan Hendrik Metzen , Mummadi Chaithanya Kumar , Thomas Brox , Volker Fischer

Existing saliency models have been designed and evaluated for predicting the saliency in distortion-free images. However, in practice, the image quality is affected by a host of factors at several stages of the image processing pipeline…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Milind S. Gide , Samuel F. Dodge , Lina J. Karam

Understanding the predictions made by Artificial Intelligence (AI) systems is becoming more and more important as deep learning models are used for increasingly complex and high-stakes tasks. Saliency mapping -- a popular visual attribution…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Jessica Cooper , Ognjen Arandjelović , David J Harrison

Explainable AI methods facilitate the understanding of model behaviour, yet, small, imperceptible perturbations to inputs can vastly distort explanations. As these explanations are typically evaluated holistically, before model deployment,…

Machine Learning · Computer Science 2024-06-05 Sara Vera Marjanović , Isabelle Augenstein , Christina Lioma

Have you ever taken a picture only to find out that an unimportant background object ended up being overly salient? Or one of those team sports photos where your favorite player blends with the rest? Wouldn't it be nice if you could tweak…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Roey Mechrez , Eli Shechtman , Lihi Zelnik-Manor

In recent years, the deep learning techniques have been applied to the estimation of saliency maps, which represent probability density functions of fixations when people look at the images. Although the methods of saliency-map estimation…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Tatsuya Suzuki , Takao Yamanaka

Saliency computation has become a popular research field for many applications due to the useful information provided by saliency maps. For a saliency map, local relations around the salient regions in multi-channel perspective should be…

Computer Vision and Pattern Recognition · Computer Science 2017-03-02 Nevrez Imamoglu , Zhixuan Wei , Huangjun Shi , Yuki Yoshida , Myagmarbayar Nergui , Jose Gonzalez , Dongyun Gu , Weidong Chen , Kenzo Nonami , Wenwei Yu