English
Related papers

Related papers: Input Bias in Rectified Gradients and Modified Sal…

200 papers

Saliency methods interpret the prediction of a neural network by showing the importance of input elements for that prediction. A popular family of saliency methods utilize gradient information. In this work, we empirically show that two…

Machine Learning · Computer Science 2020-12-02 Ashkan Khakzar , Soroosh Baselizadeh , Nassir Navab

It is known that deep neural networks (DNNs) classify an input image by paying particular attention to certain specific pixels; a graphical representation of the magnitude of attention to each pixel is called a saliency-map. Saliency-maps…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Satoshi Munakata , Caterina Urban , Haruki Yokoyama , Koji Yamamoto , Kazuki Munakata

Interpretability is a critical factor in applying complex deep learning models to advance the understanding of brain disorders in neuroimaging studies. To interpret the decision process of a trained classifier, existing techniques typically…

Image and Video Processing · Electrical Eng. & Systems 2021-06-29 Zixuan Liu , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Despite the tremendous achievements of deep convolutional neural networks (CNNs) in many computer vision tasks, understanding how they actually work remains a significant challenge. In this paper, we propose a novel two-step understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Heyi Li , Yunke Tian , Klaus Mueller , Xin Chen

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

Computation and Language · Computer Science 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

Common approaches to explainable AI (XAI) for deep learning focus on analyzing the importance of input features on the classification task in a given model: saliency methods like SHAP and GradCAM are used to measure the impact of spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Anne Sielemann , Valentin Barner , Stefan Wolf , Masoud Roschani , Jens Ziehn , Juergen Beyerer

Have you ever taken a picture only to find out that an unimportant background object ended up being overly salient? Or one of those team sports photos where your favorite player blends with the rest? Wouldn't it be nice if you could tweak…

Computer Vision and Pattern Recognition · Computer Science 2018-01-18 Roey Mechrez , Eli Shechtman , Lihi Zelnik-Manor

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

Evaluating, explaining, and visualizing high-level concepts in generative models, such as variational autoencoders (VAEs), is challenging in part due to a lack of known prediction classes that are required to generate saliency maps in…

Machine Learning · Computer Science 2023-03-21 Lennart Brocki , Neo Christopher Chung

Saliency prediction is a well studied problem in computer vision. Early saliency models were based on low-level hand-crafted feature derived from insights gained in neuroscience and psychophysics. In the wake of deep learning breakthrough,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Sen He , Nicolas Pugeault

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

Machine Learning · Computer Science 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi

Deep convolutional neural networks have achieved impressive performance on a broad range of problems, beating prior art on established benchmarks, but it often remains unclear what are the representations learnt by those systems and how…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Nicolas Pugeault

Convolutional neural networks (CNNs) offer great machine learning performance over a range of applications, but their operation is hard to interpret, even for experts. Various explanation algorithms have been proposed to address this issue,…

Human-Computer Interaction · Computer Science 2020-02-04 Ahmed Alqaraawi , Martin Schuessler , Philipp Weiß , Enrico Costanza , Nadia Berthouze

Saliency map generation techniques are at the forefront of explainable AI literature for a broad range of machine learning applications. Our goal is to question the limits of these approaches on more complex tasks. In this paper we apply…

Machine Learning · Computer Science 2019-07-15 David Tuckey , Krysia Broda , Alessandra Russo

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

Recently, there has been a growing interest in developing saliency methods that provide visual explanations of network predictions. Still, the usability of existing methods is limited to image classification models. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Lukas Hoyer , Mauricio Munoz , Prateek Katiyar , Anna Khoreva , Volker Fischer

In recent years, deep saliency models have made significant progress in predicting human visual attention. However, the mechanisms behind their success remain largely unexplained due to the opaque nature of deep neural networks. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Shi Chen , Ming Jiang , Qi Zhao

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Hengyue Pan , Bo Wang , Hui Jiang