English
Related papers

Related papers: Sanity Checks for Saliency Methods Explaining Obje…

200 papers

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

The real human attention is an interactive activity between our visual system and our brain, using both low-level visual stimulus and high-level semantic information. Previous image salient object detection (SOD) works conduct their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Zhenyu Wu , Shuai Li , Chenglizhao Chen , Aimin Hao , Hong Qin

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

Saliency detection has drawn a lot of attention of researchers in various fields over the past several years. Saliency is the perceptual quality that makes an object, person to draw the attention of humans at the very sight. Salient object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Shubham Pachori

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

In this paper, we propose a fast deep learning method for object saliency detection using convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify the input images based on the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Hengyue Pan , Hui Jiang

In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model…

Machine Learning · Statistics 2017-05-23 Piotr Dabkowski , Yarin Gal

Saliency methods are widely used to visualize which input features are deemed relevant to a model's prediction. However, their visual plausibility can obscure critical limitations. In this work, we propose a diagnostic test for class…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Dane Williamson , Yangfeng Ji , Matthew Dwyer

Saliency is the perceptual capacity of our visual system to focus our attention (i.e. gaze) on relevant objects. Neural networks for saliency estimation require ground truth saliency maps for training which are usually achieved via…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Carola Figueroa-Flores , David Berga , Joost van der Weijer , Bogdan Raducanu

Explaining a deep learning model can help users understand its behavior and allow researchers to discern its shortcomings. Recent work has primarily focused on explaining models for tasks like image classification or visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Bryan A. Plummer , Mariya I. Vasileva , Vitali Petsiuk , Kate Saenko , David Forsyth

Salient object detection (SOD) is a long-standing research topic in computer vision and has drawn an increasing amount of research interest in the past decade. This paper provides the first comprehensive review and benchmark for light field…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Keren Fu , Yao Jiang , Ge-Peng Ji , Tao Zhou , Qijun Zhao , Deng-Ping Fan

Deep learning has emerged as a compelling solution to many NLP tasks with remarkable performances. However, due to their opacity, such models are hard to interpret and trust. Recent work on explaining deep models has introduced approaches…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Hamed Shahbazi , Prasad Tadepalli

Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy. However, those methods overlook the gap between network accuracy and prediction confidence, known as the confidence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Jing Zhang , Yuchao Dai , Xin Yu , Mehrtash Harandi , Nick Barnes , Richard Hartley

Saliency detection is one of the most challenging problems in image analysis and computer vision. Many approaches propose different architectures based on the psychological and biological properties of the human visual attention system.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Fateme Mostafaie , Zahra Nabizadeh , Nader Karimi , Shadrokh Samavi

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

This paper presents an approach for top-down saliency detection guided by visual classification tasks. We first learn how to compute visual saliency when a specific visual task has to be accomplished, as opposed to most state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Francesca Murabito , Concetto Spampinato , Simone Palazzo , Konstantin Pogorelov , Michael Riegler

This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency branch to an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Carola Figueroa Flores , Abel Gonzalez-García , Joost van de Weijer , Bogdan Raducanu

While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing is often overestimated and…

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

We describe an explainable AI saliency map method for use with deep convolutional neural networks (CNN) that is much more efficient than popular fine-resolution gradient methods. It is also quantitatively similar or better in accuracy. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 T. Nathan Mundhenk , Barry Y. Chen , Gerald Friedland