English
Related papers

Related papers: NormGrad: Finding the Pixels that Matter for Train…

200 papers

Weakly-supervised image segmentation is an important task in computer vision. A key problem is how to obtain high quality objects location from image-level category. Classification activation mapping is a common method which can be used to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Fengdong Sun , Wenhui Li

Saliency map estimation in computer vision aims to estimate the locations where people gaze in images. Since people tend to look at objects in images, the parameters of the model pretrained on ImageNet for image classification are useful…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Taiki Oyama , Takao Yamanaka

We describe an explainable AI saliency map method for use with deep convolutional neural networks (CNN) that is much more efficient than popular fine-resolution gradient methods. It is also quantitatively similar or better in accuracy. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 T. Nathan Mundhenk , Barry Y. Chen , Gerald Friedland

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

We propose to employ a saliency-driven hierarchical neural image compression network for a machine-to-machine communication scenario following the compress-then-analyze paradigm. By that, different areas of the image are coded at different…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Kristian Fischer , Fabian Brand , Christian Blum , André Kaup

Clinical applicability of automated decision support systems depends on a robust, well-understood classification interpretation. Artificial neural networks while achieving class-leading scores fall short in this regard. Therefore, numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 David Major , Dimitrios Lenis , Maria Wimmer , Gert Sluiter , Astrid Berg , Katja Bühler

Incorporating human-perceptual intelligence into model training has shown to increase the generalization capability of models in several difficult biometric tasks, such as presentation attack detection (PAD) and detection of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Colton R. Crum , Samuel Webster , Adam Czajka

Visual saliency detection tries to mimic human vision psychology which concentrates on sparse, important areas in natural image. Saliency prediction research has been traditionally based on low level features such as contrast, edge, etc.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-05 Avisek Lahiri , Sourya Roy , Anirban Santara , Pabitra Mitra , Prabir Kumar Biswas

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Alexandre Englebert , Olivier Cornu , Christophe De Vleeschouwer

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

The classification decisions of neural networks can be misled by small imperceptible perturbations. This work aims to explain the misled classifications using saliency methods. The idea behind saliency methods is to explain the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jindong Gu , Volker Tresp

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this CVPR 2015 paper, we discover that a high-quality visual saliency model can be trained with multiscale features…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Guanbin Li , Yizhou Yu

Recently, many methods to interpret and visualize deep neural network predictions have been proposed and significant progress has been made. However, a more class-discriminative and visually pleasing explanation is required. Thus, this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Dasom Seo , Kanghan Oh , Il-Seok Oh

In this paper, we introduce a strategy for identifying textual saliency in large-scale language models applied to classification tasks. In visual networks where saliency is more well-studied, saliency is naturally localized through the…

Computation and Language · Computer Science 2023-08-11 Elizabeth M. Hou , Gregory Castanon

Saliency map detection, as a method for detecting important regions of an image, is used in many applications such as image classification and recognition. We propose that context detection could have an essential role in image saliency…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Mahdi Ahmadi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi