English
Related papers

Related papers: SaliencyDecor: Enhancing Neural Network Interpreta…

200 papers

It is known that deep neural networks (DNNs) classify an input image by paying particular attention to certain specific pixels; a graphical representation of the magnitude of attention to each pixel is called a saliency-map. Saliency-maps…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Satoshi Munakata , Caterina Urban , Haruki Yokoyama , Koji Yamamoto , Kazuki Munakata

Image attribution analysis seeks to highlight the feature representations learned by visual models such that the highlighted feature maps can reflect the pixel-wise importance of inputs. Gradient integration is a building block in the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Róisín Luo , James McDermott , Colm O'Riordan

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

Salient object detection, which aims to identify and locate the most salient pixels or regions in images, has been attracting more and more interest due to its various real-world applications. However, this vision task is quite challenging,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Pingping Zhang , Wei Liu , Huchuan Lu , Chunhua Shen

In high-stakes applications of machine learning models, interpretability methods provide guarantees that models are right for the right reasons. In medical imaging, saliency maps have become the standard tool for determining whether a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Jacob Pfau , Albert T. Young , Maria L. Wei , Michael J. Keiser

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Deep learning algorithms lack human-interpretable accounts of how they transform raw visual input into a robust semantic understanding, which impedes comparisons between different architectures, training objectives, and the human brain. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Gustaw Opiełka , Jessica Loke , Steven Scholte

Saliency Prediction aims to predict the attention distribution of human eyes given an RGB image. Most of the recent state-of-the-art methods are based on deep image feature representations from traditional CNNs. However, the traditional…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Shuo Zhang

Finding semantic correspondences is a challenging problem. With the breakthrough of CNNs stronger features are available for tasks like classification but not specifically for the requirements of semantic matching. In the following we…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Nikolai Ufer , Kam To Lui , Katja Schwarz , Paul Warkentin , Björn Ommer

Recent progress on salient object detection mainly aims at exploiting how to effectively integrate convolutional side-output features in convolutional neural networks (CNN). Based on this, most of the existing state-of-the-art saliency…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yun Liu , Yu Qiu , Le Zhang , JiaWang Bian , Guang-Yu Nie , Ming-Ming Cheng

Saliency methods compute heat maps that highlight portions of an input that were most {\em important} for the label assigned to it by a deep net. Evaluations of saliency methods convert this heat map into a new {\em masked input} by…

Machine Learning · Statistics 2022-11-08 Arushi Gupta , Nikunj Saunshi , Dingli Yu , Kaifeng Lyu , Sanjeev Arora

Visual saliency prediction using transformers - Convolutional neural networks (CNNs) have significantly advanced computational modelling for saliency prediction. However, accurately simulating the mechanisms of visual attention in the human…

Multimedia · Computer Science 2022-06-30 Jianxun Lou , Hanhe Lin , David Marshall , Dietmar Saupe , Hantao Liu

Prior works have shown that neural networks can be heavily pruned while preserving performance, but the impact of pruning on model interpretability remains unclear. In this work, we investigate how magnitude-based pruning followed by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sanish Suwal , Dipkamal Bhusal , Michael Clifford , Nidhi Rastogi

Graph Neural Networks (GNNs) have gained prominence for their ability to process graph-structured data across various domains. However, interpreting GNN decisions remains a significant challenge, leading to the adoption of saliency maps for…

Machine Learning · Statistics 2025-09-04 Shuichi Nishino , Tomohiro Shiraishi , Teruyuki Katsuoka , Ichiro Takeuchi

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Saliency methods are frequently used to explain Deep Neural Network-based models. Adebayo et al.'s work on evaluating saliency methods for classification models illustrate certain explanation methods fail the model and data randomization…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Deepan Chakravarthi Padmanabhan , Paul G. Plöger , Octavio Arriaga , Matias Valdenegro-Toro

Saliency methods are a popular class of feature attribution explanation methods that aim to capture a model's predictive reasoning by identifying "important" pixels in an input image. However, the development and adoption of these methods…

Machine Learning · Computer Science 2022-06-20 Joon Sik Kim , Gregory Plumb , Ameet Talwalkar

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

Machine Learning · Computer Science 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran

This paper is motivated from a fundamental curiosity on what defines a category of object shapes. For example, we may have the common knowledge that a plane has wings, and a chair has legs. Given the large shape variations among different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chaozheng Wu , Lin Sun , Xun Xu , Kui Jia

Traditional saliency map methods, popularized in computer vision, highlight individual points (pixels) of the input that contribute the most to the model's output. However, in time series, they offer limited insights, as semantically…

Machine Learning · Computer Science 2026-05-08 Christodoulos Kechris , Jonathan Dan , David Atienza