English
Related papers

Related papers: Investigating and Simplifying Masking-based Salien…

200 papers

Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Julius Adebayo , Justin Gilmer , Michael Muelly , Ian Goodfellow , Moritz Hardt , Been Kim

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble

The classification decisions of neural networks can be misled by small imperceptible perturbations. This work aims to explain the misled classifications using saliency methods. The idea behind saliency methods is to explain the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jindong Gu , Volker Tresp

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Clinical applicability of automated decision support systems depends on a robust, well-understood classification interpretation. Artificial neural networks while achieving class-leading scores fall short in this regard. Therefore, numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 David Major , Dimitrios Lenis , Maria Wimmer , Gert Sluiter , Astrid Berg , Katja Bühler

Poor generalization is one symptom of models that learn to predict target variables using spuriously-correlated image features present only in the training distribution instead of the true image features that denote a class. It is often…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Joseph D. Viviano , Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

In this paper, we propose an efficient saliency map generation method, called Group score-weighted Class Activation Mapping (Group-CAM), which adopts the "split-transform-merge" strategy to generate saliency maps. Specifically, for an input…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Qinglong Zhang , Lu Rao , Yubin Yang

State-of-the-art saliency prediction methods develop upon model architectures or loss functions; while training to generate one target saliency map. However, publicly available saliency prediction datasets can be utilized to create more…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Sandeep Mishra , Oindrila Saha

A fundamental bottleneck in utilising complex machine learning systems for critical applications has been not knowing why they do and what they do, thus preventing the development of any crucial safety protocols. To date, no method exist…

Machine Learning · Computer Science 2023-01-18 Jan Rosenzweig , Zoran Cvetkovic , Ivana Rosenzweig

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Zhenyue Qin , Jie Wu

High-quality saliency maps are essential in several machine learning application areas including explainable AI and weakly supervised object detection and segmentation. Many techniques have been developed to generate better saliency using…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Osman Tursun , Simon Denman , Sridha Sridharan , Clinton Fookes

Recently, many methods to interpret and visualize deep neural network predictions have been proposed and significant progress has been made. However, a more class-discriminative and visually pleasing explanation is required. Thus, this…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Dasom Seo , Kanghan Oh , Il-Seok Oh

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Most saliency estimation methods aim to explicitly model low-level conspicuity cues such as edges or blobs and may additionally incorporate top-down cues using face or text detection. Data-driven methods for training saliency models using…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Saumya Jetley , Naila Murray , Eleonora Vig

With the growing availability of databases for face presentation attack detection, researchers are increasingly focusing on video-based face anti-spoofing methods that involve hundreds to thousands of images for training the models.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Usman Muhammad , Mourad Oussalah , Jorma Laaksonen

Deep Neural Networks are powerful tools for understanding complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. Saliency-Guided Training (SGT) methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

We present a novel approach for saliency prediction in images, leveraging parallel decoding in transformers to learn saliency solely from fixation maps. Models typically rely on continuous saliency maps, to overcome the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yasser Abdelaziz Dahou Djilali , Kevin McGuiness , Noel O'Connor