English
Related papers

Related papers: A generalizable saliency map-based interpretation …

200 papers

In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Hengyue Pan , Bo Wang , Hui Jiang

Incorporating human-perceptual intelligence into model training has shown to increase the generalization capability of models in several difficult biometric tasks, such as presentation attack detection (PAD) and detection of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Colton R. Crum , Samuel Webster , Adam Czajka

Various saliency map methods have been proposed to interpret and explain predictions of deep learning models. Saliency maps allow us to interpret which parts of the input signals have a strong influence on the prediction results. However,…

Machine Learning · Statistics 2023-01-09 Daiki Miwa , Vo Nguyen Le Duy , Ichiro Takeuchi

Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Jindong Gu , Volker Tresp

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

Transparency and explainability in image classification are essential for establishing trust in machine learning models and detecting biases and errors. State-of-the-art explainability methods generate saliency maps to show where a specific…

Machine Learning · Computer Science 2024-07-30 Matteo Bianchi , Antonio De Santis , Andrea Tocchetti , Marco Brambilla

Saliency methods are a common class of machine learning interpretability techniques that calculate how important each input feature is to a model's output. We find that, with the rapid pace of development, users struggle to stay informed of…

Machine Learning · Computer Science 2023-06-01 Angie Boggust , Harini Suresh , Hendrik Strobelt , John V. Guttag , Arvind Satyanarayan

High-quality saliency maps are essential in several machine learning application areas including explainable AI and weakly supervised object detection and segmentation. Many techniques have been developed to generate better saliency using…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Osman Tursun , Simon Denman , Sridha Sridharan , Clinton Fookes

The black-box nature of the deep networks makes the explanation for "why" they make certain predictions extremely challenging. Saliency maps are one of the most widely-used local explanation tools to alleviate this problem. One of the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Saeed Khorram , Tyler Lawson , Fuxin Li

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Visual saliency is a fundamental problem in both cognitive and computational sciences, including computer vision. In this CVPR 2015 paper, we discover that a high-quality visual saliency model can be trained with multiscale features…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Guanbin Li , Yizhou Yu

This paper presents a novel deep architecture for saliency prediction. Current state of the art models for saliency prediction employ Fully Convolutional networks that perform a non-linear combination of features extracted from the last…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Deep convolutional neural networks have achieved impressive performance on a broad range of problems, beating prior art on established benchmarks, but it often remains unclear what are the representations learnt by those systems and how…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Nicolas Pugeault

Evaluating, explaining, and visualizing high-level concepts in generative models, such as variational autoencoders (VAEs), is challenging in part due to a lack of known prediction classes that are required to generate saliency maps in…

Machine Learning · Computer Science 2023-03-21 Lennart Brocki , Neo Christopher Chung

Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Julius Adebayo , Justin Gilmer , Michael Muelly , Ian Goodfellow , Moritz Hardt , Been Kim

In this paper, we show that existing recognition and localization deep architectures, that have not been exposed to eye tracking data or any saliency datasets, are capable of predicting the human visual saliency. We term this as implicit…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Yutong Sun , Mohit Prabhushankar , Ghassan AlRegib

Deep Neural Networks are powerful tools to understand complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. While online saliency-guided training methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ali Karkehabadi

Recent developments in machine learning have introduced models that approach human performance at the cost of increased architectural complexity. Efforts to make the rationales behind the models' predictions transparent have inspired an…

Computation and Language · Computer Science 2020-09-29 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Although deep CNNs have brought significant improvement to image saliency detection, most CNN based models are sensitive to distortion such as compression and noise. In this paper, we propose an end-to-end generic salient object…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Delu Zeng , Yixuan He , Li Liu , Zhihong Chen , Jiabin Huang , Jie Chen , John Paisley

Despite the tremendous achievements of deep convolutional neural networks (CNNs) in many computer vision tasks, understanding how they actually work remains a significant challenge. In this paper, we propose a novel two-step understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Heyi Li , Yunke Tian , Klaus Mueller , Xin Chen