English
Related papers

Related papers: End-to-End Saliency Mapping via Probability Distri…

200 papers

Understanding specifically where a model focuses on within an image is critical for human interpretability of the decision-making process. Deep learning-based solutions are prone to learning coincidental correlations in training datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Mohamed Trabelsi , Huseyin Uzunalioglu , Dan Kushnir

3D point-cloud recognition with PointNet and its variants has received remarkable progress. A missing ingredient, however, is the ability to automatically evaluate point-wise importance w.r.t.\! classification performance, which is usually…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Tianhang Zheng , Changyou Chen , Junsong Yuan , Bo Li , Kui Ren

In the area of human fixation prediction, dozens of computational saliency models are proposed to reveal certain saliency characteristics under different assumptions and definitions. As a result, saliency model benchmarking often requires…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Changqun Xia , Jia Li , Jinming Su , Ali Borji

Saliency map detection, as a method for detecting important regions of an image, is used in many applications such as image classification and recognition. We propose that context detection could have an essential role in image saliency…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Mahdi Ahmadi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

In this study, we propose a novel method to measure bottom-up saliency maps of natural images. In order to eliminate the influence of top-down signals, backward masking is used to make stimuli (natural images) subjectively invisible to…

Computer Vision and Pattern Recognition · Computer Science 2016-04-30 Cheng Chen , Xilin Zhang , Yizhou Wang , Fang Fang

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

Vision-based end-to-end driving models trained by imitation learning can lead to affordable solutions for autonomous driving. However, training these well-performing models usually requires a huge amount of data, while still lacking…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Diego Porres , Yi Xiao , Gabriel Villalonga , Alexandre Levy , Antonio M. López

The prediction of saliency areas in images has been traditionally addressed with hand crafted features based on neuroscience principles. This paper however addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2015-07-07 Junting Pan , Xavier Giró-i-Nieto

Poor generalization is one symptom of models that learn to predict target variables using spuriously-correlated image features present only in the training distribution instead of the true image features that denote a class. It is often…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Joseph D. Viviano , Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

This paper presents a fresh perspective on the role of saliency maps in weakly-supervised semantic segmentation (WSSS) and offers new insights and research directions based on our empirical findings. We conduct comprehensive experiments and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Beomyoung Kim , Donghyun Kim , Sung Ju Hwang

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

Class activation map (CAM) helps to formulate saliency maps that aid in interpreting the deep neural network's prediction. Gradient-based methods are generally faster than other branches of vision interpretability and independent of human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Masud An Nur Islam Fahim , Nazmus Saqib , Shafkat Khan Siam , Ho Yub Jung

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

Saliency maps are often used in computer vision to provide intuitive interpretations of what input regions a model has used to produce a specific prediction. A number of approaches to saliency map generation are available, but most require…

Machine Learning · Computer Science 2020-01-31 Mamuku Mokuwe , Michael Burke , Anna Sergeevna Bosman

Stereoscopic perception is an important part of human visual system that allows the brain to perceive depth. However, depth information has not been well explored in existing saliency detection models. In this letter, a novel saliency…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Runmin Cong , Jianjun Lei , Changqing Zhang , Qingming Huang , Xiaochun Cao , Chunping Hou

Saliency map generation techniques are at the forefront of explainable AI literature for a broad range of machine learning applications. Our goal is to question the limits of these approaches on more complex tasks. In this paper we apply…

Machine Learning · Computer Science 2019-07-15 David Tuckey , Krysia Broda , Alessandra Russo

Incorporating human-perceptual intelligence into model training has shown to increase the generalization capability of models in several difficult biometric tasks, such as presentation attack detection (PAD) and detection of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Colton R. Crum , Samuel Webster , Adam Czajka

The need for Explainable AI is increasing with the development of deep learning. The saliency maps derived from convolutional neural networks generally fail in localizing with accuracy the image features justifying the network prediction.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Alexandre Englebert , Olivier Cornu , Christophe De Vleeschouwer

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira