English
Related papers

Related papers: Global Saliency: Aggregating Saliency Maps to Asse…

200 papers

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

In the area of human fixation prediction, dozens of computational saliency models are proposed to reveal certain saliency characteristics under different assumptions and definitions. As a result, saliency model benchmarking often requires…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Changqun Xia , Jia Li , Jinming Su , Ali Borji

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

Complex structures commonly exist in natural images. When an image contains small-scale high-contrast patterns either in the background or foreground, saliency detection could be adversely affected, resulting erroneous and non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2015-08-05 Jianping Shi , Qiong Yan , Li Xu , Jiaya Jia

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Rangel Daroya , Aaron Sun , Subhransu Maji

The correct interpretation of convolutional models is a hard problem for time series data. While saliency methods promise visual validation of predictions for image and language processing, they fall short when applied to time series. These…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Christoffer Loeffler , Wei-Cheng Lai , Bjoern Eskofier , Dario Zanca , Lukas Schmidt , Christopher Mutschler

Recent advances in image-based saliency prediction are approaching gold standard performance levels on existing benchmarks. Despite this success, we show that predicting fixations across multiple saliency datasets remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Matthias Kümmerer , Harneet Singh Khanuja , Matthias Bethge

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Computation and Language · Computer Science 2023-06-08 Nils Feldhus , Leonhard Hennig , Maximilian Dustin Nasert , Christopher Ebert , Robert Schwarzenberg , Sebastian Möller

Skin lesion segmentation can be rather a challenging task owing to the presence of artifacts, low contrast between lesion and boundary, color variegation, fuzzy skin lesion borders and heterogeneous background in dermoscopy images. In this…

Image and Video Processing · Electrical Eng. & Systems 2020-10-09 Zanobya N. Khan

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Saliency map estimation in computer vision aims to estimate the locations where people gaze in images. Since people tend to look at objects in images, the parameters of the model pretrained on ImageNet for image classification are useful…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Taiki Oyama , Takao Yamanaka

Nearly all existing visual saliency models by far have focused on predicting a universal saliency map across all observers. Yet psychology studies suggest that visual attention of different observers can vary significantly under specific…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yanyu Xu , Shenghua Gao , Junru Wu , Nianyi Li , Jingyi Yu

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen

Interpretable machine learning and explainable artificial intelligence have become essential in many applications. The trade-off between interpretability and model performance is the traitor to developing intrinsic and model-agnostic…

Machine Learning · Computer Science 2023-09-06 Chiara Balestra , Bin Li , Emmanuel Müller

Deep learning based salient object detection has recently achieved great success with its performance greatly outperforms any other unsupervised methods. However, annotating per-pixel saliency masks is a tedious and inefficient procedure.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Guanbin Li , Yuan Xie , Liang Lin

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

In recent years, three-dimensional point clouds are used increasingly to document natural environments. Each dataset contains a diverse set of objects, at varying shapes and sizes, distributed throughout the data and intricately intertwined…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Reuma Arav , Dennis Wittich , Franz Rottensteiner