English
Related papers

Related papers: Efficient Saliency Maps for Explainable AI

200 papers

In this work we develop a fast saliency detection method that can be applied to any differentiable image classifier. We train a masking model to manipulate the scores of the classifier by masking salient parts of the input image. Our model…

Machine Learning · Statistics 2017-05-23 Piotr Dabkowski , Yarin Gal

Traditional saliency map methods, popularized in computer vision, highlight individual points (pixels) of the input that contribute the most to the model's output. However, in time series, they offer limited insights, as semantically…

Machine Learning · Computer Science 2026-05-08 Christodoulos Kechris , Jonathan Dan , David Atienza

In this paper, we show that existing recognition and localization deep architectures, that have not been exposed to eye tracking data or any saliency datasets, are capable of predicting the human visual saliency. We term this as implicit…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Yutong Sun , Mohit Prabhushankar , Ghassan AlRegib

Image retargeting is the task of making images capable of being displayed on screens with different sizes. This work should be done so that high-level visual information and low-level features such as texture remain as intact as possible to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Mahdi Ahmadi , Nader Karimi , Shadrokh Samavi

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

Deep saliency prediction algorithms complement the object recognition features, they typically rely on additional information, such as scene context, semantic relationships, gaze direction, and object dissimilarity. However, none of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Bahar Aydemir , Ludo Hoffstetter , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled.…

Artificial Intelligence · Computer Science 2023-12-12 Shawn Im , Jacob Andreas , Yilun Zhou

The volume of User Generated Content (UGC) has increased in recent years. The challenge with this type of content is assessing its quality. So far, the state-of-the-art metrics are not exhibiting a very high correlation with perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Xinyi Wang , Angeliki Katsenou , David Bull

We present Smooth Grad-CAM++, a technique which combines two recent techniques: SMOOTHGRAD and Grad-CAM++. Smooth Grad-CAM++ has the capability of either visualizing a layer, subset of feature maps, or subset of neurons within a feature map…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Daniel Omeiza

We propose a novel neural network architecture for visual saliency detections, which utilizes neurophysiologically plausible mechanisms for extraction of salient regions. The model has been significantly inspired by recent findings from…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Natalia Efremova , Sergey Tarasenko

Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Sina Mohammadi , Mehrdad Noori , Ali Bahri , Sina Ghofrani Majelan , Mohammad Havaei

Visual saliency models have recently begun to incorporate deep learning to achieve predictive capacity much greater than previous unsupervised methods. However, most existing models predict saliency using local mechanisms limited to the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Samuel Dodge , Lina Karam

Convolutional neural networks (CNN) have enabled significant improvements in pedestrian detection owing to the strong representation ability of the CNN features. Recently, aggregating features from multiple layers of a CNN has been…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Tianrui Liu , Mohamed Elmikaty , Tania Stathaki

Integrating hyperspectral imagery (HSI) with deep neural networks (DNNs) can strengthen the accuracy of intelligent vision systems by combining spectral and spatial information, which is useful for tasks like semantic segmentation in…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Jon Gutiérrez-Zaballa , Koldo Basterretxea , Javier Echanobe

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

Artificial Intelligence · Computer Science 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

In this paper, we propose an improved mechanism for saliency detection. Firstly,based on a neoteric background prior selecting four corners of an image as background,we use color and spatial contrast with each superpixel to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Hanling Zhang , Chenxing Xia

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

Nearly all existing visual saliency models by far have focused on predicting a universal saliency map across all observers. Yet psychology studies suggest that visual attention of different observers can vary significantly under specific…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yanyu Xu , Shenghua Gao , Junru Wu , Nianyi Li , Jingyi Yu

To detect salient objects accurately, existing methods usually design complex backbone network architectures to learn and fuse powerful features. However, the saliency inference module that performs saliency prediction from the fused…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Zun Li , Congyan Lang , Yunpeng Chen , Junhao Liew , Jiashi Feng