English
Related papers

Related papers: Deriving Explanation of Deep Visual Saliency Model…

200 papers

Feature maps in deep neural network generally contain different semantics. Existing methods often omit their characteristics that may lead to sub-optimal results. In this paper, we propose a novel end-to-end deep saliency network which…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Fengdong Sun , Wenhui Li , Yuanyuan Guan

This work explores how human judgement about salient regions of an image can be introduced into deep convolutional neural network (DCNN) training. Traditionally, training of DCNNs is purely data-driven. This often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Patrick Tinsley , Kevin W. Bowyer , Adam Czajka

Saliency prediction has made great strides over the past two decades, with current techniques modeling low-level information, such as color, intensity and size contrasts, and high-level ones, such as attention and gaze direction for entire…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Seungryong Kim , Mathieu Salzmann , Sabine Süsstrunk

Explaining deep convolutional neural networks has been recently drawing increasing attention since it helps to understand the networks' internal operations and why they make certain decisions. Saliency maps, which emphasize salient regions…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Quan Zheng , Ziwei Wang , Jie Zhou , Jiwen Lu

Despite the tremendous achievements of deep convolutional neural networks (CNNs) in many computer vision tasks, understanding how they actually work remains a significant challenge. In this paper, we propose a novel two-step understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Heyi Li , Yunke Tian , Klaus Mueller , Xin Chen

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

A key problem in salient object detection is how to effectively model the semantic properties of salient objects in a data-driven manner. In this paper, we propose a multi-task deep saliency model based on a fully convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Li , Liming Zhao , Lina Wei , Ming-Hsuan Yang , Fei Wu , Yueting Zhuang , Haibin Ling , Jingdong Wang

A deep feature based saliency model (DeepFeat) is developed to leverage the understanding of the prediction of human fixations. Traditional saliency models often predict the human visual attention relying on few level image cues. Although…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Ali Mahdi , Jun Qin

Saliency maps are widely used in the computer vision community for interpreting neural network classifiers. However, due to the randomness of training samples and optimization algorithms, the resulting saliency maps suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shizhan Gong , Jingwei Zhang , Qi Dou , Farzan Farnia

Despite the huge success of deep convolutional neural networks in face recognition (FR) tasks, current methods lack explainability for their predictions because of their "black-box" nature. In recent years, studies have been carried out to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zewei Xu , Yuhang Lu , Touradj Ebrahimi

Deep saliency prediction algorithms complement the object recognition features, they typically rely on additional information, such as scene context, semantic relationships, gaze direction, and object dissimilarity. However, none of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Bahar Aydemir , Ludo Hoffstetter , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Recently, with the advent of deep convolutional neural networks (DCNN), the improvements in visual saliency prediction research are impressive. One possible direction to approach the next improvement is to fully characterize the multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Sheng Yang , Guosheng Lin , Qiuping Jiang , Weisi Lin

Image saliency detection is crucial in understanding human gaze patterns from visual stimuli. The escalating demand for research in image saliency detection is driven by the growing necessity to incorporate such techniques into various…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Zhanxuan Mei , Yun-Cheng Wang , C. -C. Jay Kuo

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

Computational saliency models for still images have gained significant popularity in recent years. Saliency prediction from videos, on the other hand, has received relatively little interest from the community. Motivated by this, in this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Cagdas Bak , Aysun Kocak , Erkut Erdem , Aykut Erdem

Deep learning algorithms lack human-interpretable accounts of how they transform raw visual input into a robust semantic understanding, which impedes comparisons between different architectures, training objectives, and the human brain. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Gustaw Opiełka , Jessica Loke , Steven Scholte

We propose a novel neural network architecture for visual saliency detections, which utilizes neurophysiologically plausible mechanisms for extraction of salient regions. The model has been significantly inspired by recent findings from…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Natalia Efremova , Sergey Tarasenko

There has been profound progress in visual saliency thanks to the deep learning architectures, however, there still exist three major challenges that hinder the detection performance for scenes with complex compositions, multiple salient…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Jing Zhang , Yuchao Dai , Fatih Porikli , Mingyi He