English
Related papers

Related papers: There and Back Again: Revisiting Backpropagation S…

200 papers

Recent advances in deep learning have pushed the performances of visual saliency models way further than it has ever been. Numerous models in the literature present new ways to design neural networks, to arrange gaze pattern data, or to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Alexandre Bruckert , Hamed R. Tavakoli , Zhi Liu , Marc Christie , Olivier Le Meur

The gradients used to train neural networks are typically computed using backpropagation. While an efficient way to obtain exact gradients, backpropagation is computationally expensive, hinders parallelization, and is biologically…

Machine Learning · Computer Science 2026-01-14 Katharina Flügel , Daniel Coquelin , Marie Weiel , Charlotte Debus , Achim Streit , Markus Götz

Neural network visualization techniques mark image locations by their relevancy to the network's classification. Existing methods are effective in highlighting the regions that affect the resulting classification the most. However, as we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Shir Gur , Ameen Ali , Lior Wolf

We present a set of metrics that utilize vision priors to effectively assess the performance of saliency methods on image classification tasks. To understand behavior in deep learning models, many methods provide visual saliency maps…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Rangel Daroya , Aaron Sun , Subhransu Maji

Visual saliency detection tries to mimic human vision psychology which concentrates on sparse, important areas in natural image. Saliency prediction research has been traditionally based on low level features such as contrast, edge, etc.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-05 Avisek Lahiri , Sourya Roy , Anirban Santara , Pabitra Mitra , Prabir Kumar Biswas

Learning representations that clearly distinguish between normal and abnormal data is key to the success of anomaly detection. Most of existing anomaly detection algorithms use activation representations from forward propagation while not…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Gukyeong Kwon , Mohit Prabhushankar , Dogancan Temel , Ghassan AlRegib

Saliency maps have been widely used to interpret the decisions of neural network classifiers and discover phenomena from their learned functions. However, standard gradient-based maps are frequently observed to be highly sensitive to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhuorui Ye , Farzan Farnia

Recently, there has been a growing interest in developing saliency methods that provide visual explanations of network predictions. Still, the usability of existing methods is limited to image classification models. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Lukas Hoyer , Mauricio Munoz , Prateek Katiyar , Anna Khoreva , Volker Fischer

In this paper, an enhancement technique for the class activation mapping methods such as gradient-weighted class activation maps or excitation backpropagation is proposed to present the visual explanations of decisions from convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Tomasz Szandala

Explainability in time series forecasting is essential for improving model transparency and supporting informed decision-making. In this work, we present CrossScaleNet, an innovative architecture that combines a patch-based cross-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ibrahim Delibasoglu , Fredrik Heintz

Salient object detection has seen remarkable progress driven by deep learning techniques. However, most of deep learning based salient object detection methods are black-box in nature and lacking in interpretability. This paper proposes the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Huaxin Xiao , Jiashi Feng , Yunchao Wei , Maojun Zhang

Though deep learning techniques have made great progress in salient object detection recently, the predicted saliency maps still suffer from incomplete predictions due to the internal complexity of objects and inaccurate boundaries caused…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Runmin Wu , Mengyang Feng , Wenlong Guan , Dong Wang , Huchuan Lu , Errui Ding

In graph signal processing, learning the weighted connections between nodes from a set of sample signals is a fundamental task when the underlying relationships are not known a priori. This task is typically addressed by finding a graph…

Machine Learning · Computer Science 2025-06-30 Benjamin T. Brown , Haoxiang Zhang , Daniel L. Lau , Gonzalo R. Arce

Stereoscopic perception is an important part of human visual system that allows the brain to perceive depth. However, depth information has not been well explored in existing saliency detection models. In this letter, a novel saliency…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Runmin Cong , Jianjun Lei , Changqing Zhang , Qingming Huang , Xiaochun Cao , Chunping Hou

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

In this paper, we aim at providing an introduction to the gradient descent based optimization algorithms for learning deep neural network models. Deep learning models involving multiple nonlinear projection layers are very challenging to…

Machine Learning · Computer Science 2019-03-12 Jiawei Zhang

Estimating hyperparameters has been a long-standing problem in machine learning. We consider the case where the task at hand is modeled as the solution to an optimization problem. Here the exact gradient with respect to the hyperparameters…

Optimization and Control · Mathematics 2023-11-16 Matthias J. Ehrhardt , Lindon Roberts

Interpretation and improvement of deep neural networks relies on better understanding of their underlying mechanisms. In particular, gradients of classes or concepts with respect to the input features (e.g., pixels in images) are often used…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lennart Brocki , Neo Christopher Chung

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

Saliency methods are widely used to visualize which input features are deemed relevant to a model's prediction. However, their visual plausibility can obscure critical limitations. In this work, we propose a diagnostic test for class…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Dane Williamson , Yangfeng Ji , Matthew Dwyer