English
Related papers

Related papers: Enhancing Deep Neural Network Saliency Visualizati…

200 papers

Most saliency estimation methods aim to explicitly model low-level conspicuity cues such as edges or blobs and may additionally incorporate top-down cues using face or text detection. Data-driven methods for training saliency models using…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Saumya Jetley , Naila Murray , Eleonora Vig

Saliency methods provide post-hoc model interpretation by attributing input features to the model outputs. Current methods mainly achieve this using a single input sample, thereby failing to answer input-independent inquiries about the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Naveed Akhtar , Mohammad A. A. K. Jalwana

Class activation maps are widely used for explaining deep neural networks. Due to its ability to highlight regions of interest, it has evolved in recent years as a key step in weakly supervised learning. A major limitation to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Hang-Cheng Dong , Yuhao Jiang , Yingyan Huang , Jingxiao Liao , Bingguo Liu , Dong Ye , Guodong Liu

Gradient-based saliency maps are widely used to explain deep neural network decisions. However, as models become deeper and more black-box, such as in closed-source APIs like ChatGPT, computing gradients become challenging, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zeliang Zhang , Mingqian Feng , Jinyang Jiang , Rongyi Zhu , Yijie Peng , Chenliang Xu

Deep learning models have a large number of free parameters that must be estimated by efficient training of the models on a large number of training data samples to increase their generalization performance. In real-world applications, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Hojjat Salehinejad , Shahrokh Valaee , Timothy Dowdell , Joseph Barfett

Convolutional Neural Networks (CNN) have become state-of-the-art in the field of image classification. However, not everything is understood about their inner representations. This paper tackles the interpretability and explainability of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Brian Kenji Iwana , Ryohei Kuroki , Seiichi Uchida

Interpretability methods for deep neural networks mainly focus on the sensitivity of the class score with respect to the original or perturbed input, usually measured using actual or modified gradients. Some methods also use a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Md Mahfuzur Rahman , Noah Lewis , Sergey Plis

Deep learning has excelled in image recognition tasks through neural networks inspired by the human brain. However, the necessity for large models to improve prediction accuracy introduces significant computational demands and extended…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taigo Sakai , Kazuhiro Hotta

Converging evidence suggests that the mammalian ventral visual pathway encodes increasingly complex stimulus features in downstream areas. Using deep convolutional neural networks, we can now quantitatively demonstrate that there is indeed…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

Different activation functions work best for different deep learning models. To exploit this, we leverage recent advancements in gradient-based search techniques for neural architectures to efficiently identify high-performing activation…

Machine Learning · Computer Science 2024-08-14 Lukas Strack , Mahmoud Safari , Frank Hutter

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

Capsule Networks, as alternatives to Convolutional Neural Networks, have been proposed to recognize objects from images. The current literature demonstrates many advantages of CapsNets over CNNs. However, how to create explanations for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Jindong Gu , Volker Tresp

Variational method and deep learning method are two mainstream powerful approaches to solve inverse problems in computer vision. To take advantages of advanced optimization algorithms and powerful representation ability of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Qingchao Zhang , Yunmei Chen

Deep neural networks often suffer from poor performance or even training failure due to the ill-conditioned problem, the vanishing/exploding gradient problem, and the saddle point problem. In this paper, a novel method by acting the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mei Liu , Liangming Chen , Xiaohao Du , Long Jin , Mingsheng Shang

The different families of saliency methods, either based on contrastive signals, closed-form formulas mixing gradients with activations or on perturbation masks, all focus on which parts of an image are responsible for the model's…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Sylvestre-Alvise Rebuffi , Ruth Fong , Xu Ji , Hakan Bilen , Andrea Vedaldi

Feature maps in deep neural network generally contain different semantics. Existing methods often omit their characteristics that may lead to sub-optimal results. In this paper, we propose a novel end-to-end deep saliency network which…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Fengdong Sun , Wenhui Li , Yuanyuan Guan

We introduce a new tool for interpreting neural net responses, namely full-gradients, which decomposes the neural net response into input sensitivity and per-neuron sensitivity components. This is the first proposed representation which…

Machine Learning · Computer Science 2019-12-04 Suraj Srinivas , Francois Fleuret

Saliency methods interpret the prediction of a neural network by showing the importance of input elements for that prediction. A popular family of saliency methods utilize gradient information. In this work, we empirically show that two…

Machine Learning · Computer Science 2020-12-02 Ashkan Khakzar , Soroosh Baselizadeh , Nassir Navab

Interpreting complex deep networks, notably pre-trained vision-language models (VLMs), is a formidable challenge. Current Class Activation Map (CAM) methods highlight regions revealing the model's decision-making basis but lack clear…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Yuguang Yang , Runtang Guo , Sheng Wu , Yimi Wang , Linlin Yang , Bo Fan , Jilong Zhong , Juan Zhang , Baochang Zhang

We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the literature as "adjoint method") to train neural ODEs on…

Neural and Evolutionary Computing · Computer Science 2020-11-03 Talgat Daulbaev , Alexandr Katrutsa , Larisa Markeeva , Julia Gusak , Andrzej Cichocki , Ivan Oseledets