English
Related papers

Related papers: Improving Deep Learning Interpretability by Salien…

200 papers

We present an interpretable neural network approach to predicting and understanding politeness in natural language requests. Our models are based on simple convolutional neural networks directly on raw text, avoiding any manual…

Computation and Language · Computer Science 2016-10-11 Malika Aubakirova , Mohit Bansal

Benefit from the quick development of deep learning techniques, salient object detection has achieved remarkable progresses recently. However, there still exists following two major challenges that hinder its application in embedded…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Shuhan Chen , Xiuli Tan , Ben Wang , Xuelong Hu

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

Inducing sparseness while training neural networks has been shown to yield models with a lower memory footprint but similar effectiveness to dense models. However, sparseness is typically induced starting from a dense model, and thus this…

Machine Learning · Computer Science 2022-03-30 Thomas Demeester , Johannes Deleu , Fréderic Godin , Chris Develder

Understanding the advantages of deep neural networks trained by gradient descent (GD) compared to shallow models remains an open theoretical challenge. In this paper, we introduce a class of target functions (single and multi-index Gaussian…

Machine Learning · Statistics 2025-11-17 Yatin Dandi , Luca Pesce , Lenka Zdeborová , Florent Krzakala

Recent advances in deep learning significantly boost the performance of salient object detection (SOD) at the expense of labeling larger-scale per-pixel annotations. To relieve the burden of labor-intensive labeling, deep unsupervised SOD…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Pengxiang Yan , Ziyi Wu , Mengmeng Liu , Kun Zeng , Liang Lin , Guanbin Li

Deep neural networks for medical image diagnosis often achieve high predictive accuracy while relying on spurious or clinically irrelevant visual cues, limiting their trustworthiness in practice. Post-hoc explanation methods are widely used…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zubair Faruqui , Rahul Dubey

The goal of this document is to provide a pedagogical introduction to the main concepts underpinning the training of deep neural networks using gradient descent; a process known as backpropagation. Although we focus on a very influential…

Machine Learning · Computer Science 2018-11-30 Laurent Boué

While instruction-tuned language models have demonstrated impressive zero-shot generalization, these models often struggle to generate accurate responses when faced with instructions that fall outside their training set. This paper presents…

Computation and Language · Computer Science 2024-02-20 Taehyeon Kim , Joonkee Kim , Gihun Lee , Se-Young Yun

Input gradients have a pivotal role in a variety of applications, including adversarial attack algorithms for evaluating model robustness, explainable AI techniques for generating Saliency Maps, and counterfactual explanations.However,…

Artificial Intelligence · Computer Science 2024-02-05 Mathieu Serrurier , Franck Mamalet , Thomas Fel , Louis Béthune , Thibaut Boissin

Symbolic techniques based on Satisfiability Modulo Theory (SMT) solvers have been proposed for analyzing and verifying neural network properties, but their usage has been fairly limited owing to their poor scalability with larger networks.…

Machine Learning · Computer Science 2021-05-06 Subham Sekhar Sahoo , Subhashini Venugopalan , Li Li , Rishabh Singh , Patrick Riley

Deep learning has shown promising results in many machine learning applications. The hierarchical feature representation built by deep networks enable compact and precise encoding of the data. A kernel analysis of the trained deep networks…

Machine Learning · Computer Science 2017-03-22 Mandar Kulkarni , Shirish Karande

In this paper we introduce a novel Depth-Aware Video Saliency approach to predict human focus of attention when viewing RGBD videos on regular 2D screens. We train a generative convolutional neural network which predicts a saliency map for…

Computer Vision and Pattern Recognition · Computer Science 2016-03-14 G. Leifman , D. Rudoy , T. Swedish , E. Bayro-Corrochano , R. Raskar

With the rise in popularity of machine and deep learning models, there is an increased focus on their vulnerability to malicious inputs. These adversarial examples drift model predictions away from the original intent of the network and are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Richard Tran , David Patrick , Michael Geyer , Amanda Fernandez

Stochastic gradient descent (SGD) is a standard optimization method to minimize a training error with respect to network parameters in modern neural network learning. However, it typically suffers from proliferation of saddle points in the…

Machine Learning · Computer Science 2017-11-23 Haiping Huang , Taro Toyoizumi

Gradient-based analysis methods, such as saliency map visualizations and adversarial input perturbations, have found widespread use in interpreting neural NLP models due to their simplicity, flexibility, and most importantly, their…

Computation and Language · Computer Science 2020-10-13 Junlin Wang , Jens Tuyls , Eric Wallace , Sameer Singh

Recently, inspired by DETR variants, query-based end-to-end instance segmentation (QEIS) methods have outperformed CNN-based models on large-scale datasets. Yet they would lose efficacy when only a small amount of training data is available…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hao Li , Dingwen Zhang , Nian Liu , Lechao Cheng , Yalun Dai , Chao Zhang , Xinggang Wang , Junwei Han

Binarized Neural Networks (BNNs) have the potential to revolutionize the way that deep learning is carried out in edge computing platforms. However, the effectiveness of interpretability methods on these networks has not been assessed. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Amy Widdicombe , Simon J. Julier

We propose to employ a saliency-driven hierarchical neural image compression network for a machine-to-machine communication scenario following the compress-then-analyze paradigm. By that, different areas of the image are coded at different…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Kristian Fischer , Fabian Brand , Christian Blum , André Kaup

With the rise of deep neural networks, the challenge of explaining the predictions of these networks has become increasingly recognized. While many methods for explaining the decisions of deep neural networks exist, there is currently no…

Machine Learning · Computer Science 2022-07-13 Ian E. Nielsen , Dimah Dera , Ghulam Rasool , Nidhal Bouaynaya , Ravi P. Ramachandran