English
Related papers

Related papers: Learning Important Features Through Propagating Ac…

200 papers

Attribution methods assess the contribution of inputs to the model prediction. One way to do so is erasure: a subset of inputs is considered irrelevant if it can be removed without affecting the prediction. Though conceptually simple,…

Computation and Language · Computer Science 2021-03-03 Nicola De Cao , Michael Schlichtkrull , Wilker Aziz , Ivan Titov

Neural classifiers are non linear systems providing decisions on the classes of patterns, for a given problem they have learned. The output computed by a classifier for each pattern constitutes an approximation of the output of some unknown…

Machine Learning · Computer Science 2023-06-06 Stavros P. Adam , Aristidis C. Likas

With the success of deep learning, recent efforts have been focused on analyzing how learned networks make their classifications. We are interested in analyzing the network output based on the network structure and information flow through…

Machine Learning · Computer Science 2018-02-13 Sandeep Konam , Ian Quah , Stephanie Rosenthal , Manuela Veloso

Deep neural networks are being used increasingly to automate data analysis and decision making, yet their decision-making process is largely unclear and is difficult to explain to the end users. In this paper, we address the problem of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Vitali Petsiuk , Abir Das , Kate Saenko

We propose to explain the predictions of a deep neural network, by pointing to the set of what we call representer points in the training set, for a given test point prediction. Specifically, we show that we can decompose the pre-activation…

Machine Learning · Computer Science 2018-11-27 Chih-Kuan Yeh , Joon Sik Kim , Ian E. H. Yen , Pradeep Ravikumar

This paper introduces feature gradient flow, a new technique for interpreting deep learning models in terms of features that are understandable to humans. The gradient flow of a model locally defines nonlinear coordinates in the input data…

Image and Video Processing · Electrical Eng. & Systems 2023-07-26 Yinzhu Jin , Jonathan C. Garneau , P. Thomas Fletcher

Deep Neural Networks in NLP have enabled systems to learn complex non-linear relationships. One of the major bottlenecks towards being able to use DNNs for real world applications is their characterization as black boxes. To solve this…

Computation and Language · Computer Science 2022-06-01 Subhadip Maji , Arijit Ghosh Chowdhury , Raghav Bali , Vamsi M Bhandaru

Over the past decade, deep learning has proven to be a highly effective tool for learning meaningful features from raw data. However, it remains an open question how deep networks perform hierarchical feature learning across layers. In this…

Machine Learning · Computer Science 2025-11-17 Peng Wang , Xiao Li , Can Yaras , Zhihui Zhu , Laura Balzano , Wei Hu , Qing Qu

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

Deep learning models have been criticized for their lack of easy interpretation, which undermines confidence in their use for important applications. Nevertheless, they are consistently utilized in many applications, consequential to…

Machine Learning · Computer Science 2020-01-06 Roozbeh Yousefzadeh , Dianne P. O'Leary

A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Motoshi Abe , Junichi Miyao , Takio Kurita

Recent research towards understanding neural networks probes models in a top-down manner, but is only able to identify model tendencies that are known a priori. We propose Susceptibility Identification through Fine-Tuning (SIFT), a novel…

Computation and Language · Computer Science 2019-09-11 Jonas Pfeiffer , Aishwarya Kamath , Iryna Gurevych , Sebastian Ruder

Deep neural networks are widely used for classification. These deep models often suffer from a lack of interpretability -- they are particularly difficult to understand because of their non-linear nature. As a result, neural networks are…

Artificial Intelligence · Computer Science 2017-11-22 Oscar Li , Hao Liu , Chaofan Chen , Cynthia Rudin

Despite their increasing popularity and success in a variety of supervised learning problems, deep neural networks are extremely hard to interpret and debug: Given and already trained Deep Neural Net, and a set of test inputs, how can we…

Machine Learning · Computer Science 2018-06-07 Uday Singh Saini , Evangelos E. Papalexakis

In this article we will analyse how to compute the contribution of each input value to its aggregate output in some nonlinear models. Regression and classification applications, together with related algorithms for deep neural networks are…

Machine Learning · Computer Science 2022-07-26 Cosimo Izzo

Although deep learning models perform remarkably well across a range of tasks such as language translation and object recognition, it remains unclear what high-level logic, if any, they follow. Understanding this logic may lead to more…

Databases · Computer Science 2019-01-08 Thibault Sellam , Kevin Lin , Ian Yiran Huang , Yiru Chen , Michelle Yang , Carl Vondrick , Eugene Wu

Neural networks have been criticized for their lack of easy interpretation, which undermines confidence in their use for important applications. Here, we introduce a novel technique, interpreting a trained neural network by investigating…

Machine Learning · Computer Science 2019-03-22 Roozbeh Yousefzadeh , Dianne P. O'Leary

Feature attribution methods, which explain an individual prediction made by a model as a sum of attributions for each input feature, are an essential tool for understanding the behavior of complex deep learning models. However, ensuring…

Machine Learning · Computer Science 2020-10-28 Ethan Weinberger , Joseph Janizek , Su-In Lee

An important step towards explaining deep image classifiers lies in the identification of image regions that contribute to individual class scores in the model's output. However, doing this accurately is a difficult task due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Steven Stalder , Nathanaël Perraudin , Radhakrishna Achanta , Fernando Perez-Cruz , Michele Volpi

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Xiaojie Jin , Yunpeng Chen , Jian Dong , Jiashi Feng , Shuicheng Yan