English
Related papers

Related papers: Layer-Wise Interpretation of Deep Neural Networks …

200 papers

Deep neural networks (DNNs) have demonstrated impressive performance on a wide array of tasks, but they are usually considered opaque since internal structure and learned parameters are not interpretable. In this paper, we re-examine the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yinpeng Dong , Hang Su , Jun Zhu , Fan Bao

Dedicated neural network (NN) architectures have been designed to handle specific data types (such as CNN for images or RNN for text), which ranks them among state-of-the-art methods for dealing with these data. Unfortunately, no…

Machine Learning · Statistics 2022-10-03 Patrick Lutz , Ludovic Arnould , Claire Boyer , Erwan Scornet

Adopting Convolutional Neural Networks (CNNs) in the daily routine of primary diagnosis requires not only near-perfect precision, but also a sufficient degree of generalization to data acquisition shifts and transparency. Existing CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Mara Graziani , Sebastian Otalora , Stephane Marchand-Maillet , Henning Muller , Vincent Andrearczyk

With the proliferation of models for natural language processing tasks, it is even harder to understand the differences between models and their relative merits. Simply looking at differences between holistic metrics such as accuracy, BLEU,…

Computation and Language · Computer Science 2020-12-10 Jinlan Fu , Pengfei Liu , Graham Neubig

The current understanding of deep neural networks can only partially explain how input structure, network parameters and optimization algorithms jointly contribute to achieve the strong generalization power that is typically observed in…

Machine Learning · Computer Science 2021-01-28 Francesco Craighero , Fabrizio Angaroni , Alex Graudenzi , Fabio Stella , Marco Antoniotti

Modern deep networks are highly complex and their inferential outcome very hard to interpret. This is a serious obstacle to their transparent deployment in safety-critical or bias-aware applications. This work contributes to post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Konstantinos P. Panousis , Sotirios Chatzis

Cybersecurity is a domain where the data distribution is constantly changing with attackers exploring newer patterns to attack cyber infrastructure. Intrusion detection system is one of the important layers in cyber safety in today's world.…

Cryptography and Security · Computer Science 2021-03-15 Shraddha Mane , Dattaraj Rao

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by…

Computation and Language · Computer Science 2021-07-12 Wei Zhao , Rahul Singh , Tarun Joshi , Agus Sudjianto , Vijayan N. Nair

As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Woo-Jeoung Nam , Seong-Whan Lee

The interpretability of neural networks has recently received extensive attention. Previous prototype-based explainable networks involved prototype activation in both reasoning and interpretation processes, requiring specific explainable…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yitao Peng , Yihang Liu , Longzhen Yang , Lianghua He

Local explanation methods, also known as attribution methods, attribute a deep network's prediction to its input (cf. Baehrens et al. (2010)). We respond to the claim from Adebayo et al. (2018) that local explanation methods lack…

Machine Learning · Computer Science 2018-06-13 Mukund Sundararajan , Ankur Taly

Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and…

Materials Science · Physics 2021-05-26 Keith T. Butler , Manh Duc Le , Jeyarajan Thiyagalingam , Toby G. Perring

Deep neural networks have become essential for numerous applications due to their strong empirical performance such as vision, RL, and classification. Unfortunately, these networks are quite difficult to interpret, and this limits their…

Machine Learning · Computer Science 2021-10-12 Sina Alemohammad , Hossein Babaei , CJ Barberan , Naiming Liu , Lorenzo Luzi , Blake Mason , Richard G. Baraniuk

One significant challenge of exploiting Graph neural networks (GNNs) in real-life scenarios is that they are always treated as black boxes, therefore leading to the requirement of interpretability. To address this, model-level…

Machine Learning · Computer Science 2025-09-22 Xiao Yue , Guangzhi Qu , Lige Gan

Interpretation and explanation of deep models is critical towards wide adoption of systems that rely on them. In this paper, we propose a novel scheme for both interpretation as well as explanation in which, given a pretrained model, we…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Jose Oramas , Kaili Wang , Tinne Tuytelaars

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

In this paper, we present a novel approach to perform deep neural networks layer-wise weight initialization using Linear Discriminant Analysis (LDA). Typically, the weights of a deep neural network are initialized with: random values,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Michele Alberti , Mathias Seuret , Vinaychandran Pondenkandath , Rolf Ingold , Marcus Liwicki

Evaluation of generative models is mostly based on the comparison between the estimated distribution and the ground truth distribution in a certain feature space. To embed samples into informative features, previous works often use…

Machine Learning · Computer Science 2022-12-15 Junghyuk Lee , Jun-Hyuk Kim , Jong-Seok Lee

Being able to interpret, or explain, the predictions made by a machine learning model is of fundamental importance. This is especially true when there is interest in deploying data-driven models to make high-stakes decisions, e.g. in…

Machine Learning · Computer Science 2019-10-01 An-phi Nguyen , María Rodríguez Martínez