English
Related papers

Related papers: Towards better understanding of gradient-based att…

200 papers

We propose a novel deep neural network (DNN) based approximation architecture to learn estimates of measurements. We detail an algorithm that enables training of the DNN. The DNN estimator only uses measurements, if and when they are…

Machine Learning · Computer Science 2022-09-13 Shivangi Agarwal , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson

We study the attribution problem [28] for deep networks applied to perception tasks. For vision tasks, attribution techniques attribute the prediction of a network to the pixels of the input image. We propose a new technique called…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Shawn Xu , Subhashini Venugopalan , Mukund Sundararajan

For Deep Neural Networks (DNNs) to become useful in safety-critical applications, such as self-driving cars and disease diagnosis, they must be stable to perturbations in input and model parameters. Characterizing the sensitivity of a DNN…

Machine Learning · Computer Science 2023-07-25 Naman Maheshwari , Nicholas Malaya , Scott Moe , Jaydeep P. Kulkarni , Sudhanva Gurumurthi

Deep neural networks have been shown to be vulnerable to adversarial examples---maliciously crafted examples that can trigger the target model to misbehave by adding imperceptible perturbations. Existing attack methods for k-nearest…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xiaodan Li , Yuefeng Chen , Yuan He , Hui Xue

Graph neural networks (GNNs) are the predominant approach for graph-based machine learning. While neural networks have shown great performance at learning useful representations, they are often criticized for their limited high-level…

Machine Learning · Computer Science 2024-07-09 Markus Zopf , Francesco Alesiani

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Graphs are ubiquitous in many applications, such as social networks, knowledge graphs, smart grids, etc.. Graph neural networks (GNN) are the current state-of-the-art for these applications, and yet remain obscure to humans. Explaining the…

Machine Learning · Computer Science 2021-11-22 Yazheng Liu , Xi Zhang , Sihong Xie

Even though deep neural networks (DNNs) achieve state-of-the-art results for a number of problems involving genomic data, getting DNNs to explain their decision-making process has been a major challenge due to their black-box nature. One…

Genomics · Quantitative Biology 2022-12-14 Utku Ozbulak , Solha Kang , Jasper Zuallaert , Stephen Depuydt , Joris Vankerschaver

Deep Neural Networks (DNNs) have recently shown state of the art performance on semantic segmentation tasks, however, they still suffer from problems of poor boundary localization and spatial fragmented predictions. The difficulties lie in…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Peng Jiang , Fanglin Gu , Yunhai Wang , Changhe Tu , Baoquan Chen

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion metrics are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Lars Nieradzik , Henrike Stephani , Janis Keuper

How do two deep neural networks differ in how they arrive at a decision? Measuring the similarity of deep networks has been a long-standing open question. Most existing methods provide a single number to measure the similarity of two…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Neehar Kondapaneni , Oisin Mac Aodha , Pietro Perona

Deep learning, computational neuroscience, and cognitive science have overlapping goals related to understanding intelligence such that perception and behaviour can be simulated in computational systems. In neuroimaging, machine learning…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Jessica A. F. Thompson , Yoshua Bengio , Elia Formisano , Marc Schönwiesner

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

The leap in performance in state-of-the-art computer vision methods is attributed to the development of deep neural networks. However it often comes at a computational price which may hinder their deployment. To alleviate this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Edouard Yvinec , Arnaud Dapogny , Matthieu Cord , Kevin Bailly

Recent research has demonstrated that feature attribution methods for deep networks can themselves be incorporated into training; these attribution priors optimize for a model whose attributions have certain desirable properties -- most…

Machine Learning · Computer Science 2020-11-12 Gabriel Erion , Joseph D. Janizek , Pascal Sturmfels , Scott Lundberg , Su-In Lee

Explainability in Graph Neural Networks (GNNs) is a new field growing in the last few years. In this publication we address the problem of determining how important is each neighbor for the GNN when classifying a node and how to measure the…