English
Related papers

Related papers: Network Moments: Extensions and Sparse-Smooth Atta…

200 papers

Deep neural networks (DNNs) have been demonstrated as effective prognostic models across various domains, e.g. natural language processing, computer vision, and genomics. However, modern-day DNNs demand high compute and memory storage for…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-27 Zachariah Carmichael , Hamed F. Langroudi , Char Khazanov , Jeffrey Lillie , John L. Gustafson , Dhireesha Kudithipudi

Deep neural networks are at the forefront of machine learning research. However, despite achieving impressive performance on complex tasks, they can be very sensitive: Small perturbations of inputs can be sufficient to induce incorrect…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Alex Serban , Erik Poll , Joost Visser

Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, the problem remains open. In this paper, we…

Machine Learning · Computer Science 2020-06-25 Ginevra Carbone , Matthew Wicker , Luca Laurenti , Andrea Patane , Luca Bortolussi , Guido Sanguinetti

Deep Neural Networks (DNNs) have been shown to be vulnerable against adversarial examples, which are data points cleverly constructed to fool the classifier. Such attacks can be devastating in practice, especially as DNNs are being applied…

Cryptography and Security · Computer Science 2018-01-30 Linh Nguyen , Sky Wang , Arunesh Sinha

Motivation: Several different threads of research have been proposed for modeling and mining temporal data. On the one hand, approaches such as dynamic Bayesian networks (DBNs) provide a formal probabilistic basis to model relationships…

Machine Learning · Computer Science 2009-04-15 Debprakash Patnaik , Srivatsan Laxman , Naren Ramakrishnan

Deep neural networks (DNNs) are now commonly used in many domains. However, they are vulnerable to adversarial attacks: carefully crafted perturbations on data inputs that can fool a model into making incorrect predictions. Despite…

Machine Learning · Computer Science 2020-09-09 Nilaksh Das , Haekyu Park , Zijie J. Wang , Fred Hohman , Robert Firstman , Emily Rogers , Duen Horng Chau

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

In this work we study the properties of deep neural networks (DNN) with random weights. We formally prove that these networks perform a distance-preserving embedding of the data. Based on this we then draw conclusions on the size of the…

Machine Learning · Statistics 2015-06-04 Raja Giryes , Guillermo Sapiro , Alex M. Bronstein

For reliability, it is important that the predictions made by machine learning methods are interpretable by human. In general, deep neural networks (DNNs) can provide accurate predictions, although it is difficult to interpret why such…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

Deep Neural Networks (DNNs) are often criticized for being susceptible to adversarial attacks. Most successful defense strategies adopt adversarial training or random input transformations that typically require retraining or fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Lokender Tiwari , Anish Madan , Saket Anand , Subhashis Banerjee

Recent work on deep neural network pruning has shown there exist sparse subnetworks that achieve equal or improved accuracy, training time, and loss using fewer network parameters when compared to their dense counterparts. Orthogonal to…

Machine Learning · Computer Science 2019-12-06 Justin Cosentino , Federico Zaiter , Dan Pei , Jun Zhu

State-of-the-art deep neural networks are sensitive to small input perturbations. Since the discovery of this intriguing vulnerability, many defence methods have been proposed that attempt to improve robustness to adversarial noise. Fast…

Machine Learning · Computer Science 2021-06-04 Alexander Matyasko , Lap-Pui Chau

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several…

Machine Learning · Computer Science 2021-02-24 Jianlin Li , Pengfei Yang , Jiangchao Liu , Liqian Chen , Xiaowei Huang , Lijun Zhang

Artificial neural networks (NNs) are one of the most frequently used machine learning approaches to construct interatomic potentials and enable efficient large-scale atomistic simulations with almost ab initio accuracy. However, the…

Computational Physics · Physics 2021-10-05 Viktor Zaverkin , David Holzmüller , Ingo Steinwart , Johannes Kästner

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

Robotics · Computer Science 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

Deep neural nets (DNNs) compression is crucial for adaptation to mobile devices. Though many successful algorithms exist to compress naturally trained DNNs, developing efficient and stable compression algorithms for robustly trained DNNs…

Machine Learning · Computer Science 2020-03-03 Thu Dinh , Bao Wang , Andrea L. Bertozzi , Stanley J. Osher

Adversarial sample attacks perturb benign inputs to induce DNN misbehaviors. Recent research has demonstrated the widespread presence and the devastating consequences of such attacks. Existing defense techniques either assume prior…

Machine Learning · Computer Science 2018-10-30 Guanhong Tao , Shiqing Ma , Yingqi Liu , Xiangyu Zhang

Deep neural networks (NNs) for computer vision are vulnerable to adversarial attacks, i.e., miniscule malicious changes to inputs may induce unintuitive outputs. One key approach to verify and mitigate such robustness issues is to falsify…

Cryptography and Security · Computer Science 2025-10-07 Raik Dankworth , Gesina Schwalbe

Deep neural networks (DNNs) have become ubiquitous thanks to their remarkable ability to model complex patterns across various domains such as computer vision, speech recognition, robotics, etc. While large DNN models are often more…

Machine Learning · Computer Science 2025-11-18 Omkar Shende , Gayathri Ananthanarayanan , Marcello Traiola

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham