English
Related papers

Related papers: Reachability Analysis of Deep Neural Networks with…

200 papers

Despite the improved accuracy of deep neural networks, the discovery of adversarial examples has raised serious safety concerns. In this paper, we study two variants of pointwise robustness, the maximum safe radius problem, which for a…

Machine Learning · Computer Science 2020-04-07 Min Wu , Matthew Wicker , Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska

Research in computational deep learning has directed considerable efforts towards hardware-oriented optimisations for deep neural networks, via the simplification of the activation functions, or the quantization of both activations and…

Machine Learning · Computer Science 2020-11-04 Gian Paolo Leonardi , Matteo Spallanzani

Deep Neural Networks (DNN) have emerged as an effective approach to tackling real-world problems. However, like human-written software, DNNs are susceptible to bugs and attacks. This has generated significant interests in developing…

Machine Learning · Computer Science 2024-01-29 Hai Duong , Dong Xu , ThanhVu Nguyen , Matthew B. Dwyer

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

The Lipschitz constant plays a crucial role in certifying the robustness of neural networks to input perturbations. Since calculating the exact Lipschitz constant is NP-hard, efforts have been made to obtain tight upper bounds on the…

Machine Learning · Computer Science 2024-10-30 Yuezhu Xu , S. Sivaranjani

Neural networks achieved high performance over different tasks, i.e. image identification, voice recognition and other applications. Despite their success, these models are still vulnerable regarding small perturbations, which can be used…

Machine Learning · Computer Science 2023-01-31 João Zago , Eduardo Camponogara , Eric Antonelo

In this paper we consider Deep Neural Networks (DNNs) with a smooth activation function as surrogates for high-dimensional functions that are somewhat smooth but costly to evaluate. We consider the standard (non-periodic) DNNs as well as…

Numerical Analysis · Mathematics 2026-03-04 Alexander Keller , Frances Y. Kuo , Dirk Nuyens , Ian H. Sloan

Deep neural networks (DNNs) have become increasingly important due to their excellent empirical performance on a wide range of problems. However, regularization is generally achieved by indirect means, largely due to the complex set of…

Machine Learning · Computer Science 2018-07-02 Amal Rannen Triki , Maxim Berman , Matthew B. Blaschko

Deep neural networks (DNNs) have emerged as a powerful methodology with significant practical successes in fields such as computer vision and natural language processing. Recent works have demonstrated that sparsely connected DNNs with…

Statistics Theory · Mathematics 2025-05-08 The Tien Mai

As neural networks (NNs) become more prevalent in safety-critical applications such as control of vehicles, there is a growing need to certify that systems with NN components are safe. This paper presents a set of backward reachability…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Sydney M. Katz , Chelsea Sidrane , Esen Yel , Michael Everett , Mykel J. Kochenderfer , Jonathan P. How

This paper proposes a theoretical and computational framework for training and robustness verification of implicit neural networks based upon non-Euclidean contraction theory. The basic idea is to cast the robustness analysis of a neural…

Machine Learning · Computer Science 2022-08-09 Saber Jafarpour , Alexander Davydov , Matthew Abate , Francesco Bullo , Samuel Coogan

Neural networks (NNs) have emerged as a state-of-the-art method for modeling nonlinear systems in model predictive control (MPC). However, the robustness of NNs, in terms of sensitivity to small input perturbations, remains a critical…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Wallace Tan Gian Yion , Zhe Wu

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

Machine Learning · Computer Science 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

The problem of estimating the number of sources and their angles of arrival from a single antenna array observation has been an active area of research in the signal processing community for the last few decades. When the number of sources…

Signal Processing · Electrical Eng. & Systems 2019-02-19 Oded Bialer , Noa Garnett , Tom Tirer

Verifying properties and interpreting the behaviour of deep neural networks (DNN) is an important task given their ubiquitous use in applications, including safety-critical ones, and their black-box nature. We propose an automata-theoric…

Formal Languages and Automata Theory · Computer Science 2023-09-28 Marco Sälzer , Eric Alsmann , Florian Bruse , Martin Lange

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as…

Machine Learning · Computer Science 2020-10-19 Yu Li , Min Li , Bo Luo , Ye Tian , Qiang Xu

Accurate approximation of scalar-valued functions from sample points is a key task in computational science. Recently, machine learning with Deep Neural Networks (DNNs) has emerged as a promising tool for scientific computing, with…

Machine Learning · Computer Science 2021-03-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Network reliability measures the probability that a target node is reachable from a source node in an uncertain graph, i.e., a graph where every edge is associated with a probability of existence. In this paper, we investigate the novel and…

Databases · Computer Science 2020-05-26 Xiangyu Ke , Arijit Khan , Mohammad Al Hasan , Rojin Rezvansangsari