English
Related papers

Related papers: Globally-Robust Neural Networks

200 papers

Robustness of machine learning models to various adversarial and non-adversarial corruptions continues to be of interest. In this paper, we introduce the notion of the boundary thickness of a classifier, and we describe its connection with…

Channel estimation is crucial in wireless communications. However, in many papers neural networks are frequently tested by training and testing on one example channel or similar channels. This is because data-driven methods often degrade on…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Dianxin Luan , John Thompson

In this work we propose a graph-based learning framework to train models with provable robustness to adversarial perturbations. In contrast to regularization-based approaches, we formulate the adversarially robust learning problem as one of…

Machine Learning · Computer Science 2020-10-26 Vishaal Krishnan , Abed AlRahman Al Makdah , Fabio Pasqualetti

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

Deep neural networks are considered to be state of the art models in many offline machine learning tasks. However, their performance and generalization abilities in online learning tasks are much less understood. Therefore, we focus on…

Machine Learning · Computer Science 2019-05-28 Guy Uziel

Robustness verification of neural networks, referring to formally proving that neural networks satisfy robustness properties, is of crucial importance in safety-critical applications, where model failures can result in loss of human life or…

Machine Learning · Computer Science 2026-04-06 Minh Le , Phuong Cao

Recent works have developed several methods of defending neural networks against adversarial attacks with certified guarantees. However, these techniques can be computationally costly due to the use of certification during training. We…

Machine Learning · Computer Science 2021-02-03 Akhilan Boopathy , Tsui-Wei Weng , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Luca Daniel

A robustness certificate is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} input perturbations with a magnitude smaller than the certificate value, the classification…

Machine Learning · Computer Science 2020-06-02 Sahil Singla , Soheil Feizi

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

Machine Learning · Computer Science 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

Several recent papers have discussed utilizing Lipschitz constants to limit the susceptibility of neural networks to adversarial examples. We analyze recently proposed methods for computing the Lipschitz constant. We show that the Lipschitz…

Machine Learning · Computer Science 2018-07-26 Todd Huster , Cho-Yu Jason Chiang , Ritu Chadha

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

Making neural networks robust against adversarial inputs has resulted in an arms race between new defenses and attacks. The most promising defenses, adversarially robust training and verifiably robust training, have limitations that…

Machine Learning · Computer Science 2018-12-04 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Recurrent neural networks (RNNs) are a class of nonlinear dynamical systems often used to model sequence-to-sequence maps. RNNs have excellent expressive power but lack the stability or robustness guarantees that are necessary for many…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

Great advances in deep neural networks (DNNs) have led to state-of-the-art performance on a wide range of tasks. However, recent studies have shown that DNNs are vulnerable to adversarial attacks, which have brought great concerns when…

Machine Learning · Computer Science 2023-04-13 Linyi Li , Tao Xie , Bo Li

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

Machine Learning · Computer Science 2025-03-12 Christopher Zach

Deep learning has achieved remarkable success across a wide range of domains, significantly expanding the frontiers of what is achievable in artificial intelligence. Yet, despite these advances, critical challenges remain -- most notably,…

Machine Learning · Computer Science 2026-02-05 Róisín Luo

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Under data distributions which may be heavy-tailed, many stochastic gradient-based learning algorithms are driven by feedback queried at points with almost no performance guarantees on their own. Here we explore a modified "anytime…

Machine Learning · Statistics 2023-12-01 Matthew J. Holland