English
Related papers

Related papers: Certified Robustness via Dynamic Margin Maximizati…

200 papers

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

Machine Learning · Computer Science 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

Machine Learning · Computer Science 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

Machine Learning · Computer Science 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

Despite the promise of Lipschitz-based methods for provably-robust deep learning with deterministic guarantees, current state-of-the-art results are limited to feed-forward Convolutional Networks (ConvNets) on low-dimensional data, such as…

Machine Learning · Computer Science 2023-10-31 Kai Hu , Andy Zou , Zifan Wang , Klas Leino , Matt Fredrikson

Recent studies have highlighted the potential of Lipschitz-based methods for training certifiably robust neural networks against adversarial attacks. A key challenge, supported both theoretically and empirically, is that robustness demands…

Machine Learning · Computer Science 2024-06-25 Kai Hu , Klas Leino , Zifan Wang , Matt Fredrikson

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

Tight estimation of the Lipschitz constant for deep neural networks (DNNs) is useful in many applications ranging from robustness certification of classifiers to stability analysis of closed-loop systems with reinforcement learning…

Machine Learning · Computer Science 2023-01-18 Mahyar Fazlyab , Alexander Robey , Hamed Hassani , Manfred Morari , George J. Pappas

Despite recent success, state-of-the-art learning-based models remain highly vulnerable to input changes such as adversarial examples. In order to obtain certifiable robustness against such perturbations, recent work considers…

Machine Learning · Computer Science 2023-09-13 Max Losch , David Stutz , Bernt Schiele , Mario Fritz

Designing neural networks with bounded Lipschitz constant is a promising way to obtain certifiably robust classifiers against adversarial examples. However, the relevant progress for the important $\ell_\infty$ perturbation setting is…

Machine Learning · Computer Science 2022-10-28 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Robustness of machine learning models to various adversarial and non-adversarial corruptions continues to be of interest. In this paper, we introduce the notion of the boundary thickness of a classifier, and we describe its connection with…

Deep learning has achieved remarkable success across a wide range of tasks, but its models often suffer from instability and vulnerability: small changes to the input may drastically affect predictions, while optimization can be hindered by…

Machine Learning · Computer Science 2025-10-30 Blaise Delattre

The Lipschitz constant plays a crucial role in certifying the robustness of neural networks to input perturbations. Since calculating the exact Lipschitz constant is NP-hard, efforts have been made to obtain tight upper bounds on the…

Machine Learning · Computer Science 2024-10-30 Yuezhu Xu , S. Sivaranjani

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

Machine Learning · Computer Science 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

The threat of adversarial examples has motivated work on training certifiably robust neural networks to facilitate efficient verification of local robustness at inference time. We formalize a notion of global robustness, which captures the…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Zifan Wang , Matt Fredrikson

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

Machine Learning · Computer Science 2022-07-18 Sarosij Bose

Deriving sharp and computable upper bounds of the Lipschitz constant of deep neural networks is crucial to formally guarantee the robustness of neural-network based models. We analyse three existing upper bounds written for the $l^2$ norm.…

Machine Learning · Computer Science 2024-10-29 Moreno Pintore , Bruno Després
‹ Prev 1 2 3 10 Next ›