English
Related papers

Related papers: Understanding Certified Training with Interval Bou…

200 papers

Training certifiable neural networks enables one to obtain models with robustness guarantees against adversarial attacks. In this work, we introduce a framework to bound the adversary-free region in the neighborhood of the input data by a…

Machine Learning · Computer Science 2021-09-21 Chen Liu , Mathieu Salzmann , Sabine Süsstrunk

The threat of adversarial examples has motivated work on training certifiably robust neural networks to facilitate efficient verification of local robustness at inference time. We formalize a notion of global robustness, which captures the…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Zifan Wang , Matt Fredrikson

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

To improve the robustness of deep classifiers against adversarial perturbations, many approaches have been proposed, such as designing new architectures with better robustness properties (e.g., Lipschitz-capped networks), or modifying the…

Machine Learning · Computer Science 2025-03-27 Mahyar Fazlyab , Taha Entesari , Aniket Roy , Rama Chellappa

A robustness certificate is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} input perturbations with a magnitude smaller than the certificate value, the classification…

Machine Learning · Computer Science 2020-06-02 Sahil Singla , Soheil Feizi

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Neural networks offer a computationally efficient approximation of model predictive control, but they lack guarantees on the resulting controlled system's properties. Formal certification of neural networks is crucial for ensuring safety,…

Optimization and Control · Mathematics 2025-02-05 Philip Sosnin , Calvin Tsay

Training certifiably robust neural networks remains a notoriously hard problem. On one side, adversarial training optimizes under-approximations of the worst-case loss, which leads to insufficient regularization for certification, while on…

Machine Learning · Computer Science 2023-10-26 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

To obtain, deterministic guarantees of adversarial robustness, specialized training methods are used. We propose, SABR, a novel such certified training method, based on the key insight that propagating interval bounds for a small but…

Machine Learning · Computer Science 2023-03-10 Mark Niklas Müller , Franziska Eckert , Marc Fischer , Martin Vechev

Federated learning has recently gained significant attention and popularity due to its effectiveness in training machine learning models on distributed data privately. However, as in the single-node supervised learning setup, models trained…

Machine Learning · Computer Science 2022-10-27 Motasem Alfarra , Juan C. Pérez , Egor Shulgin , Peter Richtárik , Bernard Ghanem

Neural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data augmentation to partially mitigate such…

Computation and Language · Computer Science 2019-12-23 Po-Sen Huang , Robert Stanforth , Johannes Welbl , Chris Dyer , Dani Yogatama , Sven Gowal , Krishnamurthy Dvijotham , Pushmeet Kohli

Control barrier functions (CBFs) are a popular tool for safety certification of nonlinear dynamical control systems. Recently, CBFs represented as neural networks have shown great promise due to their expressiveness and applicability to a…

Machine Learning · Computer Science 2026-04-15 Nikolaus Vertovec , Frederik Baymler Mathiesen , Thom Badings , Luca Laurenti , Alessandro Abate

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

Machine Learning · Computer Science 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

Certified defenses against small-norm adversarial examples have received growing attention in recent years; though certified accuracies of state-of-the-art methods remain far below their non-robust counterparts, despite the fact that…

Machine Learning · Computer Science 2023-01-24 Klas Leino

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

The use of Mixed-Integer Linear Programming (MILP) models to represent neural networks with Rectified Linear Unit (ReLU) activations has become increasingly widespread in the last decade. This has enabled the use of MILP technology to…

Optimization and Control · Mathematics 2024-02-01 Fabian Badilla , Marcos Goycoolea , Gonzalo Muñoz , Thiago Serra

Robust training methods typically defend against specific attack types, such as Lp attacks with fixed budgets, and rarely account for the fact that defenders may encounter new attacks over time. A natural solution is to adapt the defended…

Machine Learning · Computer Science 2025-02-07 Sihui Dai , Christian Cianfarani , Arjun Bhagoji , Vikash Sehwag , Prateek Mittal

In recent years, the application of artificial intelligence (AI) in wireless communications has demonstrated inherent robustness against wireless channel distortions. Most existing works empirically leverage this robustness to yield…

Information Theory · Computer Science 2025-07-09 Yangshuo He , Guanding Yu , Huaiyu Dai

The robustness of deep neural networks has received significant interest recently, especially when being deployed in safety-critical systems, as it is important to analyze how sensitive the model output is under input perturbations. While…

Machine Learning · Computer Science 2022-03-29 Zhilu Wang , Chao Huang , Qi Zhu

This paper proposes a theoretical and computational framework for training and robustness verification of implicit neural networks based upon non-Euclidean contraction theory. The basic idea is to cast the robustness analysis of a neural…

Machine Learning · Computer Science 2022-08-09 Saber Jafarpour , Alexander Davydov , Matthew Abate , Francesco Bullo , Samuel Coogan