English
Related papers

Related papers: Towards Stable and Efficient Training of Verifiabl…

200 papers

To obtain, deterministic guarantees of adversarial robustness, specialized training methods are used. We propose, SABR, a novel such certified training method, based on the key insight that propagating interval bounds for a small but…

Machine Learning · Computer Science 2023-03-10 Mark Niklas Müller , Franziska Eckert , Marc Fischer , Martin Vechev

In safety-critical but computationally resource-constrained applications, deep learning faces two key challenges: lack of robustness against adversarial attacks and large neural network size (often millions of parameters). While the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Vikash Sehwag , Shiqi Wang , Prateek Mittal , Suman Jana

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

Continual learning under adversarial conditions remains an open problem, as existing methods often compromise either robustness, scalability, or both. We propose a novel framework that integrates Interval Bound Propagation (IBP) with a…

Machine Learning · Computer Science 2025-11-24 Patryk Krukowski , Łukasz Gorczyca , Piotr Helm , Kamil Książek , Przemysław Spurek

Learning-based methods for synthesizing controllers have gained popularity due to their high expressiveness and strong empirical performance. However, in safety-critical scenarios such as autonomous driving, robotics, and power systems,…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Haoyu Li , Xiangru Zhong , Hao Cheng , Bin Hu , Huan Zhang

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

State-of-the-art neural network (NN) verifiers demonstrate that applying the branch-and-bound (BaB) procedure with fast bounding techniques plays a key role in tackling many challenging verification properties. In this work, we introduce…

Machine Learning · Computer Science 2025-12-15 Duo Zhou , Jorge Chavez , Hesun Chen , Grani A. Hanasusanto , Huan Zhang

Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that adversarial examples…

Machine Learning · Computer Science 2024-05-01 Ge Yan , Yaniv Romano , Tsui-Wei Weng

Neural networks (NNs) are now routinely implemented on systems that must operate in uncertain environments, but the tools for formally analyzing how this uncertainty propagates to NN outputs are not yet commonplace. Computing tight bounds…

Machine Learning · Computer Science 2020-12-08 Michael Everett , Golnaz Habibi , Jonathan P. How

With the increasing application of deep learning in mission-critical systems, there is a growing need to obtain formal guarantees about the behaviors of neural networks. Indeed, many approaches for verifying neural networks have been…

Machine Learning · Computer Science 2022-08-17 Tom Zelazny , Haoze Wu , Clark Barrett , Guy Katz

Sparse training is a natural idea to accelerate the training speed of deep neural networks and save the memory usage, especially since large modern neural networks are significantly over-parameterized. However, most of the existing methods…

Machine Learning · Computer Science 2021-11-11 Xiao Zhou , Weizhong Zhang , Zonghao Chen , Shizhe Diao , Tong Zhang

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

Interval analysis (or interval bound propagation, IBP) is a popular technique for verifying and training provably robust deep neural networks, a fundamental challenge in the area of reliable machine learning. However, despite substantial…

Machine Learning · Computer Science 2021-12-15 Matthew Mirman , Maximilian Baader , Martin Vechev

This paper proposes a novel, abstraction-based, certified training method for robust image classifiers. Via abstraction, all perturbed images are mapped into intervals before feeding into neural networks for training. By training on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Zhaodi Zhang , Zhiyi Xue , Yang Chen , Si Liu , Yueling Zhang , Jing Liu , Min Zhang

Deep neural networks are vulnerable to so-called adversarial examples: inputs which are intentionally constructed to cause the model to make incorrect predictions or classifications. Adversarial examples are often visually indistinguishable…

Machine Learning · Computer Science 2024-05-28 Jonathan Peck , Bart Goossens

Deep neural networks have been widely adopted in many vision and robotics applications with visual inputs. It is essential to verify its robustness against semantic transformation perturbations, such as brightness and contrast. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hanjiang Hu , Bowei Li , Ziwei Wang , Tianhao Wei , Casidhe Hutchison , Eric Sample , Changliu Liu

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Artificial Neural Networks (ANNs) trained with Backpropagation (BP) excel in different daily tasks but have a dangerous vulnerability: inputs with small targeted perturbations, also known as adversarial samples, can drastically disrupt…

Machine Learning · Computer Science 2024-06-04 Matilde Tristany Farinha , Thomas Ortner , Giorgia Dellaferrera , Benjamin Grewe , Angeliki Pantazi