English
Related papers

Related papers: IBP Regularization for Verified Adversarial Robust…

200 papers

Recent work has shown that it is possible to train deep neural networks that are provably robust to norm-bounded adversarial perturbations. Most of these methods are based on minimizing an upper bound on the worst-case loss over all…

Training neural networks with verifiable robustness guarantees is challenging. Several existing approaches utilize linear relaxation based neural network output bounds under perturbation, but they can slow down training by a factor of…

Machine Learning · Computer Science 2019-11-28 Huan Zhang , Hongge Chen , Chaowei Xiao , Sven Gowal , Robert Stanforth , Bo Li , Duane Boning , Cho-Jui Hsieh

Recent works have shown that interval bound propagation (IBP) can be used to train verifiably robust neural networks. Reseachers observe an intriguing phenomenon on these IBP trained networks: CROWN, a bounding method based on tight linear…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Zhaoyang Lyu , Minghao Guo , Tong Wu , Guodong Xu , Kehuan Zhang , Dahua Lin

As robustness verification methods are becoming more precise, training certifiably robust neural networks is becoming ever more relevant. To this end, certified training methods compute and then optimize an upper bound on the worst-case…

Machine Learning · Computer Science 2024-02-29 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

Training Deep Neural Networks that are robust to norm bounded adversarial attacks remains an elusive problem. While exact and inexact verification-based methods are generally too expensive to train large networks, it was demonstrated that…

Machine Learning · Computer Science 2021-06-15 Salman Alsubaihi , Adel Bibi , Modar Alfadly , Abdullah Hamdi , Bernard Ghanem

Interval Bound Propagation (IBP) is so far the base of state-of-the-art methods for training neural networks with certifiable robustness guarantees when potential adversarial perturbations present, while the convergence of IBP training…

Machine Learning · Computer Science 2022-03-18 Yihan Wang , Zhouxing Shi , Quanquan Gu , Cho-Jui Hsieh

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Recent works have developed several methods of defending neural networks against adversarial attacks with certified guarantees. However, these techniques can be computationally costly due to the use of certification during training. We…

Machine Learning · Computer Science 2021-02-03 Akhilan Boopathy , Tsui-Wei Weng , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Luca Daniel

Neural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data augmentation to partially mitigate such…

Computation and Language · Computer Science 2019-12-23 Po-Sen Huang , Robert Stanforth , Johannes Welbl , Chris Dyer , Dani Yogatama , Sven Gowal , Krishnamurthy Dvijotham , Pushmeet Kohli

We study the problem of training and certifying adversarially robust quantized neural networks (QNNs). Quantization is a technique for making neural networks more efficient by running them using low-bit integer arithmetic and is therefore…

Machine Learning · Computer Science 2022-11-30 Mathias Lechner , Đorđe Žikelić , Krishnendu Chatterjee , Thomas A. Henzinger , Daniela Rus

Neural networks achieve strong empirical performance, but robustness concerns still hinder deployment in safety-critical applications. Formal verification provides robustness guarantees, but current methods face a scalability-completeness…

Machine Learning · Computer Science 2026-02-06 Wenting Li , Saif R. Kazi , Russell Bent , Duo Zhou , Huan Zhang

Recently, bound propagation based certified robust training methods have been proposed for training neural networks with certifiable robustness guarantees. Despite that state-of-the-art (SOTA) methods including interval bound propagation…

Machine Learning · Computer Science 2021-10-29 Zhouxing Shi , Yihan Wang , Huan Zhang , Jinfeng Yi , Cho-Jui Hsieh

We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical…

Machine Learning · Computer Science 2021-06-08 Jiameng Fan , Wenchao Li

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

In this paper, we propose a novel method, IB-RAR, which uses Information Bottleneck (IB) to strengthen adversarial robustness for both adversarial training and non-adversarial-trained methods. We first use the IB theory to build…

Machine Learning · Computer Science 2023-06-01 Xiaoyun Xu , Guilherme Perin , Stjepan Picek

Making neural networks robust against adversarial inputs has resulted in an arms race between new defenses and attacks. The most promising defenses, adversarially robust training and verifiably robust training, have limitations that…

Machine Learning · Computer Science 2018-12-04 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

Many state-of-the-art adversarial training methods for deep learning leverage upper bounds of the adversarial loss to provide security guarantees against adversarial attacks. Yet, these methods rely on convex relaxations to propagate lower…

Machine Learning · Computer Science 2023-04-07 Dimitris Bertsimas , Xavier Boix , Kimberly Villalobos Carballo , Dick den Hertog

To obtain, deterministic guarantees of adversarial robustness, specialized training methods are used. We propose, SABR, a novel such certified training method, based on the key insight that propagating interval bounds for a small but…

Machine Learning · Computer Science 2023-03-10 Mark Niklas Müller , Franziska Eckert , Marc Fischer , Martin Vechev

In various scenarios motivated by real life, such as medical data analysis, autonomous driving, and adversarial training, we are interested in robust deep networks. A network is robust when a relatively small perturbation of the input…

Machine Learning · Computer Science 2024-10-07 Patryk Krukowski , Daniel Wilczak , Jacek Tabor , Anna Bielawska , Przemysław Spurek

We present an efficient technique, which allows to train classification networks which are verifiably robust against norm-bounded adversarial attacks. This framework is built upon the work of Gowal et al., who applies the interval…

Machine Learning · Computer Science 2019-07-04 Paweł Morawiecki , Przemysław Spurek , Marek Śmieja , Jacek Tabor
‹ Prev 1 2 3 10 Next ›