English
Related papers

Related papers: Fast and Stable Interval Bounds Propagation for Tr…

200 papers

We consider the problem of stabilization of a linear system, under state and control constraints, and subject to bounded disturbances and unknown parameters in the state matrix. First, using a simple least square solution and available…

Systems and Control · Electrical Eng. & Systems 2020-07-22 Edouard Leurent , Denis Efimov , Odalric-Ambrym Maillard

Making neural networks robust against adversarial inputs has resulted in an arms race between new defenses and attacks. The most promising defenses, adversarially robust training and verifiably robust training, have limitations that…

Machine Learning · Computer Science 2018-12-04 Shiqi Wang , Yizheng Chen , Ahmed Abdou , Suman Jana

Recent works have tried to increase the verifiability of adversarially trained networks by running the attacks over domains larger than the original perturbations and adding various regularization terms to the objective. However, these…

Machine Learning · Computer Science 2023-06-01 Alessandro De Palma , Rudy Bunel , Krishnamurthy Dvijotham , M. Pawan Kumar , Robert Stanforth

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Recent works have shown that interval bound propagation (IBP) can be used to train verifiably robust neural networks. Reseachers observe an intriguing phenomenon on these IBP trained networks: CROWN, a bounding method based on tight linear…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Zhaoyang Lyu , Minghao Guo , Tong Wu , Guodong Xu , Kehuan Zhang , Dahua Lin

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

In this paper, a robust optimization framework is developed to train shallow neural networks based on reachability analysis of neural networks. To characterize noises of input data, the input training data is disturbed in the description of…

Machine Learning · Computer Science 2021-07-28 Yejiang Yang , Weiming Xiang

The success of modern deep learning is attributed to two key elements: huge amounts of training data and large model sizes. Where a vast amount of data allows the model to learn more features, the large model architecture boosts the…

Machine Learning · Computer Science 2024-10-08 Muhammad Asif Khan , Ridha Hamila , Hamid Menouar

Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.…

Machine Learning · Computer Science 2021-11-03 Yujia Huang , Huan Zhang , Yuanyuan Shi , J Zico Kolter , Anima Anandkumar

In various scenarios motivated by real life, such as medical data analysis, autonomous driving, and adversarial training, we are interested in robust deep networks. A network is robust when a relatively small perturbation of the input…

Machine Learning · Computer Science 2024-10-07 Patryk Krukowski , Daniel Wilczak , Jacek Tabor , Anna Bielawska , Przemysław Spurek

Formal verification provides critical security assurances for neural networks, yet its practical application suffers from the long verification time. This work introduces a novel method for training verification-friendly neural networks,…

Machine Learning · Computer Science 2024-12-31 Zongxin Liu , Zhe Zhao , Fu Song , Jun Sun , Pengfei Yang , Xiaowei Huang , Lijun Zhang

We propose a principled framework that combines adversarial training and provable robustness verification for training certifiably robust neural networks. We formulate the training problem as a joint optimization problem with both empirical…

Machine Learning · Computer Science 2021-06-08 Jiameng Fan , Wenchao Li

We study the problem of training and certifying adversarially robust quantized neural networks (QNNs). Quantization is a technique for making neural networks more efficient by running them using low-bit integer arithmetic and is therefore…

Machine Learning · Computer Science 2022-11-30 Mathias Lechner , Đorđe Žikelić , Krishnendu Chatterjee , Thomas A. Henzinger , Daniela Rus

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

Machine Learning · Computer Science 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

Computation and Language · Computer Science 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

Interval Bound Propagation (IBP) is so far the base of state-of-the-art methods for training neural networks with certifiable robustness guarantees when potential adversarial perturbations present, while the convergence of IBP training…

Machine Learning · Computer Science 2022-03-18 Yihan Wang , Zhouxing Shi , Quanquan Gu , Cho-Jui Hsieh

Current neural-network-based classifiers are susceptible to adversarial examples. The most empirically successful approach to defending against such adversarial examples is adversarial training, which incorporates a strong self-attack…

Machine Learning · Computer Science 2020-06-08 Bai Li , Shiqi Wang , Suman Jana , Lawrence Carin

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama