English
Related papers

Related papers: Fast Certified Robust Training with Short Warmup

200 papers

Gradient regularization (GR), which aims to penalize the gradient norm atop the loss function, has shown promising results in training modern over-parameterized deep neural networks. However, can we trust this powerful technique? This paper…

Machine Learning · Computer Science 2024-06-17 Yang Zhao , Hao Zhang , Xiuyuan Hu

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

Certifiable robustness is a highly desirable property for adopting deep neural networks (DNNs) in safety-critical scenarios, but often demands tedious computations to establish. The main hurdle lies in the massive amount of non-linearity in…

Machine Learning · Computer Science 2022-06-17 Tianlong Chen , Huan Zhang , Zhenyu Zhang , Shiyu Chang , Sijia Liu , Pin-Yu Chen , Zhangyang Wang

Reinforcement Learning (RL) has achieved remarkable success in safety-critical areas, but it can be weakened by adversarial attacks. Recent studies have introduced "smoothed policies" in order to enhance its robustness. Yet, it is still…

Machine Learning · Computer Science 2023-12-13 Ronghui Mu , Leandro Soriano Marcolino , Tianle Zhang , Yanghao Zhang , Xiaowei Huang , Wenjie Ruan

This paper proposes a theoretical and computational framework for training and robustness verification of implicit neural networks based upon non-Euclidean contraction theory. The basic idea is to cast the robustness analysis of a neural…

Machine Learning · Computer Science 2022-08-09 Saber Jafarpour , Alexander Davydov , Matthew Abate , Francesco Bullo , Samuel Coogan

The existence of adversarial examples poses a real danger when deep neural networks are deployed in the real world. The go-to strategy to quantify this vulnerability is to evaluate the model against specific attack algorithms. This approach…

Machine Learning · Computer Science 2021-06-08 Kevin Roth

Robust classification methods predominantly concentrate on algorithms that address a specific threat model, resulting in ineffective defenses against other threat models. Real-world applications are exposed to this vulnerability, as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Tsachi Blau , Roy Ganz , Chaim Baskin , Michael Elad , Alex M. Bronstein

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

In this discussion paper, we survey recent research surrounding robustness of machine learning models. As learning algorithms become increasingly more popular in data-driven control systems, their robustness to data uncertainty must be…

Machine Learning · Computer Science 2022-09-28 Brendon G. Anderson , Tanmay Gautam , Somayeh Sojoudi

In many real-world deployments of machine learning systems, data arrive piecemeal. These learning scenarios may be passive, where data arrive incrementally due to structural properties of the problem (e.g., daily financial data) or active,…

Machine Learning · Computer Science 2021-01-01 Jordan T. Ash , Ryan P. Adams

The sim-to-real gap, which represents the disparity between training and testing environments, poses a significant challenge in reinforcement learning (RL). A promising approach to addressing this challenge is distributionally robust RL,…

Machine Learning · Computer Science 2024-11-05 Miao Lu , Han Zhong , Tong Zhang , Jose Blanchet

Uncertainty quantification is essential for the reliable deployment of machine learning models to high-stakes application domains. Uncertainty quantification is all the more challenging when training distribution and test distribution are…

Machine Learning · Computer Science 2022-06-07 Yaodong Yu , Stephen Bates , Yi Ma , Michael I. Jordan

Most existing works focus on improving robustness against adversarial attacks bounded by a single $l_p$ norm using adversarial training (AT). However, these AT models' multiple-norm robustness (union accuracy) is still low, which is crucial…

Machine Learning · Computer Science 2024-09-24 Enyi Jiang , Gagandeep Singh

Control barrier functions (CBFs) are a popular tool for safety certification of nonlinear dynamical control systems. Recently, CBFs represented as neural networks have shown great promise due to their expressiveness and applicability to a…

Machine Learning · Computer Science 2026-04-15 Nikolaus Vertovec , Frederik Baymler Mathiesen , Thom Badings , Luca Laurenti , Alessandro Abate

An emerging problem in trustworthy machine learning is to train models that produce robust interpretations for their predictions. We take a step towards solving this problem through the lens of axiomatic attribution of neural networks. Our…

Machine Learning · Computer Science 2019-10-29 Jiefeng Chen , Xi Wu , Vaibhav Rastogi , Yingyu Liang , Somesh Jha

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Penghao Jiang , Xin Ke , ZiFeng Wang , Chunxi Li

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

Due to their susceptibility to adversarial perturbations, neural networks (NNs) are hardly used in safety-critical applications. One measure of robustness to such perturbations in the input is the Lipschitz constant of the input-output map…

Machine Learning · Computer Science 2021-04-30 Patricia Pauli , Anne Koch , Julian Berberich , Paul Kohler , Frank Allgöwer