English
Related papers

Related papers: How robust accuracy suffers from certified trainin…

200 papers

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Recently, there is an emerging interest in adversarially training a classifier with a rejection option (also known as a selective classifier) for boosting adversarial robustness. While rejection can incur a cost in many applications,…

Machine Learning · Computer Science 2023-05-15 Jiefeng Chen , Jayaram Raghuram , Jihye Choi , Xi Wu , Yingyu Liang , Somesh Jha

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

Certified defenses promise provable robustness guarantees. We study the malicious exploitation of probabilistic certification frameworks to better understand the limits of guarantee provisions. Now, the objective is to not only mislead a…

Machine Learning · Computer Science 2025-11-19 Quoc Viet Vo , Tashreque M. Haq , Paul Montague , Tamas Abraham , Ehsan Abbasnejad , Damith C. Ranasinghe

It has been demonstrated that deep neural networks are prone to noisy examples particular adversarial samples during inference process. The gap between robust deep learning systems in real world applications and vulnerable neural networks…

Machine Learning · Computer Science 2018-07-03 Xinhan Di , Pengqian Yu , Meng Tian

Achieving robustness against adversarial input perturbation is an important and intriguing problem in machine learning. In the area of semantic image segmentation, a number of adversarial training approaches have been proposed as a defense…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Levente Halmosi , Mark Jelasity

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Deep neural networks are easily misled by adversarial examples. Although lots of defense methods are proposed, many of them are demonstrated to lose effectiveness when against properly performed adaptive attacks. How to evaluate the…

Cryptography and Security · Computer Science 2021-01-08 Pengfei Xia , Ziqiang Li , Hongjing Niu , Bin Li

Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent…

Machine Learning · Computer Science 2020-10-07 Ryan Campbell , Chris Finlay , Adam M Oberman

Adversarial examples are carefully perturbed in-puts for fooling machine learning models. A well-acknowledged defense method against such examples is adversarial training, where adversarial examples are injected into training data to…

Machine Learning · Computer Science 2019-05-17 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

We identify a trade-off between robustness and accuracy that serves as a guiding principle in the design of defenses against adversarial examples. Although this problem has been widely studied empirically, much remains unknown concerning…

Machine Learning · Computer Science 2019-06-25 Hongyang Zhang , Yaodong Yu , Jiantao Jiao , Eric P. Xing , Laurent El Ghaoui , Michael I. Jordan

The current state-of-the-art defense methods against adversarial examples typically focus on improving either empirical or certified robustness. Among them, adversarially trained (AT) models produce empirical state-of-the-art defense…

Machine Learning · Computer Science 2022-08-02 Jay Nandy , Sudipan Saha , Wynne Hsu , Mong Li Lee , Xiao Xiang Zhu

Neural networks are vulnerable to adversarial examples and researchers have proposed many heuristic attack and defense mechanisms. We address this problem through the principled lens of distributionally robust optimization, which guarantees…

Machine Learning · Statistics 2020-05-04 Aman Sinha , Hongseok Namkoong , Riccardo Volpi , John Duchi

Adversarial training is an effective method to train deep learning models that are resilient to norm-bounded perturbations, with the cost of nominal performance drop. While adversarial training appears to enhance the robustness and safety…

Machine Learning · Computer Science 2021-03-16 Mathias Lechner , Ramin Hasani , Radu Grosu , Daniela Rus , Thomas A. Henzinger

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

Machine Learning · Computer Science 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Data used to train machine learning models can be adversarial--maliciously constructed by adversaries to fool the model. Challenge also arises by privacy, confidentiality, or due to legal constraints when data are geographically gathered…

Machine Learning · Computer Science 2020-07-09 Alireza Sadeghi , Gang Wang , Meng Ma , Georgios B. Giannakis

Correctly classifying adversarial examples is an essential but challenging requirement for safely deploying machine learning models. As reported in RobustBench, even the state-of-the-art adversarially trained models struggle to exceed 67%…

Machine Learning · Computer Science 2022-04-01 Tianyu Pang , Huishuai Zhang , Di He , Yinpeng Dong , Hang Su , Wei Chen , Jun Zhu , Tie-Yan Liu

Adversarial robustness of machine learning models is critical to ensuring reliable performance under data perturbations. Recent progress has been on point estimators, and this paper considers distributional predictors. First, using the link…

Machine Learning · Computer Science 2025-02-21 Mahalakshmi Sabanayagam , Russell Tsuchida , Cheng Soon Ong , Debarghya Ghoshdastidar