中文
相关论文

相关论文: Is Certifying $\ell_p$ Robustness Still Worthwhile…

200 篇论文

Randomized smoothing is considered to be the state-of-the-art provable defense against adversarial perturbations. However, it heavily exploits the fact that classifiers map input objects to class probabilities and do not focus on the ones…

机器学习 · 计算机科学 2023-06-06 Mikhail Pautov , Olesya Kuznetsova , Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

Robustness is a fundamental property of machine learning classifiers required to achieve safety and reliability. In the field of adversarial robustness of image classifiers, robustness is commonly defined as the stability of a model to all…

机器学习 · 计算机科学 2024-05-28 Georg Siedel , Weijia Shao , Silvia Vock , Andrey Morozov

From past couple of years there is a cycle of researchers proposing a defence model for adversaries in machine learning which is arguably defensible to most of the existing attacks in restricted condition (they evaluate on some bounded…

密码学与安全 · 计算机科学 2022-02-21 Kanak Tekwani , Manojkumar Parmar

Top-k predictions are used in many real-world applications such as machine learning as a service, recommender systems, and web searches. $\ell_0$-norm adversarial perturbation characterizes an attack that arbitrarily modifies some features…

密码学与安全 · 计算机科学 2022-06-07 Jinyuan Jia , Binghui Wang , Xiaoyu Cao , Hongbin Liu , Neil Zhenqiang Gong

Recent work have demonstrated that robustness (to "corruption") can be at odds with generalization. Adversarial training, for instance, aims to reduce the problematic susceptibility of modern neural networks to small data perturbations.…

机器学习 · 统计学 2023-05-19 Amine Bennouna , Ryan Lucas , Bart Van Parys

The bulk of existing research in defending against adversarial examples focuses on defending against a single (typically bounded Lp-norm) attack, but for a practical setting, machine learning (ML) models should be robust to a wide variety…

机器学习 · 计算机科学 2023-07-21 Sihui Dai , Saeed Mahloujifar , Chong Xiang , Vikash Sehwag , Pin-Yu Chen , Prateek Mittal

In recent years several adversarial attacks and defenses have been proposed. Often seemingly robust models turn out to be non-robust when more sophisticated attacks are used. One way out of this dilemma are provable robustness guarantees.…

机器学习 · 计算机科学 2020-04-27 Francesco Croce , Matthias Hein

We study the design of computationally efficient algorithms with provable guarantees, that are robust to adversarial (test time) perturbations. While there has been an proliferation of recent work on this topic due to its connections to…

机器学习 · 计算机科学 2019-11-13 Pranjal Awasthi , Abhratanu Dutta , Aravindan Vijayaraghavan

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

机器学习 · 计算机科学 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

We study the robustness of classifiers to various kinds of random noise models. In particular, we consider noise drawn uniformly from the $\ell\_p$ ball for $p \in [1, \infty]$ and Gaussian noise with an arbitrary covariance matrix. We…

机器学习 · 计算机科学 2018-06-25 Jean-Yves Franceschi , Alhussein Fawzi , Omar Fawzi

Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for…

机器学习 · 计算机科学 2026-05-26 Konstantinos Emmanouilidis , Tianjiao Ding , Nghia Nguyen , Nicolas Loizou , René Vidal

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

机器学习 · 计算机科学 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Machine-learning models are known to be vulnerable to evasion attacks that perturb model inputs to induce misclassifications. In this work, we identify real-world scenarios where the true threat cannot be assessed accurately by existing…

机器学习 · 计算机科学 2024-03-12 Weiran Lin , Keane Lucas , Neo Eyal , Lujo Bauer , Michael K. Reiter , Mahmood Sharif

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

机器学习 · 计算机科学 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

机器学习 · 计算机科学 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

机器学习 · 计算机科学 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

We extend randomized smoothing to cover parameterized transformations (e.g., rotations, translations) and certify robustness in the parameter space (e.g., rotation angle). This is particularly challenging as interpolation and rounding…

机器学习 · 计算机科学 2021-08-26 Marc Fischer , Maximilian Baader , Martin Vechev

Existing certified training methods can only train models to be robust against a certain perturbation type (e.g. $l_\infty$ or $l_2$). However, an $l_\infty$ certifiably robust model may not be certifiably robust against $l_2$ perturbation…

机器学习 · 计算机科学 2026-04-15 Enyi Jiang , David S. Cheung , Gagandeep Singh