English
Related papers

Related papers: It's Simplex! Disaggregating Measures to Improve C…

200 papers

Certified defenses against adversarial attacks offer formal guarantees on the robustness of a model, making them more reliable than empirical methods such as adversarial training, whose effectiveness is often later reduced by unseen…

Machine Learning · Computer Science 2023-05-18 Thomas Altstidl , David Dobre , Björn Eskofier , Gauthier Gidel , Leo Schwinn

In guaranteeing the absence of adversarial examples in an instance's neighbourhood, certification mechanisms play an important role in demonstrating neural net robustness. In this paper, we ask if these certifications can compromise the…

Machine Learning · Computer Science 2024-06-13 Andrew C. Cullen , Shijie Liu , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

Certified defenses against small-norm adversarial examples have received growing attention in recent years; though certified accuracies of state-of-the-art methods remain far below their non-robust counterparts, despite the fact that…

Machine Learning · Computer Science 2023-01-24 Klas Leino

In this paper we criticize the robustness measure traditionally employed to assess the performance of machine learning models deployed in adversarial settings. To mitigate the limitations of robustness, we introduce a new measure called…

Machine Learning · Computer Science 2021-12-07 Stefano Calzavara , Lorenzo Cazzaro , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Certified defenses promise provable robustness guarantees. We study the malicious exploitation of probabilistic certification frameworks to better understand the limits of guarantee provisions. Now, the objective is to not only mislead a…

Machine Learning · Computer Science 2025-11-19 Quoc Viet Vo , Tashreque M. Haq , Paul Montague , Tamas Abraham , Ehsan Abbasnejad , Damith C. Ranasinghe

In response to subtle adversarial examples flipping classifications of neural network models, recent research has promoted certified robustness as a solution. There, invariance of predictions to all norm-bounded attacks is achieved through…

Machine Learning · Computer Science 2022-10-13 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

Poisoning attacks can disproportionately influence model behaviour by making small changes to the training corpus. While defences against specific poisoning attacks do exist, they in general do not provide any guarantees, leaving them…

Machine Learning · Computer Science 2024-03-19 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

While certified robustness is widely promoted as a solution to adversarial examples in Artificial Intelligence systems, significant challenges remain before these techniques can be meaningfully deployed in real-world applications. We…

Cryptography and Security · Computer Science 2025-08-12 Andrew C. Cullen , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

While neural networks have achieved high performance in different learning tasks, their accuracy drops significantly in the presence of small adversarial perturbations to inputs. Defenses based on regularization and adversarial training are…

Machine Learning · Computer Science 2019-02-07 Sahil Singla , Soheil Feizi

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent…

Machine Learning · Computer Science 2020-10-07 Ryan Campbell , Chris Finlay , Adam M Oberman

Adversarial examples pose a security risk as they can alter decisions of a machine learning classifier through slight input perturbations. Certified robustness has been proposed as a mitigation where given an input $\mathbf{x}$, a…

Cryptography and Security · Computer Science 2024-09-10 Jiankai Jin , Olga Ohrimenko , Benjamin I. P. Rubinstein

Despite the vast success of Deep Neural Networks in numerous application domains, it has been shown that such models are not robust i.e., they are vulnerable to small adversarial perturbations of the input. While extensive work has been…

Machine Learning · Computer Science 2020-02-24 Sharon Qian , Dimitris Kalimeris , Gal Kaplun , Yaron Singer

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

Machine Learning · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

Model attribution is a popular tool to explain the rationales behind model predictions. However, recent work suggests that the attributions are vulnerable to minute perturbations, which can be added to input samples to fool the attributions…

Machine Learning · Computer Science 2024-05-13 Fan Wang , Adams Wai-Kin Kong
‹ Prev 1 2 3 10 Next ›