English
Related papers

Related papers: Rethinking Randomized Smoothing from the Perspecti…

200 papers

Randomness supports many critical functions in the field of machine learning (ML) including optimisation, data selection, privacy, and security. ML systems outsource the task of generating or harvesting randomness to the compiler, the cloud…

Machine Learning · Computer Science 2024-02-13 Pranav Dahiya , Ilia Shumailov , Ross Anderson

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbed input with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanbin Hong , Yuan Hong

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm. This "randomized smoothing" technique has been proposed…

Machine Learning · Computer Science 2019-06-18 Jeremy M Cohen , Elan Rosenfeld , J. Zico Kolter

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

Recently, few certified defense methods have been developed to provably guarantee the robustness of a text classifier to adversarial synonym substitutions. However, all existing certified defense methods assume that the defenders are…

Computation and Language · Computer Science 2021-07-27 Jiehang Zeng , Xiaoqing Zheng , Jianhan Xu , Linyang Li , Liping Yuan , Xuanjing Huang

While Automatic Speech Recognition has been shown to be vulnerable to adversarial attacks, defenses against these attacks are still lagging. Existing, naive defenses can be partially broken with an adaptive attack. In classification tasks,…

Computation and Language · Computer Science 2022-01-12 Raphael Olivier , Bhiksha Raj

Randomized smoothing is the current state-of-the-art defense with provable robustness against $\ell_2$ adversarial attacks. Many works have devised new randomized smoothing schemes for other metrics, such as $\ell_1$ or $\ell_\infty$;…

Machine Learning · Computer Science 2020-07-27 Greg Yang , Tony Duan , J. Edward Hu , Hadi Salman , Ilya Razenshteyn , Jerry Li

Randomized Smoothing (RS), being one of few provable defenses, has been showing great effectiveness and scalability in terms of defending against $\ell_2$-norm adversarial perturbations. However, the cost of MC sampling needed in RS for…

Machine Learning · Computer Science 2021-08-03 Huimin Zeng , Jiahao Su , Furong Huang

Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models…

Computation and Language · Computer Science 2024-04-19 Jiabao Ji , Bairu Hou , Zhen Zhang , Guanhua Zhang , Wenqi Fan , Qing Li , Yang Zhang , Gaowen Liu , Sijia Liu , Shiyu Chang

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

Machine Learning · Computer Science 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

Watermarking is a commonly used strategy to protect creators' rights to digital images, videos and audio. Recently, watermarking methods have been extended to deep learning models -- in principle, the watermark should be preserved when an…

Deep Learning has been shown to be particularly vulnerable to adversarial samples. To combat adversarial strategies, numerous defensive techniques have been proposed. Among these, a promising approach is to use randomness in order to make…

Cryptography and Security · Computer Science 2020-03-18 Kumar Sharad , Giorgia Azzurra Marson , Hien Thi Thu Truong , Ghassan Karame

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Machine learning-based static malware detectors remain vulnerable to adversarial evasion techniques, such as metamorphic engine mutations. To address this vulnerability, we propose a certifiably robust malware detection framework based on…

Cryptography and Security · Computer Science 2026-04-23 Nandakrishna Giri , Asmitha K. A. , Serena Nicolazzo , Antonino Nocera , Vinod P

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Randomized smoothing has recently attracted attentions in the field of adversarial robustness to provide provable robustness guarantees on smoothed neural network classifiers. However, existing works show that vanilla randomized smoothing…

Machine Learning · Computer Science 2023-10-13 Linbo Liu , Trong Nghia Hoang , Lam M. Nguyen , Tsui-Wei Weng