English
Related papers

Related papers: Certifying Confidence via Randomized Smoothing

200 papers

One strategy for adversarially training a robust model is to maximize its certified radius -- the neighborhood around a given training sample for which the model's prediction remains unchanged. The scheme typically involves analyzing a…

Machine Learning · Computer Science 2021-04-14 Xingjian Zhen , Rudrasis Chakraborty , Vikas Singh

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbed input with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanbin Hong , Yuan Hong

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

Deep neural networks have proven to be extremely powerful, however, they are also vulnerable to adversarial attacks which can cause hazardous incorrect predictions in safety-critical applications. Certified robustness via randomized…

Machine Learning · Computer Science 2024-10-29 Sina Däubener , Kira Maag , David Krueger , Asja Fischer

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Randomized Smoothing (RS) is a promising method for obtaining robustness certificates by evaluating a base model under noise. In this work, we: (i) theoretically motivate why ensembles are a particularly suitable choice as base models for…

Machine Learning · Computer Science 2022-03-31 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Randomized smoothing (RS) is popular for providing certified robustness guarantees against adversarial attacks. The average certified radius (ACR) has emerged as a widely used metric for tracking progress in RS. However, in this work, for…

Machine Learning · Computer Science 2025-06-06 Chenhao Sun , Yuhao Mao , Mark Niklas Müller , Martin Vechev

Currently the most popular method of providing robustness certificates is randomized smoothing where an input is smoothed via some probability distribution. We propose a novel approach to randomized smoothing over multiplicative parameters.…

Machine Learning · Computer Science 2022-08-17 Nikita Muravev , Aleksandr Petiushko

Randomized smoothing is currently considered the state-of-the-art method to obtain certifiably robust classifiers. Despite its remarkable performance, the method is associated with various serious problems such as "certified accuracy…

Machine Learning · Computer Science 2024-03-11 Peter Súkeník , Aleksei Kuvshinov , Stephan Günnemann

Within the PAC-Bayesian framework, the Gibbs classifier (defined on a posterior $Q$) and the corresponding $Q$-weighted majority vote classifier are commonly used to analyze the generalization performance. However, there exists a notable…

Machine Learning · Computer Science 2025-10-01 Gaojie Jin , Xinping Yi , Xiaowei Huang

Machine learning models have demonstrated remarkable success across diverse domains but remain vulnerable to adversarial attacks. Empirical defense mechanisms often fail, as new attacks constantly emerge, rendering existing defenses…

Machine Learning · Computer Science 2024-10-25 Anupriya Kumari , Devansh Bhardwaj , Sukrit Jindal

Randomized smoothing has become a leading approach for certifying adversarial robustness in machine learning models. However, a persistent gap remains between theoretical certified robustness and empirical robustness accuracy. This paper…

Machine Learning · Computer Science 2025-04-10 Blaise Delattre , Paul Caillon , Quentin Barthélemy , Erwan Fagnou , Alexandre Allauzen

Neural networks (NNs) are known to be vulnerable against adversarial perturbations, and thus there is a line of work aiming to provide robustness certification for NNs, such as randomized smoothing, which samples smoothing noises from a…

Machine Learning · Computer Science 2023-02-01 Linyi Li , Jiawei Zhang , Tao Xie , Bo Li

Despite the great success of state-of-the-art deep neural networks, several studies have reported models to be over-confident in predictions, indicating miscalibration. Label Smoothing has been proposed as a solution to the over-confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

Federated learning is an emerging data-private distributed learning framework, which, however, is vulnerable to adversarial attacks. Although several heuristic defenses are proposed to enhance the robustness of federated learning, they do…

Machine Learning · Computer Science 2024-03-05 Cheng Chen , Bhavya Kailkhura , Ryan Goldhahn , Yi Zhou

This paper presents preliminary work on a novel connection between certified robustness in machine learning and the modeling of 3D objects. We highlight an intriguing link between the Maximal Certified Radius (MCR) of a classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Gabriel Pérez S , Juan C. Pérez , Motasem Alfarra , Jesús Zarzar , Sara Rojas , Bernard Ghanem , Pablo Arbeláez