English
Related papers

Related papers: Effects of Exponential Gaussian Distribution on (D…

200 papers

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

In real-world regression tasks, datasets frequently exhibit imbalanced distributions, characterized by a scarcity of data in high-complexity regions and an abundance in low-complexity areas. This imbalance presents significant challenges…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Jiaxuan Yue , Tengjie Zheng , Lanxuan Wang , Lin Cheng

Randomized Smoothing (RS) is a promising technique for certified robustness, and recently in RS the ensemble of multiple Deep Neural Networks (DNNs) has shown state-of-the-art performances due to its variance reduction effect over Gaussian…

Machine Learning · Computer Science 2025-04-14 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Xiaolin Huang , Jie Yang

Strong theoretical guarantees of robustness can be given for ensembles of classifiers generated by input randomization. Specifically, an $\ell_2$ bounded adversary cannot alter the ensemble prediction generated by an additive isotropic…

Machine Learning · Computer Science 2020-02-28 Guang-He Lee , Yang Yuan , Shiyu Chang , Tommi S. Jaakkola

Gaussian smoothing (GS) is a derivative-free optimization (DFO) algorithm that estimates the gradient of an objective using perturbations of the current parameters sampled from a standard normal distribution. We generalize it to sampling…

Machine Learning · Computer Science 2022-11-29 Katelyn Gao , Ozan Sener

Randomized smoothing is a general technique for computing sample-dependent robustness guarantees against adversarial attacks for deep classifiers. Prior works on randomized smoothing against L_1 adversarial attacks use additive smoothing…

Machine Learning · Computer Science 2021-06-14 Alexander Levine , Soheil Feizi

Randomized smoothing (RS) has been shown to be a fast, scalable technique for certifying the robustness of deep neural network classifiers. However, methods based on RS require augmenting data with large amounts of noise, which leads to…

Machine Learning · Computer Science 2022-05-13 Ameya Joshi , Minh Pham , Minsu Cho , Leonid Boytsov , Filipe Condessa , J. Zico Kolter , Chinmay Hegde

Randomized smoothing is a recently proposed defense against adversarial attacks that has achieved SOTA provable robustness against $\ell_2$ perturbations. A number of publications have extended the guarantees to other metrics, such as…

Machine Learning · Computer Science 2020-10-15 Jeet Mohapatra , Ching-Yun Ko , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Randomized smoothing is a recent technique that achieves state-of-art performance in training certifiably robust deep neural networks. While the smoothing family of distributions is often connected to the choice of the norm used for…

Machine Learning · Computer Science 2022-07-06 Motasem Alfarra , Adel Bibi , Philip H. S. Torr , Bernard Ghanem

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

Randomized smoothing (RS) is an effective and scalable technique for constructing neural network classifiers that are certifiably robust to adversarial perturbations. Most RS works focus on training a good base model that boosts the…

Machine Learning · Computer Science 2021-09-20 Chen Chen , Kezhi Kong , Peihong Yu , Juan Luque , Tom Goldstein , Furong Huang

In this paper, we consider two distinct challenges in the resolution of nonsmooth stochastic optimization. Of these, the first pertains to the pronounced dependence of dimension in Gaussian smoothing-enabled zeroth-order schemes, impeding…

Optimization and Control · Mathematics 2026-04-20 Mingrui Wang , Prakash Chakraborty , Uday V. Shanbhag

Randomized classifiers have been shown to provide a promising approach for achieving certified robustness against adversarial attacks in deep learning. However, most existing methods only leverage Gaussian smoothing noise and only work for…

Machine Learning · Computer Science 2020-10-21 Dinghuai Zhang , Mao Ye , Chengyue Gong , Zhanxing Zhu , Qiang Liu

Advancements in 3D Gaussian Splatting have significantly accelerated 3D reconstruction and generation. However, it may require a large number of Gaussians, which creates a substantial memory footprint. This paper introduces GES (Generalized…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Abdullah Hamdi , Luke Melas-Kyriazi , Jinjie Mai , Guocheng Qian , Ruoshi Liu , Carl Vondrick , Bernard Ghanem , Andrea Vedaldi

Training neural networks with high certified accuracy against adversarial examples remains an open challenge despite significant efforts. While certification methods can effectively leverage tight convex relaxations for bound computation,…

Machine Learning · Computer Science 2025-07-16 Stefan Balauca , Mark Niklas Müller , Yuhao Mao , Maximilian Baader , Marc Fischer , Martin Vechev

Randomized Smoothing (RS) offers formal $\ell_2$ guarantees for arbitrary base classifiers but faces two key practical bottlenecks: (i) it often relies on noise-augmented training to achieve nontrivial certificates, which increases training…

Machine Learning · Computer Science 2026-04-29 Miao Lin , MD Saifur Rahman Mazumder , Feng Yu , Daniel Takabi , Rui Ning

Randomized Smoothing (RS) is considered the state-of-the-art approach to obtain certifiably robust models for challenging tasks. However, current RS approaches drastically decrease standard accuracy on unperturbed data, severely limiting…

Machine Learning · Computer Science 2022-04-04 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Randomized smoothing is a popular certified defense against adversarial attacks. In its essence, we need to solve a problem of statistical estimation which is usually very time-consuming since we need to perform numerous (usually $10^5$)…

Machine Learning · Statistics 2025-01-22 Vaclav Voracek

Deep Neural Network (DNN) based classifiers have recently been used for the modulation classification of RF signals. These classifiers have shown impressive performance gains relative to conventional methods, however, they are vulnerable to…

Machine Learning · Computer Science 2024-10-10 Wenhan Zhang , Meiyu Zhong , Ravi Tandon , Marwan Krunz