English
Related papers

Related papers: Double Sampling Randomized Smoothing

200 papers

Deep Neural Networks are vulnerable to small perturbations that can drastically alter their predictions for perceptually unchanged inputs. The literature on adversarially robust Deep Learning attempts to either enhance the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Thomas Massena , Corentin Friedrich , Franck Mamalet , Mathieu Serrurier

Smoothing and filtering two-dimensional sequences are fundamental tasks in fields such as computer vision. Conventional filtering algorithms often rely on the selection of the filtering window, limiting their applicability in certain…

Information Theory · Computer Science 2025-07-22 Xufeng Chen , Liang Yan , Xiaoshan Gao

Randomized Smoothing (RS) is considered the state-of-the-art approach to obtain certifiably robust models for challenging tasks. However, current RS approaches drastically decrease standard accuracy on unperturbed data, severely limiting…

Machine Learning · Computer Science 2022-04-04 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

In this study, we propose a method Distributionally Robust Safe Screening (DRSS), for identifying unnecessary samples and features within a DR covariate shift setting. This method effectively combines DR learning, a paradigm aimed at…

Certified defense using randomized smoothing is a popular technique to provide robustness guarantees for deep neural networks against l2 adversarial attacks. Existing works use this technique to provably secure a pretrained non-robust model…

Machine Learning · Computer Science 2022-10-18 Gaurav Kumar Nayak , Ruchit Rawal , Anirban Chakraborty

Certifying the robustness of a graph-based machine learning model poses a critical challenge for safety. Current robustness certificates for graph classifiers guarantee output invariance with respect to the total number of node pair flips…

Machine Learning · Computer Science 2023-06-27 Pierre Osselin , Henry Kenlay , Xiaowen Dong

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

Recent advances in machine learning (ML) algorithms, especially deep neural networks (DNNs), have demonstrated remarkable success (sometimes exceeding human-level performance) on several tasks, including face and speech recognition.…

Machine Learning · Computer Science 2020-03-04 Yue Gao , Harrison Rosenberg , Kassem Fawaz , Somesh Jha , Justin Hsu

This work investigates the optimization instability of deep neural networks from a less-explored yet insightful perspective: the emergence and amplification of singularities in the parametric space. Our analysis reveals that parametric…

Randomized smoothing is a well-established method for achieving certified robustness against l2-adversarial perturbations. By incorporating a denoiser before the base classifier, pretrained classifiers can be seamlessly integrated into…

Machine Learning · Computer Science 2025-09-16 Ali Hedayatnia , Mostafa Tavassolipour , Babak Nadjar Araabi , Abdol-Hossein Vahabie

Learning with Reproducing Kernel Hilbert Spaces (RKHS) has been widely used in many scientific disciplines. Because a RKHS can be very flexible, it is common to impose a regularization term in the optimization to prevent overfitting.…

Methodology · Statistics 2017-06-06 Jingxiang Chen , Chong Zhang , Michael R. Kosorok , Yufeng Liu

The current learning process of deep learning, regardless of any deep neural network (DNN) architecture and/or learning algorithm used, is essentially a single resolution training. We explore multiresolution learning and show that…

Machine Learning · Computer Science 2023-09-29 Hongyan Zhou , Yao Liang

Corrupting the input and hidden layers of deep neural networks (DNNs) with multiplicative noise, often drawn from the Bernoulli distribution (or 'dropout'), provides regularization that has significantly contributed to deep learning's…

Machine Learning · Statistics 2015-06-11 Eric Nalisnick , Anima Anandkumar , Padhraic Smyth

Randomized smoothing has achieved state-of-the-art certified robustness against $l_2$-norm adversarial attacks. However, it is not wholly resolved on how to find the optimal base classifier for randomized smoothing. In this work, we employ…

Machine Learning · Computer Science 2021-02-24 Chizhou Liu , Yunzhen Feng , Ranran Wang , Bin Dong

In this paper, the robustness and accuracy of the deep neural network (DNN) was enhanced by introducing the $L_{2,\infty}$ normalization of the weight matrices of the DNN with Relu as the activation function. It is proved that the…

Machine Learning · Statistics 2020-10-13 Lijia Yu , Xiao-Shan Gao

We study anomaly detection in images under a fixed-camera environment and propose a \emph{doubly smoothed} (DS) density estimator that exploits spatial structure to improve estimation accuracy. The DS estimator applies kernel smoothing…

Applications · Statistics 2025-10-28 Qianhan Zeng , Miao Han , Ke Xu , Feifei Wang , Hansheng Wang

Geometric image transformations that arise in the real world, such as scaling and rotation, have been shown to easily deceive deep neural networks (DNNs). Hence, training DNNs to be certifiably robust to these perturbations is critical.…

Machine Learning · Computer Science 2023-05-09 Rem Yang , Jacob Laurel , Sasa Misailovic , Gagandeep Singh

Soft random sampling (SRS) is a simple yet effective approach for efficient training of large-scale deep neural networks when dealing with massive data. SRS selects a subset uniformly at random with replacement from the full data set in…

Machine Learning · Computer Science 2023-11-27 Xiaodong Cui , Ashish Mittal , Songtao Lu , Wei Zhang , George Saon , Brian Kingsbury

As deep neural networks (DNNs) are becoming the prominent solution for many computational problems, the aviation industry seeks to explore their potential in alleviating pilot workload and in improving operational safety. However, the use…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Yizhak Elboher , Raya Elsaleh , Omri Isac , Mélanie Ducoffe , Audrey Galametz , Guillaume Povéda , Ryma Boumazouza , Noémie Cohen , Guy Katz