English
Related papers

Related papers: Hierarchical Randomized Smoothing

200 papers

Randomized smoothing has recently attracted attentions in the field of adversarial robustness to provide provable robustness guarantees on smoothed neural network classifiers. However, existing works show that vanilla randomized smoothing…

Machine Learning · Computer Science 2023-10-13 Linbo Liu , Trong Nghia Hoang , Lam M. Nguyen , Tsui-Wei Weng

With the proliferation of algorithmic decision-making, increased scrutiny has been placed on these systems. This paper explores the relationship between the quality of the training data and the overall fairness of the models trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Aki Barry , Lei Han , Gianluca Demartini

Scene recognition, particularly for aerial and underwater images, often suffers from various types of degradation, such as blurring or overexposure. Previous works that focus on convolutional neural networks have been shown to be able to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jianqi Zhang , Mengxuan Wang , Jingyao Wang , Lingyu Si , Changwen Zheng , Fanjiang Xu

Currently the most popular method of providing robustness certificates is randomized smoothing where an input is smoothed via some probability distribution. We propose a novel approach to randomized smoothing over multiplicative parameters.…

Machine Learning · Computer Science 2022-08-17 Nikita Muravev , Aleksandr Petiushko

As ML models are increasingly deployed in critical applications, robustness against adversarial perturbations is crucial. While numerous defenses have been proposed to counter such attacks, they typically assume that all adversarial…

Machine Learning · Computer Science 2025-06-11 Yuan Xin , Dingfan Chen , Michael Backes , Xiao Zhang

We propose Adaptive Diffusion Denoised Smoothing, a method for certifying the predictions of a vision model against adversarial examples, while adapting to the input. Our key insight is to reinterpret a guided denoising diffusion model as a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Frederick Shpilevskiy , Saiyue Lyu , Krishnamurthy Dj Dvijotham , Mathias Lécuyer , Pierre-André Noël

Regularization is an effective way to promote the generalization performance of machine learning models. In this paper, we focus on label smoothing, a form of output distribution regularization that prevents overfitting of a neural network…

Machine Learning · Computer Science 2020-07-07 Weizhi Li , Gautam Dasarathy , Visar Berisha

We present a new theoretical perspective of data noising in recurrent neural network language models (Xie et al., 2017). We show that each variant of data noising is an instance of Bayesian recurrent neural networks with a particular…

Computation and Language · Computer Science 2019-01-29 Lingpeng Kong , Gabor Melis , Wang Ling , Lei Yu , Dani Yogatama

Increasing production and exchange of multimedia content has increased the need for better protection of copyright by means of watermarking. Different methods have been proposed to satisfy the tradeoff between imperceptibility and…

Multimedia · Computer Science 2017-09-12 Majid Mohrekesh , Shekoofeh Azizi , Shahram Shirani , Nader Karimi , Shadrokh Samavi

There has been a surge in the number of large and flat data sets - data sets containing a large number of features and a relatively small number of observations - due to the growing ability to collect and store information in medical…

Machine Learning · Statistics 2017-07-05 Hongyang Zhang , Ruben H. Zamar

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily computed. In this…

Machine Learning · Computer Science 2020-12-16 Alexander Levine , Aounon Kumar , Thomas Goldstein , Soheil Feizi

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Randomized smoothing (RS) is a well known certified defense against adversarial attacks, which creates a smoothed classifier by predicting the most likely class under random noise perturbations of inputs during inference. While initial work…

Machine Learning · Computer Science 2023-04-21 Soumalya Nandi , Sravanti Addepalli , Harsh Rangwani , R. Venkatesh Babu

How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization, adversarial robustness, generative modeling and…

Machine Learning · Statistics 2021-07-08 Mihaela Rosca , Theophane Weber , Arthur Gretton , Shakir Mohamed

Neural ranking models have achieved remarkable progress and are now widely deployed in real-world applications such as Retrieval-Augmented Generation (RAG). However, like other neural architectures, they remain vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-12-30 Jiawei Liu , Zhuo Chen , Rui Zhu , Miaokun Chen , Yuyang Gong , Wei Lu , Xiaofeng Wang

Before entering the neural network, a token is generally converted to the corresponding one-hot representation, which is a discrete distribution of the vocabulary. Smoothed representation is the probability of candidate tokens obtained from…

Computation and Language · Computer Science 2022-03-01 Xing Wu , Chaochen Gao , Meng Lin , Liangjun Zang , Zhongyuan Wang , Songlin Hu

Probabilistic time series forecasting has played critical role in decision-making processes due to its capability to quantify uncertainties. Deep forecasting models, however, could be prone to input perturbations, and the notion of such…

Machine Learning · Computer Science 2022-02-25 TaeHo Yoon , Youngsuk Park , Ernest K. Ryu , Yuyang Wang

The operationalization of algorithmic fairness comes with several practical challenges, not the least of which is the availability or reliability of protected attributes in datasets. In real-world contexts, practical and legal impediments…

Machine Learning · Computer Science 2023-07-12 Avijit Ghosh , Pablo Kvitca , Christo Wilson

Despite the rapid growth in datasets for video activity, stable robust activity recognition with neural networks remains challenging. This is in large part due to the explosion of possible variation in video -- including lighting changes,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Yi Zhang , Xinyue Wei , Weichao Qiu , Zihao Xiao , Gregory D. Hager , Alan Yuille