English
Related papers

Related papers: Accelerated Smoothing: A Scalable Approach to Rand…

200 papers

We consider the problem of adaptive stratified sampling for Monte Carlo integration of a noisy function, given a finite budget n of noisy evaluations to the function. We tackle in this paper the problem of adapting to the function at the…

Machine Learning · Statistics 2013-03-13 Alexandra Carpentier , Remi Munos

Randomized smoothing is currently considered the state-of-the-art method to obtain certifiably robust classifiers. Despite its remarkable performance, the method is associated with various serious problems such as "certified accuracy…

Machine Learning · Computer Science 2024-03-11 Peter Súkeník , Aleksei Kuvshinov , Stephan Günnemann

As a certified defensive technique, randomized smoothing has received considerable attention due to its scalability to large datasets and neural networks. However, several important questions remain unanswered, such as (i) whether the…

Machine Learning · Computer Science 2020-06-09 Tianhang Zheng , Di Wang , Baochun Li , Jinhui Xu

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

To improve the off-sample generalization of classical procedures minimizing the empirical risk under potentially heavy-tailed data, new robust learning algorithms have been proposed in recent years, with generalized median-of-means…

Machine Learning · Statistics 2018-10-16 Matthew J. Holland

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

We present approximate algorithms for performing smoothing in a class of high-dimensional state-space models via sequential Monte Carlo methods ("particle filters"). In high dimensions, a prohibitively large number of Monte Carlo samples…

Computation · Statistics 2017-09-21 Axel Finke , Sumeetpal S. Singh

Various kinetic Monte Carlo algorithms become inefficient when some of the population sizes in a system are large, which gives rise to a large number of reaction events per unit time. Here, we present a new acceleration algorithm based on…

Quantitative Methods · Quantitative Biology 2019-07-24 Yen Ting Lin , Song Feng , William S. Hlavacek

Medical vision-language models (Med-VLMs) trained on large datasets of medical image-text pairs and later fine-tuned for specific tasks have emerged as a mainstream paradigm in medical image analysis. However, recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Noor Hussein , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

We study certified robustness of machine learning classifiers against adversarial perturbations. In particular, we propose the first universally approximated certified robustness (UniCR) framework, which can approximate the robustness…

Machine Learning · Computer Science 2022-07-12 Hanbin Hong , Binghui Wang , Yuan Hong

Large-scale pre-trained language models have shown outstanding performance in a variety of NLP tasks. However, they are also known to be significantly brittle against specifically crafted adversarial examples, leading to increasing interest…

Computation and Language · Computer Science 2023-05-12 Han Cheol Moon , Shafiq Joty , Ruochen Zhao , Megh Thakkar , Xu Chi

Deep learning-based malware detectors have been shown to be susceptible to adversarial malware examples, i.e. malware examples that have been deliberately manipulated in order to avoid detection. In light of the vulnerability of deep…

Cryptography and Security · Computer Science 2024-04-30 Daniel Gibert , Giulio Zizzo , Quan Le , Jordi Planes

Recently, techniques have been developed to provably guarantee the robustness of a classifier to adversarial perturbations of bounded L_1 and L_2 magnitudes by using randomized smoothing: the robust classification is a consensus of base…

Machine Learning · Computer Science 2019-11-22 Alexander Levine , Soheil Feizi

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

Machine Learning · Computer Science 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

We consider systems of stochastic differential equations with multiple scales and small noise and assume that the coefficients of the equations are ergodic and stationary random fields. Our goal is to construct provably-efficient importance…

Probability · Mathematics 2015-09-29 Konstantinos Spiliopoulos

Randomized smoothing is a leading approach for constructing classifiers that are certifiably robust against adversarial examples. Existing work on randomized smoothing has focused on classifiers with continuous inputs, such as images, where…

Cryptography and Security · Computer Science 2024-01-26 Zhuoqun Huang , Neil G. Marchant , Keane Lucas , Lujo Bauer , Olga Ohrimenko , Benjamin I. P. Rubinstein

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

Randomized smoothing is one of the most promising frameworks for certifying the adversarial robustness of machine learning models, including Graph Neural Networks (GNNs). Yet, existing randomized smoothing certificates for GNNs are overly…

Machine Learning · Computer Science 2024-11-12 Yan Scholten , Jan Schuchardt , Simon Geisler , Aleksandar Bojchevski , Stephan Günnemann

The approximation of a high-dimensional vector by a small combination of column vectors selected from a fixed matrix has been actively debated in several different disciplines. In this paper, a sampling approach based on the Monte Carlo…

Information Theory · Computer Science 2016-10-05 Tomoyuki Obuchi , Yoshiyuki Kabashima

Quantized neural networks (NN) are the common standard to efficiently deploy deep learning models on tiny hardware platforms. However, we notice that quantized NNs are as vulnerable to adversarial attacks as the full-precision models. With…

Machine Learning · Computer Science 2021-05-17 Lorena Qendro , Sangwon Ha , René de Jong , Partha Maji