English
Related papers

Related papers: A Fast Algorithm for Adaptive Private Mean Estimat…

200 papers

We propose a new, computationally efficient, sparsity adaptive changepoint estimator for detecting changes in unknown subsets of a high-dimensional data sequence. Assuming the data sequence is Gaussian, we prove that the new method…

Methodology · Statistics 2023-11-27 Per August Jarval Moen , Ingrid Kristine Glad , Martin Tveten

In the recent years, various gradient descent algorithms including the methods of gradient descent, gradient descent with momentum, adaptive gradient (AdaGrad), root-mean-square propagation (RMSProp) and adaptive moment estimation (Adam)…

Machine Learning · Computer Science 2024-09-19 Abel C. H. Chen

We introduce a new family of MCMC samplers that combine auxiliary variables, Gibbs sampling and Taylor expansions of the target density. Our approach permits the marginalisation over the auxiliary variables yielding marginal samplers, or…

Machine Learning · Statistics 2018-01-26 Michalis K. Titsias , Omiros Papaspiliopoulos

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We study the canonical statistical estimation problem of linear regression from $n$ i.i.d.~examples under $(\varepsilon,\delta)$-differential privacy when some response variables are adversarially corrupted. We propose a variant of the…

Machine Learning · Computer Science 2023-02-01 Xiyang Liu , Prateek Jain , Weihao Kong , Sewoong Oh , Arun Sai Suggala

Adaptive sampling algorithms are modern and efficient methods that dynamically adjust the sample size throughout the optimization process. However, they may encounter difficulties in risk-averse settings, particularly due to the challenge…

Optimization and Control · Mathematics 2025-02-17 Sandra Pieraccini , Tommaso Vanzan

This work is concerned with the derivation of a robust a posteriori error estimator for a discontinuous Galerkin method discretisation of linear non-stationary convection-diffusion initial/boundary value problems and with the implementation…

Numerical Analysis · Mathematics 2012-11-16 Andrea Cangiani , Emmanuil H. Georgoulis , Stephen Metcalfe

The consideration of predictive uncertainty in medical imaging with deep learning is of utmost importance. We apply estimation of both aleatoric and epistemic uncertainty by variational Bayesian inference with Monte Carlo dropout to…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Max-Heinrich Laves , Sontje Ihler , Jacob F. Fast , Lüder A. Kahrs , Tobias Ortmaier

We adapt a previously introduced continuous in time data assimilation (downscaling) algorithm for the 2D Navier-Stokes equations to the more realistic case when the measurements are obtained discretely in time and may be contaminated by…

Analysis of PDEs · Mathematics 2016-05-24 Ciprian Foias , Cecilia F. Mondaini , Edriss S. Titi

We initiate a systematic study of algorithms that are both differentially private and run in sublinear time for several problems in which the goal is to estimate natural graph parameters. Our main result is a differentially-private…

Data Structures and Algorithms · Computer Science 2022-03-15 Jeremiah Blocki , Elena Grigorescu , Tamalika Mukherjee

We consider the problem of performing linear regression over a stream of $d$-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without…

Machine Learning · Computer Science 2020-10-13 Vatsal Sharan , Aaron Sidford , Gregory Valiant

We consider adaptive estimation and statistical inference for high-dimensional graph-based linear models. In our model, the coordinates of regression coefficients correspond to an underlying undirected graph. Furthermore, the given graph…

Statistics Theory · Mathematics 2020-01-30 Duzhe Wang , Po-Ling Loh

In this paper, a distributed stochastic approximation algorithm is studied. Applications of such algorithms include decentralized estimation, optimization, control or computing. The algorithm consists in two steps: a local step, where each…

Optimization and Control · Mathematics 2013-12-03 Pascal Bianchi , Gersende Fort , Walid Hachem

Various differentially private algorithms instantiate the exponential mechanism, and require sampling from the distribution $\exp(-f)$ for a suitable function $f$. When the domain of the distribution is high-dimensional, this sampling can…

Machine Learning · Computer Science 2020-12-18 Arun Ganesh , Kunal Talwar

In this work, we first consider distributed convex constrained optimization problems where the objective function is encoded by multiple local and possibly nonsmooth objectives privately held by a group of agents, and propose a distributed…

Optimization and Control · Mathematics 2020-02-20 Changxin Liu , Huiping Li , Yang Shi

We study differentially private mean estimation in a high-dimensional setting. Existing differential privacy techniques applied to large dimensions lead to computationally intractable problems or estimators with excessive privacy loss.…

Machine Learning · Computer Science 2020-07-23 Aditya Dhar , Jason Huang

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

The authors consider the problem of estimating the density $g$ of independent and identically distributed variables $X\_i$, from a sample $Z\_1, ..., Z\_n$ where $Z\_i=X\_i+\sigma\epsilon\_i$, $i=1, ..., n$, $\epsilon$ is a noise…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Yves Rozenholc , Marie-Luce Taupin

Existing algorithms for subgroup discovery with numerical targets do not optimize the error or target variable dispersion of the groups they find. This often leads to unreliable or inconsistent statements about the data, rendering practical…

Artificial Intelligence · Computer Science 2017-07-06 Mario Boley , Bryan R. Goldsmith , Luca M. Ghiringhelli , Jilles Vreeken

We consider the Random Walk Metropolis algorithm on $\mathbb{R}^n$ with Gaussian proposals, and when the target probability measure is the $n$-fold product of a one-dimensional law. It is well known (see Roberts et al. (Ann. Appl. Probab. 7…

Methodology · Statistics 2014-10-22 Benjamin Jourdain , Tony Lelièvre , Błażej Miasojedow