English
Related papers

Related papers: A Private and Computationally-Efficient Estimator …

200 papers

We propose an unbiased Monte-Carlo estimator for $\mathbb{E}[g(X_{t_1}, \cdots, X_{t_n})]$, where $X$ is a diffusion process defined by a multi-dimensional stochastic differential equation (SDE). The main idea is to start instead from a…

Probability · Mathematics 2016-03-08 Pierre Henry-Labordere , Xiaolu Tan , Nizar Touzi

Estimating mutual information (MI) from samples is a fundamental problem in statistics, machine learning, and data analysis. Recently it was shown that a popular class of non-parametric MI estimators perform very poorly for strongly…

Information Theory · Computer Science 2016-02-18 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

We study the problem of list-decodable Gaussian covariance estimation. Given a multiset $T$ of $n$ points in $\mathbb R^d$ such that an unknown $\alpha<1/2$ fraction of points in $T$ are i.i.d. samples from an unknown Gaussian…

Data Structures and Algorithms · Computer Science 2023-05-02 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia , Thanasis Pittas

Suppose that $X_1,X_2,\ldots$ are a stream of independent, identically distributed Poisson random variables with mean $\mu$. This work presents a new estimate $\mu_k$ for $\mu$ with the property that the distribution of the relative error…

Computation · Statistics 2016-06-01 Mark Huber

Computing multi-source partial information decomposition (PID) for continuous data is hard: existing closed-form Gaussian estimators are restricted to two source variables, while continuous arbitrary-source estimators are typically…

Information Theory · Computer Science 2026-05-12 Aobo Lyu , Andrew Clark , Netanel Raviv

We consider the problem of estimating the mean and covariance of a distribution from iid samples in $\mathbb{R}^n$, in the presence of an $\eta$ fraction of malicious noise; this is in contrast to much recent work where the noise itself is…

Data Structures and Algorithms · Computer Science 2016-08-16 Kevin A. Lai , Anup B. Rao , Santosh Vempala

The Gaussian mechanism is one differential privacy mechanism commonly used to protect numerical data. However, it may be ill-suited to some applications because it has unbounded support and thus can produce invalid numerical answers to…

Cryptography and Security · Computer Science 2022-12-01 Bo Chen , Matthew Hale

We present a new quantum algorithm for estimating the mean of a real-valued random variable obtained as the output of a quantum computation. Our estimator achieves a nearly-optimal quadratic speedup over the number of classical i.i.d.…

Quantum Physics · Physics 2021-11-16 Yassine Hamoudi

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

This paper addresses the challenging computational problem of estimating intractable expectations over discrete domains. Existing approaches, including Monte Carlo and Russian Roulette estimators, are consistent but often require a large…

Machine Learning · Statistics 2025-12-19 Sophia Seulkee Kang , François-Xavier Briol , Toni Karvonen , Zonghao Chen

We introduce general tools for designing efficient private estimation algorithms, in the high-dimensional settings, whose statistical guarantees almost match those of the best known non-private algorithms. To illustrate our techniques, we…

Data Structures and Algorithms · Computer Science 2023-11-17 Hongjie Chen , Vincent Cohen-Addad , Tommaso d'Orsi , Alessandro Epasto , Jacob Imola , David Steurer , Stefan Tiegel

We study the problem of estimating finite sample confidence intervals of the mean of a normal population under the constraint of differential privacy. We consider both the known and unknown variance cases and construct differentially…

Cryptography and Security · Computer Science 2017-11-13 Vishesh Karwa , Salil Vadhan

Common workflows in machine learning and statistics rely on the ability to partition the information in a data set into independent portions. Recent work has shown that this may be possible even when conventional sample splitting is not…

Methodology · Statistics 2025-12-16 Ameer Dharamshi , Anna Neufeld , Lucy L. Gao , Jacob Bien , Daniela Witten

We introduce a new method for estimating the mean of an outcome variable within groups when researchers only observe the average of the outcome and group indicators across a set of aggregation units, such as geographical areas. Existing…

Methodology · Statistics 2026-05-01 Cory McCartan , Shiro Kuriwaki

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

This work provides tight upper- and lower-bounds for the problem of mean estimation under $\epsilon$-differential privacy in the local model, when the input is composed of $n$ i.i.d. drawn samples from a normal distribution with variance…

Data Structures and Algorithms · Computer Science 2019-04-12 Marco Gaboardi , Ryan Rogers , Or Sheffet

Let $Y$ be a Gaussian vector whose components are independent with a common unknown variance. We consider the problem of estimating the mean $\mu$ of $Y$ by model selection. More precisely, we start with a collection…

Statistics Theory · Mathematics 2009-04-03 Yannick Baraud , Christophe Giraud , Sylvie Huet

We consider the problem of estimating the mean vector of a p-variate normal $(\theta,\Sigma)$ distribution under invariant quadratic loss, $(\delta-\theta)'\Sigma^{-1}(\delta-\theta)$, when the covariance is unknown. We propose a new class…

Statistics Theory · Mathematics 2013-02-28 Didier Chételat , Martin T. Wells

Bootstrap is a common tool for quantifying uncertainty in data analysis. However, besides additional computational costs in the application of the bootstrap on massive data, a challenging problem in bootstrap based inference under…

Machine Learning · Statistics 2025-05-05 Holger Dette , Carina Graw

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev