English
Related papers

Related papers: Estimation Error: Distribution and Pointwise Limit…

200 papers

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

Estimation frameworks for statistical inference are preferred to hypothesis testing when quantifying uncertainty and precise estimation are more valuable than binary decisions about statistical significance. Study design for…

Methodology · Statistics 2025-10-29 Luke Hagar , Nathaniel T. Stevens

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

We consider the problem of estimating the density $g$ of identically distributed variables $X\_i$, from a sample $Z\_1, ..., Z\_n$ where $Z\_i=X\_i+\sigma\epsilon\_i$, $i=1, ..., n$ and $\sigma \epsilon\_i$ is a noise independent of $X\_i$…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Yves Rozenholc , Marie-Luce Taupin

This paper deals with the nonparametric estimation in heteroscedastic regression $ Y_i=f(X_i)+\xi_i, \: i=1,...,n $, with incomplete information, i.e. each real random variable $ \xi_i $ has a density $ g_{i} $ which is unknown to the…

Statistics Theory · Mathematics 2011-05-10 Michaël Chichignoud

Distributed minimax estimation and distributed adaptive estimation under communication constraints for Gaussian sequence model and white noise model are studied. The minimax rate of convergence for distributed estimation over a given Besov…

Statistics Theory · Mathematics 2021-07-02 T. Tony Cai , Hongji Wei

We consider a channel $Y=X+N$ where $X$ is a random variable satisfying $\mathbb{E}[|X|]<\infty$ and $N$ is an independent standard normal random variable. We show that the minimum mean-square error estimator of $X$ from $Y,$ which is given…

Information Theory · Computer Science 2021-02-12 Wael Alghamdi , Flavio P. Calmon

We consider the problem of consistently estimating the conditional distribution $P(Y \in A |X)$ of a functional data object $Y=(Y(t): t\in[0,1])$ given covariates $X$ in a general space, assuming that $Y$ and $X$ are related by a functional…

Statistics Theory · Mathematics 2021-05-05 Siegfried Hörmann , Thomas Kuenzer , Gregory Rice

The Hoover index is a widely used measure of inequality with an intuitive interpretation, yet little is known about the finite-sample properties of its empirical estimator. In this paper, we derive a simple expression for the expected value…

Methodology · Statistics 2026-03-03 Roberto Vila , Helton Saulo

It is well known that, under standard regularity conditions, the maximum likelihood estimator (MLE) satisfies a central limit theorem and converges in distribution to a Gaussian random variable as the sample size grows. This paper…

Information Theory · Computer Science 2026-05-26 Leighton P. Barnes , Alex Dytso

This paper studies the concentration properties of random codes. Specifically, we show that, for discrete memoryless channels, the error exponent of a randomly generated code with pairwise-independent codewords converges in probability to…

Information Theory · Computer Science 2022-03-16 Lan V. Truong , Giuseppe Cocco , Josep Font-Segura , Albert Guillén i Fàbregas

Expectation Propagation is a very popular algorithm for variational inference, but comes with few theoretical guarantees. In this article, we prove that the approximation errors made by EP can be bounded. Our bounds have an asymptotic…

Computation · Statistics 2016-01-12 Guillaume P Dehaene , Simon Barthelmé

We analyze the problem of estimating a signal from multiple measurements on a $\mbox{group action channel}$ that linearly transforms a signal by a random group action followed by a fixed projection and additive Gaussian noise. This channel…

Information Theory · Computer Science 2018-01-16 Emmanuel Abbe , João M. Pereira , Amit Singer

We study prediction and estimation problems using empirical risk minimization, relative to a general convex loss function. We obtain sharp error rates even when concentration is false or is very restricted, for example, in heavy-tailed…

Machine Learning · Statistics 2014-10-14 Shahar Mendelson

A distributed binary hypothesis testing problem, in which multiple observers transmit their observations to a detector over noisy channels, is studied. Given its own side information, the goal of the detector is to decide between two…

Information Theory · Computer Science 2017-04-06 Sreejith Sreekumar , Deniz Gündüz

Most work in neural networks focuses on estimating the conditional mean of a continuous response variable given a set of covariates.In this article, we consider estimating the conditional distribution function using neural networks for both…

Methodology · Statistics 2022-07-07 Bingqing Hu , Bin Nan

We will focus on estimating the integrated covariance of two diffusion processes observed in a nonsynchronous manner. The observation data is contaminated by some noise, which is possibly correlated with the returns of the diffusion…

Statistics Theory · Mathematics 2013-05-07 Yuta Koike

Compressed sensing deals with the reconstruction of sparse signals using a small number of linear measurements. One of the main challenges in compressed sensing is to find the support of a sparse signal. In the literature, several bounds on…

Information Theory · Computer Science 2009-11-26 Ali Hormati , Amin Karbasi , Soheil Mohajer , Martin Vetterli

For many applications, an ensemble of base classifiers is an effective solution. The tuning of its parameters(number of classes, amount of data on which each classifier is to be trained on, etc.) requires G, the generalization error of a…

Diffusion models have been firmly established as principled zero-shot solvers for linear and nonlinear inverse problems, owing to their powerful image prior and iterative sampling algorithm. These approaches often rely on Tweedie's formula,…

Machine Learning · Computer Science 2026-04-29 Jonathan Patsenker , Henry Li , Myeongseob Ko , Ruoxi Jia , Yuval Kluger