English
Related papers

Related papers: Fast Mean Estimation with Sub-Gaussian Rates

200 papers

This paper suggests a generalized class of estimators for population mean of the qualitative study variable in simple random sampling using information on an auxiliary variable. Asymptotic expressions of bias and mean square error of the…

Statistics Theory · Mathematics 2014-09-18 Prayas Sharma , Hemant K. Verma , Rajesh Singh

Recent years have witnessed much progress on Gaussian and bootstrap approximations to the distribution of sums of independent random vectors with dimension $d$ large relative to the sample size $n$. However, for any number of moments $m>2$…

Statistics Theory · Mathematics 2026-03-27 Anders Bredahl Kock , David Preinerstorfer

We propose a general semi-supervised inference framework focused on the estimation of the population mean. As usual in semi-supervised settings, there exists an unlabeled sample of covariate vectors and a labeled sample consisting of…

Methodology · Statistics 2018-08-15 Anru Zhang , Lawrence D. Brown , T. Tony Cai

Simultaneous inference for high-dimensional non-Gaussian time series is always considered to be a challenging problem. Such tasks require not only robust estimation of the coefficients in the random process, but also deriving limiting…

Methodology · Statistics 2021-11-03 Linbo Liu , Danna Zhang

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

Data Structures and Algorithms · Computer Science 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

This paper proposes a simple and efficient estimation procedure for the model with non-ignorable missing data studied by Morikawa and Kim (2016). Their semiparametrically efficient estimator requires explicit nonparametric estimation and so…

Methodology · Statistics 2018-01-15 Chunrong Ai , Oliver Linton , Zheng Zhang

This paper proposes a general family of estimators for estimating the population mean in systematic sampling in the presence of non-response adapting the family of estimators proposed by Khoshnevisan et al. (2007). In this paper we have…

Statistics Theory · Mathematics 2013-05-09 M. K. Chaudhary , Sachin Malik , Jayant Singh , Rajesh Singh

Some improved estimators are proposed for estimating the population mean in stratified sampling in the presence of auxiliary information. Mean square error (MSE) of the proposed estimators have been derived under large sample approximation.…

Statistics Theory · Mathematics 2013-09-13 Rajesh Singh , Viplav K. Singh , A. A. Adewara

Finite sample bounds on the estimation error of the mean by the empirical mean, uniform over a class of functions, can often be conveniently obtained in terms of Rademacher or Gaussian averages of the class. If a function of n variables has…

Probability · Mathematics 2015-03-10 Andreas Maurer

We present a simple randomized polynomial time algorithm to approximate the mixed discriminant of $n$ positive semidefinite $n \times n$ matrices within a factor $2^{O(n)}$. Consequently, the algorithm allows us to approximate in randomized…

Rings and Algebras · Mathematics 2008-02-03 Alexander Barvinok

We study the problem of heavy-tailed mean estimation in settings where the variance of the data-generating distribution does not exist. Concretely, given a sample $\mathbf{X} = \{X_i\}_{i = 1}^n$ from a distribution $\mathcal{D}$ over…

Statistics Theory · Mathematics 2020-12-10 Yeshwanth Cherapanamjeri , Nilesh Tripuraneni , Peter L. Bartlett , Michael I. Jordan

We study estimation and inference for the mean of real-valued random functions defined on a hypercube. The independent random functions are observed on a discrete, random subset of design points, possibly with heteroscedastic noise. We…

Statistics Theory · Mathematics 2025-04-16 Omar Kassi , Valentin Patilea

We give a polynomial-time algorithm for the problem of robustly estimating a mixture of $k$ arbitrary Gaussians in $\mathbb{R}^d$, for any fixed $k$, in the presence of a constant fraction of arbitrary corruptions. This resolves the main…

Data Structures and Algorithms · Computer Science 2021-06-08 Ainesh Bakshi , Ilias Diakonikolas , He Jia , Daniel M. Kane , Pravesh K. Kothari , Santosh S. Vempala

We consider the problem of estimating the mean and covariance of a distribution from iid samples in $\mathbb{R}^n$, in the presence of an $\eta$ fraction of malicious noise; this is in contrast to much recent work where the noise itself is…

Data Structures and Algorithms · Computer Science 2016-08-16 Kevin A. Lai , Anup B. Rao , Santosh Vempala

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with significantly improved…

Data Structures and Algorithms · Computer Science 2017-11-21 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Traditionally, robust statistics has focused on designing estimators tolerant to a minority of contaminated data. Robust list-decodable learning focuses on the more challenging regime where only a minority $\frac 1 k$ fraction of the…

Data Structures and Algorithms · Computer Science 2020-11-20 Ilias Diakonikolas , Daniel M. Kane , Daniel Kongsgaard , Jerry Li , Kevin Tian

We study Gaussian sparse estimation tasks in Huber's contamination model with a focus on mean estimation, PCA, and linear regression. For each of these tasks, we give the first sample and computationally efficient robust estimators with…

Machine Learning · Computer Science 2024-03-18 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

We study the algorithmic problem of robust mean estimation of an identity covariance Gaussian in the presence of mean-shift contamination. In this contamination model, we are given a set of points in $\mathbb{R}^d$ generated i.i.d. via the…

Data Structures and Algorithms · Computer Science 2025-02-21 Ilias Diakonikolas , Giannis Iakovidis , Daniel M. Kane , Thanasis Pittas

The Cox proportional hazards model is widely used in survival analysis to model time-to-event data. However, it faces significant computational challenges in the era of large-scale data, particularly when dealing with time-dependent…

Methodology · Statistics 2025-01-14 Miaomiao Su , Ruoyu Wang

This paper is devoted to the statistical and numerical properties of the geometric median, and its applications to the problem of robust mean estimation via the median of means principle. Our main theoretical results include (a) an upper…

Statistics Theory · Mathematics 2023-07-21 Stanislav Minsker , Nate Strawn
‹ Prev 1 3 4 5 6 7 10 Next ›