English
Related papers

Related papers: Robust and efficient estimation of high dimensiona…

200 papers

We study the problem of computationally efficient robust estimation of the covariance/scatter matrix of elliptical distributions -- that is, affine transformations of spherically symmetric distributions -- under the strong contamination…

Data Structures and Algorithms · Computer Science 2025-04-15 Gleb Novikov

Off-policy evaluation (OPE) in both contextual bandits and reinforcement learning allows one to evaluate novel decision policies without needing to conduct exploration, which is often costly or otherwise infeasible. The problem's importance…

Machine Learning · Computer Science 2019-06-11 Nathan Kallus , Masatoshi Uehara

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

Machine Learning · Computer Science 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

We present a new finite-sample analysis of M-estimators of locations in $\mathbb{R}^d$ using the tool of the influence function. In particular, we show that the deviations of an M-estimator can be controlled thanks to its influence function…

Statistics Theory · Mathematics 2022-08-23 Timothée Mathieu

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

In this paper we propose a family of robust estimates for isotonic regression: isotonic M-estimators. We show that their asymptotic distribution is, up to an scalar factor, the same as that of Brunk's classical isotonic estimator. We also…

Methodology · Statistics 2011-05-26 Enrique E. Álvarez , Víctor J. Yohai

In this paper, we consider the spectrum sensing in cognitive radio networks when the impulsive noise appears. We propose a class of blind and robust detectors using M-estimators in eigenvalue based spectrum sensing method. The conventional…

Signal Processing · Electrical Eng. & Systems 2019-09-11 Zhedong Liu , Abla Kammoun , Mohamed Slim Alouini

As the most fundamental problem in statistics, robust location estimation has many prominent solutions, such as the trimmed mean, Winsorized mean, Hodges Lehmann estimator, Huber M estimator, and median of means. Recent studies suggest that…

Statistics Theory · Mathematics 2024-09-12 Li Tuobang

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

Machine Learning · Computer Science 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

Let there be given a contaminated list of n R^d-valued observations coming from g different, normally distributed populations with a common covariance matrix. We compute the ML-estimator with respect to a certain statistical model with n-r…

Statistics Theory · Mathematics 2007-06-13 Maria Teresa Gallegos , Gunter Ritter

The paper considers two-phase random design linear regression models. The errors and the regressors are stationary long-range dependent Gaussian. The regression parameters, the scale parameters and the change-point are estimated using a…

Statistics Theory · Mathematics 2009-06-10 Gabriela Ciuperca

The likelihood functions for discretely observed nonlinear continuous-time models based on stochastic differential equations are not available except for a few cases. Various parameter estimation techniques have been proposed, each with…

Methodology · Statistics 2025-04-17 Predrag Pilipovic , Adeline Samson , Susanne Ditlevsen

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

Statistics Theory · Mathematics 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

We study the problem of estimating a $p$-dimensional $s$-sparse vector in a linear model with Gaussian design and additive noise. In the case where the labels are contaminated by at most $o$ adversarial outliers, we prove that the…

Statistics Theory · Mathematics 2019-11-20 Arnak S. Dalalyan , Philip Thompson

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh

It is widely recognised that semiparametric efficient estimation can be hard to achieve in practice: estimators that are in theory efficient may require unattainable levels of accuracy for the estimation of complex nuisance functions. As a…

Statistics Theory · Mathematics 2024-12-18 Elliot H. Young , Rajen D. Shah

This article studies the \emph{robust covariance matrix estimation} of a data collection $X = (x_1,\ldots,x_n)$ with $x_i = \sqrt \tau_i z_i + m$, where $z_i \in \mathbb R^p$ is a \textit{concentrated vector} (e.g., an elliptical random…

Probability · Mathematics 2022-04-12 Cosme Louart , Romain Couillet

Robust estimators, like the median of a point set, are important for data analysis in the presence of outliers. We study robust estimators for locationally uncertain points with discrete distributions. That is, each point in a data set has…

Discrete Mathematics · Computer Science 2018-03-14 Kevin Buchin , Jeff M. Phillips , Pingfan Tang

National statistical institutes in many countries are now mandated to produce reliable statistics for important variables such as population, income, unemployment, health outcomes, etc. for small areas, defined by geography and/or…

Methodology · Statistics 2018-10-29 Adrijo Chakraborty , Gauri Sankar Datta , Abhyuday Mandal
‹ Prev 1 3 4 5 6 7 10 Next ›