English
Related papers

Related papers: Improved multivariate normal mean estimation with …

200 papers

We study the existence, strong consistency and asymptotic normality of estimators obtained from estimating functions, that are p-dimensional martingale transforms. The problem is motivated by the analysis of evolutionary clustered data,…

Statistics Theory · Mathematics 2020-12-01 Laura Dumitrescu , Ioana Schiopu-Kratina

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Regression trees and random forests are popular and effective non-parametric estimators in practical applications. A recent paper by Athey and Wager shows that the random forest estimate at any point is asymptotically Gaussian; in this…

Econometrics · Economics 2021-02-02 Kevin Li

We consider the problem of estimating the conditional mean of a real Gaussian variable $\nolinebreak Y=\sum_{i=1}^p\nolinebreak\theta_iX_i+\nolinebreak \epsilon$ where the vector of the covariates $(X_i)_{1\leq i\leq p}$ follows a joint…

Statistics Theory · Mathematics 2009-04-28 Nicolas Verzelen

Consider estimating the n by p matrix of means of an n by p matrix of independent normally distributed observations with constant variance, where the performance of an estimator is judged using a p by p matrix quadratic error loss function.…

Statistics Theory · Mathematics 2011-01-19 Reman Abu-Shanab , John T. Kent , William E. Strawderman

Consider a nonlinear regression model : y_{i}=g(x_{i},{\theta})+e_{i}, i=1,...,n, where the x_{i} are random predictors x_{i} and {\theta} is the unknown parameter vector ranging in a set {\Theta}\subsetR^{p}. All known results on the…

Statistics Theory · Mathematics 2012-07-03 Fasano María Victoria , Ricardo A. Maronna

We consider the problem of the estimation of the invariant distribution function of an ergodic diffusion process when the drift coefficient is unknown. The empirical distribution function is a natural estimator which is unbiased, uniformly…

Statistics Theory · Mathematics 2007-06-13 Ilia Negri

Assume that X is a set of sample statistics which follow a special case Central Limit Theorem, namely: as the sample size n increases the corresponding distribution becomes multivariate Normal with the mean (of each X) equal to zero and…

Statistics Theory · Mathematics 2014-11-21 Hao Yuan Zhang , Jan Vrbik

This paper deals with the problem of estimating the covariance matrix of a series of independent multivariate observations, in the case where the dimension of each observation is of the same order as the number of observations. Although…

Information Theory · Computer Science 2015-06-03 Jianfeng Yao , Abla Kammoun , Jamal Najim

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

Machine Learning · Computer Science 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

This paper deals with recovering an unknown vector $\theta$ from the noisy data $Y=A\theta+\sigma\xi$, where $A$ is a known $(m\times n)$-matrix and $\xi$ is a white Gaussian noise. It is assumed that $n$ is large and $A$ may be severely…

Statistics Theory · Mathematics 2010-11-11 Yuri Golubev

This paper presents a novel approach to constructing estimators that dominate the classical James-Stein estimator under the quadratic loss for multivariate normal means. Building on Stein's risk representation, we introduce a new sufficient…

Statistics Theory · Mathematics 2025-09-23 Yuzo Maruyama , Akimichi Takemura

In this article we introduce a family of valuative invariants defined in terms of the $p$-th moment of the expected vanishing order. These invariants lie between $\alpha$ and $\delta$-invariants. They vary continuously in the big cone and…

Algebraic Geometry · Mathematics 2021-08-03 Kewei Zhang

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

Statistics Theory · Mathematics 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

Let $X_{1},X_{2},...$ be a sequence of independent random variables ($rv$)with common distribution function ($df$) $F$ such that $F(1)=0$ and for each $n\geq 1,$ let $X_{1,n}\leq X_{2,n}\leq ...\leq X_{n,n}$ denote the order statistics…

Probability · Mathematics 2012-02-14 Gane Samb lo

Consider a random sample in the max-domain of attraction of a multivariate extreme value distribution such that the dependence structure of the attractor belongs to a parametric model. A new estimator for the unknown parameter is defined as…

Statistics Theory · Mathematics 2012-10-05 John H. J. Einmahl , Andrea Krajina , Johan Segers

This paper analyzes the performance of Tyler's M-estimator of the scatter matrix in elliptical populations. We focus on the non-asymptotic setting and derive the estimation error bounds depending on the number of samples n and the dimension…

Statistics Theory · Mathematics 2015-06-18 Ilya Soloveychik , Ami Wiesel

The assumption of normality in data has been considered in the field of statistical analysis for a long time. However, in many practical situations, this assumption is clearly unrealistic. It has recently been suggested that the use of…

Computation · Statistics 2016-11-25 Reinaldo B. Arellano-Valle , Javier E. Contreras-Reyes

General depth weighted scatter estimators are introduced and investigated. For general depth functions, we find out that these affine equivariant scatter estimators are Fisher consistent and unbiased for a wide range of multivariate…

Statistics Theory · Mathematics 2007-06-13 Yijun Zuo , Hengjian Cui

The problem of characterizing a multivariate distribution of a random vector using examination of univariate combinations of vector components is an essential issue of multivariate analysis. The likelihood principle plays a prominent role…

Methodology · Statistics 2019-10-29 Albert Vexler