English
Related papers

Related papers: Asymptotics For High Dimensional Regression M-Esti…

200 papers

The aim of this paper is to establish several deep theoretical properties of principal component analysis for multiple-component spike covariance models. Our new results reveal a surprising asymptotic conical structure in critical sample…

Statistics Theory · Mathematics 2013-03-26 Dan Shen , Haipeng Shen , Hongtu Zhu , J. S. Marron

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regularity conditions on the…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh , Martin J. Wainwright

We find the asymptotic distribution of the multi-dimensional multi-scale and kernel estimators for high-frequency financial data with microstructure. Sampling times are allowed to be asynchronous and endogenous. In the process, we show that…

Statistics Theory · Mathematics 2014-11-05 Markus Bibinger , Per A. Mykland

By means of two simple convexity arguments we are able to develop a general method for proving consistency and asymptotic normality of estimators that are defined by minimisation of convex criterion functions. This method is then applied to…

Statistics Theory · Mathematics 2011-07-20 Nils Lid Hjort , David Pollard

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

We analyze the prediction error of ridge regression in an asymptotic regime where the sample size and dimension go to infinity at a proportional rate. In particular, we consider the role played by the structure of the true regression…

Statistics Theory · Mathematics 2021-03-09 Dominic Richards , Jaouad Mourtada , Lorenzo Rosasco

We construct uniform and point-wise asymptotic confidence sets for the single edge in an otherwise smooth image function which are based on rotated differences of two one-sided kernel estimators. Using methods from M-estimation, we show…

Statistics Theory · Mathematics 2019-03-26 Viktor Bengs , Matthias Eulert , Hajo Holzmann

We study the asymptotic properties of geodesically convex $M$-estimation on non-linear spaces. Namely, we prove that under very minimal assumptions besides geodesic convexity of the cost function, one can obtain consistency and asymptotic…

Statistics Theory · Mathematics 2023-05-08 Victor-Emmanuel Brunel

Asymptotic properties of scatter estimators for elliptical graphical models are studied. Such models impose a given pattern of zeros on the inverse of the shape matrix of an elliptically distributed random vector. In particular, we…

Statistics Theory · Mathematics 2015-06-16 Daniel Vogel , David E. Tyler

We propose a class of robust estimates for multivariate linear models. Based on the approach of MM estimation (Yohai 1987), we estimate the regression coefficients and the covariance matrix of the errors simultaneously. These estimates have…

Statistics Theory · Mathematics 2025-12-03 Nadia L. Kudraszow , Ricardo A. Maronna

The Birnbaum-Saunders distribution has been used quite effectively to model times to failure for materials subject to fatigue and for modeling lifetime data. In this paper we obtain asymptotic expansions, up to order $n^{-1/2}$ and under a…

Methodology · Statistics 2011-11-22 Artur Lemonte , Silvia Ferrari

This paper presents uniform estimation and inference theory for a large class of nonparametric partitioning-based M-estimators. The main theoretical results include: (i) uniform consistency for convex and non-convex objective functions;…

Statistics Theory · Mathematics 2025-09-01 Matias D. Cattaneo , Yingjie Feng , Boris Shigida

We study (asymmetric) $U$-statistics based on a stationary sequence of $m$-dependent variables; moreover, we consider constrained $U$-statistics, where the defining multiple sum only includes terms satisfying some restrictions on the gaps…

Probability · Mathematics 2022-03-10 Svante Janson

This paper presents asymptotic results for the maximum likelihood and restricted maximum likelihood (REML) estimators within a two-way crossed mixed effect model as the sizes of the rows, columns, and cells tend to infinity. Under very mild…

Statistics Theory · Mathematics 2024-12-24 Ziyang Lyu , S. A. Sisson , A. H. Welsh

This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are…

Statistics Theory · Mathematics 2020-07-27 Emil S. Jørgensen , Michael Sørensen

Linear thresholding models postulate that the conditional distribution of a response variable in terms of covariates differs on the two sides of a (typically unknown) hyperplane in the covariate space. A key goal in such models is to learn…

Statistics Theory · Mathematics 2021-10-01 Debarghya Mukherjee , Moulinath Banerjee , Debasri Mukherjee , Ya'acov Ritov

This paper considers extensions of minimum-disparity estimators to the problem of estimating parameters in a regression model that is conditionally specified; that is where a parametric model describes the distribution of a response $y$…

Statistics Theory · Mathematics 2016-02-10 Giles Hooker

In this paper, we investigate the asymptotic behaviors of the extreme eigenvectors in a general spiked covariance matrix, where the dimension and sample size increase proportionally. We eliminate the restrictive assumption of the block…

Statistics Theory · Mathematics 2024-05-15 Zhangni Pu , Xiaozhuo Zhang , Jiang Hu , Zhidong Bai

We study the large sample properties of sparse M-estimators in the presence of pseudo-observations. Our framework covers a broad class of semi-parametric copula models, for which the marginal distributions are unknown and replaced by their…

Statistics Theory · Mathematics 2023-06-01 Jean-David Fermanian , Benjamin Poignard

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum