English
Related papers

Related papers: Provable More Data Hurt in High Dimensional Least …

200 papers

This paper derives central limit and bootstrap theorems for probabilities that sums of centered high-dimensional random vectors hit hyperrectangles and sparsely convex sets. Specifically, we derive Gaussian and bootstrap approximations for…

Statistics Theory · Mathematics 2016-03-09 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

This work studies finite-sample properties of the risk of the minimum-norm interpolating predictor in high-dimensional regression models. If the effective rank of the covariance matrix $\Sigma$ of the $p$ regression features is much larger…

Machine Learning · Statistics 2021-03-23 Florentina Bunea , Seth Strimas-Mackey , Marten Wegkamp

This article provides, through theoretical analysis, an in-depth understanding of the classification performance of the empirical risk minimization framework, in both ridge-regularized and unregularized cases, when high dimensional data are…

Machine Learning · Statistics 2020-11-26 Xiaoyi Mai , Zhenyu Liao

We consider learning methods based on the regularization of a convex empirical risk by a squared Hilbertian norm, a setting that includes linear predictors and non-linear predictors through positive-definite kernels. In order to go beyond…

Machine Learning · Computer Science 2019-06-19 Ulysse Marteau-Ferey , Dmitrii Ostrovskii , Francis Bach , Alessandro Rudi

We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling…

Statistics Theory · Mathematics 2020-10-16 Doron Cohen , Aryeh Kontorovich , Geoffrey Wolfer

High-dimensional data sets are commonly collected in many contemporary applications arising in various fields of scientific research. We present two views of finite samples in high dimensions: a probabilistic one and a nonprobabilistic one.…

Statistics Theory · Mathematics 2013-11-13 Jinchi Lv

Consider the standard Gaussian linear regression model $Y=X\theta+\epsilon$, where $Y\in R^n$ is a response vector and $ X\in R^{n*p}$ is a design matrix. Numerous work have been devoted to building efficient estimators of $\theta$ when $p$…

Statistics Theory · Mathematics 2012-01-26 Nicolas Verzelen

The James-Stein estimator's dominance over maximum likelihood in terms of mean square error (MSE) has been one of the most celebrated results in modern statistics, suggesting that biased estimators can systematically outperform unbiased…

Statistics Theory · Mathematics 2025-08-12 Paul W. Vos

High-dimensional classification is a fundamentally important research problem in high-dimensional data analysis. In this paper, we derive a nonasymptotic rate for the minimax excess misclassification risk when feature dimension…

Statistics Theory · Mathematics 2023-03-07 Shuoyang Wang , Zuofeng Shang

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann

We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features.…

Statistics Theory · Mathematics 2020-02-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

Least-squares refitting is widely used in high dimensional regression to reduce the prediction bias of l1-penalized estimators (e.g., Lasso and Square-Root Lasso). We present theoretical and numerical results that provide new insights into…

Methodology · Statistics 2013-06-04 Johannes Lederer

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Least-squares fits are an important tool in many data analysis applications. In this paper, we review theoretical results, which are relevant for their application to data from counting experiments. Using a simple example, we illustrate the…

Data Analysis, Statistics and Probability · Physics 2019-06-07 Hans Dembinski , Michael Schmelling , Roland Waldi

The purpose of this paper is to pursue our study of rho-estimators built from i.i.d. observations that we defined in Baraud et al. (2014). For a \rho-estimator based on some model S (which means that the estimator belongs to S) and a true…

Statistics Theory · Mathematics 2017-03-07 Yannick Baraud , Lucien Birgé

We consider the problem of constructing confidence intervals for the locations of change points in a high-dimensional mean shift model. To that end, we develop a locally refitted least squares estimator and obtain component-wise and…

Methodology · Statistics 2021-07-21 Abhishek Kaul , George Michailidis

This paper deals with subspace estimation in the small sample size regime, where the number of samples is comparable in magnitude with the observation dimension. The traditional estimators, mostly based on the sample correlation matrix, are…

Methodology · Statistics 2015-06-19 Pascal Vallet , Xavier Mestre , Philippe Loubaton

Mixed outcome endpoints that combine multiple continuous and discrete components to form co-primary, multiple primary or composite endpoints are often employed as primary outcome measures in clinical trials. There are many advantages to…

Methodology · Statistics 2019-12-12 Martina McMenamin , Jessica K. Barrett , Anna Berglind , James M. S. Wason

This paper investigates a change-point estimation problem in the context of high-dimensional Markov Random Field models. Change-points represent a key feature in many dynamically evolving network structures. The change-point estimate is…

Methodology · Statistics 2018-02-13 Sandipan Roy , Yves Atchade , George Michailidis