English
Related papers

Related papers: On the $\mathbb{L}_p$-error of monotonicity constr…

200 papers

Many results have been proved for various nuclear norm penalized estimators of the uniform sampling matrix completion problem. However, most of these estimators are not robust: in most of the cases the quadratic loss function and its…

Statistics Theory · Mathematics 2017-07-25 Andreas Elsener , Sara van de Geer

The article starts with generalizations of some classical results and new truncation error upper bounds in the sampling theorem for bandlimited stochastic processes. Then, it investigates $L_p([0,T])$ and uniform approximations of…

Probability · Mathematics 2016-06-06 Yuriy Kozachenko , Andriy Olenko

A current strand of research in high-dimensional statistics deals with robustifying the available methodology with respect to deviations from the pervasive light-tail assumptions. In this paper we consider a linear mean regression model…

Statistics Theory · Mathematics 2025-02-06 Philipp Hermann , Hajo Holzmann

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

Machine Learning · Computer Science 2025-11-21 Ethan Blaser , Shangtong Zhang

Covariance estimation is a central problem in statistics. An important issue is that there are rarely enough samples $n$ to accurately estimate the $p (p+1) / 2$ coefficients in dimension $p$. Parsimonious covariance models are therefore…

Methodology · Statistics 2025-07-14 Tom Szwagier , Guillaume Olikier , Xavier Pennec

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Let $\mathcal{P}_{\lambda}:=\mathcal{P}_{\lambda\kappa}$ denote a Poisson point process of intensity $\lambda\kappa$ on $[0,1]^d,d\geq2$, with $\kappa$ a bounded density on $[0,1]^d$ and $\lambda\in(0,\infty)$. Given a closed subset…

Probability · Mathematics 2015-02-02 J. E. Yukich

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse…

Statistics Theory · Mathematics 2019-07-04 David Gamarnik , Julia Gaudio

M-estimation, aka empirical risk minimization, is at the heart of statistics and machine learning: Classification, regression, location estimation, etc. Asymptotic theory is well understood when the loss satisfies some smoothness…

Statistics Theory · Mathematics 2025-12-16 Victor-Emmanuel Brunel

We study estimation of multivariate densities $p$ of the form $p(x)=h(g(x))$ for $x\in \mathbb {R}^d$ and for a fixed monotone function $h$ and an unknown convex function $g$. The canonical example is $h(y)=e^{-y}$ for $y\in \mathbb {R}$;…

Statistics Theory · Mathematics 2012-11-15 Arseni Seregin , Jon A. Wellner

Sparse linear regression is one of the classical and extensively studied problems in high-dimensional statistics and compressed sensing. Despite the substantial body of literature dedicated to this problem, the precise determination of its…

Statistics Theory · Mathematics 2024-05-10 Yilin Guo , Shubhangi Ghosh , Haolei Weng , Arian Maleki

Confidence intervals based on penalized maximum likelihood estimators such as the LASSO, adaptive LASSO, and hard-thresholding are analyzed. In the known-variance case, the finite-sample coverage properties of such intervals are determined…

Statistics Theory · Mathematics 2010-03-16 Benedikt M. Pötscher , Ulrike Schneider

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

We investigate the limit behavior of the $L_k$-distance between a decreasing density $f$ and its nonparametric maximum likelihood estimator $\hat{f}_n$ for $k\geq1$. Due to the inconsistency of $\hat{f}_n$ at zero, the case $k=2.5$ turns…

Statistics Theory · Mathematics 2016-08-16 Vladimir N. Kulikov , Hendrik P. Lopuhaä

In this paper, we derive the continuity of solutions to the $L_{p}$ torsional Minkowski problem for $p>1$. It is shown that the weak convergence of the $L_{p}$ torsional measure implies the convergence of the sequence of the corresponding…

Metric Geometry · Mathematics 2023-03-21 Jinrong Hu , Qiongfang Mao , Sinan Wang

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

Statistics Theory · Mathematics 2013-11-04 Adel Javanmard , Andrea Montanari

A generic out-of-sample error estimate is proposed for robust $M$-estimators regularized with a convex penalty in high-dimensional linear regression where $(X,y)$ is observed and $p,n$ are of the same order. If $\psi$ is the derivative of…

Statistics Theory · Mathematics 2023-03-31 Pierre C Bellec

Object grasping is a crucial technology enabling robots to perceive and interact with the environment sufficiently. However, in practical applications, researchers are faced with missing or noisy ground truth while training the…

Robotics · Computer Science 2024-09-10 Yangfan Deng , Mengyao Zhang , Yong Zhao

We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features.…

Statistics Theory · Mathematics 2020-02-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

In this paper, we built a new nonparametric regression estimator with the local linear method by using the mean squared relative error as a loss function when the data are subject to random right censoring. We establish the uniform almost…

Statistics Theory · Mathematics 2020-04-07 Feriel Bouhadjera , Elias Saïd