English
Related papers

Related papers: Adaptive estimation in the linear random coefficie…

200 papers

In this paper, we analyze the behavior of various non-parametric local regression estimators, i.e. estimators that are based on local averaging, for estimating a Lipschitz regression function at a fixed point, or in sup-norm. We first prove…

Statistics Theory · Mathematics 2025-07-11 Jérémy Bettinger , François Portier , Adrien Saumard

A current strand of research in high-dimensional statistics deals with robustifying the available methodology with respect to deviations from the pervasive light-tail assumptions. In this paper we consider a linear mean regression model…

Statistics Theory · Mathematics 2025-02-06 Philipp Hermann , Hajo Holzmann

An important problem in space-time adaptive detection is the estimation of the large p-by-p interference covariance matrix from training signals. When the number of training signals n is greater than 2p, existing estimators are generally…

Signal Processing · Electrical Eng. & Systems 2021-07-26 Benjamin D. Robinson , Robert Malinas , Alfred O. Hero

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh

We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints ($\ell_q$ constraint with $0<q\leq1$) in the high-dimensional setting. We first present a…

Statistics Theory · Mathematics 2013-11-11 Li Zhang

We study the problem of aggregation of estimators when the estimators are not independent of the data used for aggregation and no sample splitting is allowed. If the estimators are deterministic vectors, it is well known that the minimax…

Statistics Theory · Mathematics 2018-03-01 Pierre C. Bellec

The change-plane Cox model is a popular tool for the subgroup analysis of survival data. Despite the rich literature on this model, there has been limited investigation into the asymptotic properties of the estimators of the…

Statistics Theory · Mathematics 2023-02-14 Shota Takeishi

This paper proves, in very general settings, that convex risk minimization is a procedure to select a unique conditional probability model determined by the classification problem. Unlike most previous work, we give results that are general…

Machine Learning · Computer Science 2015-06-16 Matus Telgarsky , Miroslav Dudík , Robert Schapire

In the one-parameter regression model with AR(1) and AR(2) errors we find explicit expressions and a continuous approximation of the optimal discrete design for the signed least square estimator. The results are used to derive the optimal…

Statistics Theory · Mathematics 2016-02-12 Holger Dette , Andrey Pepelyshev , Anatoly Zhigljavsky

In this paper we deal with the regression problem in a random design setting. We investigate asymptotic optimality under minimax point of view of various Bayesian rules based on warped wavelets and show that they nearly attain optimal…

Statistics Theory · Mathematics 2009-08-21 Thanh Mai Pham Ngoc

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

Statistics Theory · Mathematics 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

We consider the regression model with (known) random design. We investigate the minimax performances of an adaptive wavelet block thresholding estimator under the $\mathbb{L}^p$ risk with $p\ge 2$ over Besov balls. We prove that it is near…

Statistics Theory · Mathematics 2011-11-10 Christophe Chesneau

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed…

Statistics Theory · Mathematics 2015-03-13 Jan Johannes , Maik Schwarz

We show both adaptive and non-adaptive minimax rates of convergence for a family of weighted Laplacian-Eigenmap based nonparametric regression methods, when the true regression function belongs to a Sobolev space and the sampling density is…

Statistics Theory · Mathematics 2023-11-02 Zhaoyang Shi , Krishnakumar Balasubramanian , Wolfgang Polonik

We consider nonparametric estimation of a mixed discrete-continuous distribution under anisotropic smoothness conditions and possibly increasing number of support points for the discrete part of the distribution. For these settings, we…

Statistics Theory · Mathematics 2018-06-21 Andriy Norets , Justinas Pelenis

We discuss estimation and inference of conditional treatment effects in regression discontinuity (RD) designs with multiple scores. In addition to local linear regressions and the minimax-optimal estimator more recently proposed by Imbens…

Econometrics · Economics 2025-06-10 Yiqi Liu , Yuan Qi

Random forests are a powerful method for non-parametric regression, but are limited in their ability to fit smooth signals, and can show poor predictive performance in the presence of strong, smooth effects. Taking the perspective of random…

Machine Learning · Statistics 2020-09-08 Rina Friedberg , Julie Tibshirani , Susan Athey , Stefan Wager

Missing values arise in most real-world data sets due to the aggregation of multiple sources and intrinsically missing information (sensor failure, unanswered questions in surveys...). In fact, the very nature of missing values usually…

Machine Learning · Statistics 2022-02-04 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

We consider the linear regression model with observation error in the design. In this setting, we allow the number of covariates to be much larger than the sample size. Several new estimation methods have been recently introduced for this…

Statistics Theory · Mathematics 2016-07-05 Alexandre Belloni , Mathieu Rosenbaum , Alexandre Tsybakov
‹ Prev 1 4 5 6 7 8 10 Next ›