English
Related papers

Related papers: Adaptive estimation in the single-index model via …

200 papers

The performance of Least Squares (LS) estimators is studied in isotonic, unimodal and convex regression. Our results have the form of sharp oracle inequalities that account for the model misspecification error. In isotonic and unimodal…

Statistics Theory · Mathematics 2016-08-09 Pierre C. Bellec

In this paper, we introduce the first principled adaptive-sampling procedure for learning a convex function in the $L_\infty$ norm, a problem that arises often in the behavioral and social sciences. We present a function-specific measure of…

Machine Learning · Computer Science 2018-08-28 Max Simchowitz , Kevin Jamieson , Jordan W. Suchow , Thomas L. Griffiths

In one-dimensional density estimation on i.i.d. observations we suggest an adaptive cross-validation technique for the selection of a kernel estimator. This estimator is both asymptotic MISE-efficient with respect to the monotone oracle,…

Statistics Theory · Mathematics 2007-06-13 Clementine Dalelane

Adaptive nuclear-norm penalization is proposed for low-rank matrix approximation, by which we develop a new reduced-rank estimation method for the general high-dimensional multivariate regression problems. The adaptive nuclear norm of a…

Methodology · Statistics 2012-09-25 Kun Chen , Hongbo Dong , Kung-Sik Chan

We address the problem of adaptive minimax density estimation on $\bR^d$ with $\bL_p$--loss on the anisotropic Nikol'skii classes. We fully characterize behavior of the minimax risk for different relationships between regularity parameters…

Statistics Theory · Mathematics 2013-06-19 A. Goldenshluger , O. Lepski

This paper deals with a nonparametric shape respecting estimation method for U-shaped or unimodal functions. A general upper bound for the nonasymptotic L_1-risk of the estimator is given. The method is applied to the shape respecting…

Statistics Theory · Mathematics 2007-06-13 L. Reboul

We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is…

Optimization and Control · Mathematics 2021-10-12 Fedor S. Stonyakin

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

We tackle the problem of estimating a regression function observed in an instrumental regression framework. This model is an inverse problem with unknown operator. We provide a spectral cut-off estimation procedure which enables to derive…

Statistics Theory · Mathematics 2009-01-28 Jean-Michel Loubes , Clément Marteau

This paper presents an adaptive version of the Hill estimator based on Lespki's model selection method. This simple data-driven index selection method is shown to satisfy an oracle inequality and is checked to achieve the lower bound…

Statistics Theory · Mathematics 2015-12-16 Stéphane Boucheron , Maud Thomas

In this paper, we consider adaptive estimation of an unknown planar compact, convex set from noisy measurements of its support function on a uniform grid. Both the problem of estimating the support function at a point and that of estimating…

Statistics Theory · Mathematics 2015-08-18 Tony Cai , Adityanand Guntuboyina , Yuting Wei

Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate…

Statistics Theory · Mathematics 2023-10-31 Licong Lin , Mufang Ying , Suvrojit Ghosh , Koulik Khamaru , Cun-Hui Zhang

We constuct a sequential adaptive procedure for estimating the autoregressive function at a given point in nonparametric autoregression models with Gaussian noise. We make use of the sequential kernel estimators. The optimal adaptive…

Statistics Theory · Mathematics 2010-11-12 Ouerdia Arkoun

We study methods for aggregating pairwise comparison data in order to estimate outcome probabilities for future comparisons among a collection of n items. Working within a flexible framework that imposes only a form of strong stochastic…

Machine Learning · Computer Science 2016-03-23 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be heavily biased, or they…

Econometrics · Economics 2025-09-17 Timothy B. Armstrong , Patrick Kline , Liyang Sun

Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical challenges, such as personalized medicine and optimal resource allocation. In this paper, we develop a general class of two-step algorithms for…

Machine Learning · Statistics 2020-08-07 Xinkun Nie , Stefan Wager

Given a large number of covariates $Z$, we consider the estimation of a high-dimensional parameter $\theta$ in an individualized linear threshold $\theta^T Z$ for a continuous variable $X$, which minimizes the disagreement between…

Statistics Theory · Mathematics 2019-05-28 Huijie Feng , Yang Ning , Jiwei Zhao

This paper offers a new approach to modeling and forecasting of nonstationary time series with applications to volatility modeling for financial data. The approach is based on the assumption of local homogeneity: for every time point, there…

Statistics Theory · Mathematics 2009-06-10 Vladimir Spokoiny

This paper studies adaptive sensing for estimating the nonzero amplitudes of a sparse signal with the aim of providing analytical guarantees on the performance gain due to adaptive resource allocation. We consider a previously proposed…

Information Theory · Computer Science 2014-08-05 Dennis Wei , Alfred O. Hero
‹ Prev 1 3 4 5 6 7 10 Next ›