English
Related papers

Related papers: Adaptive estimation of an additive regression func…

200 papers

This paper studies high-dimensional additive regression under the transfer learning framework, where one observes samples from a target population together with auxiliary samples from different but potentially related regression models. We…

Machine Learning · Statistics 2025-09-17 Seung Hyun Moon

Assume that $(X_t)_{t\in\Z}$ is a real valued time series admitting a common marginal density $f$ with respect to Lebesgue's measure. Donoho {\it et al.} (1996) propose a near-minimax method based on thresholding wavelets to estimate $f$ on…

Statistics Theory · Mathematics 2011-03-17 Irène Gannaz , Olivier Wintenberger

The purpose of this paper is to estimate the intensity of a Poisson process $N$ by using thresholding rules. In this paper, the intensity, defined as the derivative of the mean measure of $N$ with respect to $ndx$ where $n$ is a fixed…

Statistics Theory · Mathematics 2008-01-22 Patricia Reynaud-Bouret , Vincent Rivoirard

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery is an important step…

Statistics Theory · Mathematics 2024-07-16 Stéphane Lhaut , Johan Segers

This paper studies some asymptotic properties of adaptive algorithms widely used in optimization and machine learning, and among them Adagrad and Rmsprop, which are involved in most of the blackbox deep learning algorithms. Our setup is the…

Machine Learning · Statistics 2020-12-15 Sébastien Gadat , Ioana Gavra

We consider the problem of inference on a regression function at a point when the entire function satisfies a sign or shape restriction under the null. We propose a test that achieves the optimal minimax rate adaptively over a range of…

Statistics Theory · Mathematics 2015-10-15 Timothy Armstrong

We study distributed estimation methods under communication constraints in a distributed version of the nonparametric random design regression model. We derive minimax lower bounds and exhibit methods that attain those bounds. Moreover, we…

Statistics Theory · Mathematics 2019-02-06 Botond Szabo , Harry van Zanten

The aim of this article is to propose a novel kernel estimator of the baseline function in a general high-dimensional Cox model, for which we derive non-asymptotic rates of convergence. To construct our estimator, we first estimate the…

Applications · Statistics 2015-07-07 Agathe Guilloux , Sarah Lemler , Marie-Luce Taupin

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

Statistics Theory · Mathematics 2012-05-02 Xiao Wang , Jinglai Shen

This paper studies the asymptotic properties of the penalized least squares estimator using an adaptive group Lasso penalty for the reduced rank regression. The group Lasso penalty is defined in the way that the regression coefficients…

Statistics Theory · Mathematics 2024-04-02 Kejun He , Jianhua Z. Huang

Optimal estimation and inference for both the minimizer and minimum of a convex regression function under the white noise and nonparametric regression models are studied in a nonasymptotic local minimax framework, where the performance of a…

Statistics Theory · Mathematics 2024-03-12 T. Tony Cai , Ran Chen , Yuancheng Zhu

Most results in nonparametric regression theory are developed only for the case of additive noise. In such a setting many smoothing techniques including wavelet thresholding methods have been developed and shown to be highly adaptive. In…

Statistics Theory · Mathematics 2010-10-20 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

We consider the detection problem of a two-dimensional function from noisy observations of its integrals over lines. We study both rate and sharp asymptotics for the error probabilities in the minimax setup. By construction, the derived…

Statistics Theory · Mathematics 2012-01-26 Yuri I. Ingster , Theofanis Sapatinas , Irina A. Suslina

Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate…

Statistics Theory · Mathematics 2023-10-31 Licong Lin , Mufang Ying , Suvrojit Ghosh , Koulik Khamaru , Cun-Hui Zhang

We study the problem of bivariate discrete or continuous probability density estimation under low-rank constraints.For discrete distributions, we assume that the two-dimensional array to estimate is a low-rank probability matrix. In the…

Statistics Theory · Mathematics 2024-10-23 Julien Chhor , Olga Klopp , Alexandre Tsybakov

This paper considers the problem of adaptive estimation of a mean pattern in a randomly shifted curve model. We show that this problem can be transformed into a linear inverse problem, where the density of the random shifts plays the role…

Statistics Theory · Mathematics 2010-10-21 Jérémie Bigot , Sébastien Gadat

This work is intended as a contribution to a wavelet-based adaptive estimator of the memory parameter in the classical semi-parametric framework for Gaussian stationary processes. In particular we introduce and develop the choice of a…

Statistics Theory · Mathematics 2008-03-27 Jean-Marc Bardet , Hatem Bibi , Abdellatif Jouini

We consider a general monotone regression estimation where we allow for independent and dependent regressors. We propose a modification of the classical isotonic least squares estimator and establish its rate of convergence for the…

Statistics Theory · Mathematics 2018-05-07 Konstantinos Fokianos , Anne Leucht , Michael H. Neumann

Nonparametric regression models such as Bayesian Additive Regression Trees (BART) can be useful in fitting flexible functions of a set of covariates to a response, while accounting for nonlinearities and interactions. However, they are…

Methodology · Statistics 2018-07-02 Bonifride Tuyishimire , Brent R Logan , Purushottam W Laud

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang