English
Related papers

Related papers: Adapting to Unknown Smoothness by Aggregation of T…

200 papers

In many statistical problems, stochastic signals can be represented as a sequence of noisy wavelet coefficients. In this paper, we develop general empirical Bayes methods for the estimation of true signal. Our estimators approximate certain…

Statistics Theory · Mathematics 2007-06-13 Cun-Hui Zhang

This work is intended as a contribution to a wavelet-based adaptive estimator of the memory parameter in the classical semi-parametric framework for Gaussian stationary processes. In particular we introduce and develop the choice of a…

Statistics Theory · Mathematics 2008-03-27 Jean-Marc Bardet , Hatem Bibi , Abdellatif Jouini

We consider the estimation of a structural function which models a non-parametric relationship between a response and an endogenous regressor given an instrument in presence of dependence in the data generating process. Assuming an…

Statistics Theory · Mathematics 2016-04-08 Nicolas Asin , Jan Johannes

Although adaptive optimization algorithms have been successful in many applications, there are still some mysteries in terms of convergence analysis that have not been unraveled. This paper provides a novel non-convex analysis of adaptive…

Optimization and Control · Mathematics 2025-04-08 Zhishuai Guo , Yi Xu , Wotao Yin , Rong Jin , Tianbao Yang

We introduce two data-driven procedures for optimal estimation and inference in nonparametric models using instrumental variables. The first is a data-driven choice of sieve dimension for a popular class of sieve two-stage least squares…

Econometrics · Economics 2024-01-09 Xiaohong Chen , Timothy Christensen , Sid Kankanala

This paper explores a class of empirical Bayes methods for level-dependent threshold selection in wavelet shrinkage. The prior considered for each wavelet coefficient is a mixture of an atom of probability at zero and a heavy-tailed…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

We consider the non-parametric Poisson regression problem where the integer valued response $Y$ is the realization of a Poisson random variable with parameter $\lambda(X)$. The aim is to estimate the functional parameter $\lambda$ from…

Statistics Theory · Mathematics 2018-05-14 Martin Kroll

We construct nonparametric confidence sets for regression functions using wavelets that are uniform over Besov balls. We consider both thresholding and modulation estimators for the wavelet coefficients. The confidence set is obtained by…

Statistics Theory · Mathematics 2007-06-13 Christopher R. Genovese , Larry Wasserman

This work is concerned with the study of asymptotic properties of nonparametric density estimates in the framework of circular data. The estimation procedure here applied is based on wavelet thresholding methods: the wavelets used are the…

Statistics Theory · Mathematics 2016-03-16 Claudio Durastanti

In a circular deconvolution model we consider the fully data driven density estimation of a circular random variable where the density of the additive independent measurement error is unknown. We have at hand two independent iid samples,…

Statistics Theory · Mathematics 2021-02-02 Jan Johannes , Xavier Loizeau

Most results in nonparametric regression theory are developed only for the case of additive noise. In such a setting many smoothing techniques including wavelet thresholding methods have been developed and shown to be highly adaptive. In…

Statistics Theory · Mathematics 2010-10-20 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

Assume that $(X_t)_{t\in\Z}$ is a real valued time series admitting a common marginal density $f$ with respect to Lebesgue's measure. Donoho {\it et al.} (1996) propose a near-minimax method based on thresholding wavelets to estimate $f$ on…

Statistics Theory · Mathematics 2011-03-17 Irène Gannaz , Olivier Wintenberger

In this paper, we study the problem of adaptive estimation of the spectral density of a stationary Gaussian process. For this purpose, we consider a wavelet-based method which combines the ideas of wavelet approximation and estimation by…

Statistics Theory · Mathematics 2011-06-07 Jérémie Bigot , Rolando Biscay Lirio , Jean-Michel Loubes , Lilian Muniz Alvarez

In a first part, we prove Bernstein-type deviation inequalities for bifurcating Markov chains (BMC) under a geometric ergodicity assumption, completing former results of Guyon and Bitseki Penda, Djellout and Guillin. These preliminary…

Statistics Theory · Mathematics 2015-09-11 S. Valère Bitseki Penda , Marc Hoffmann , Adélaïde Olivier

We consider nonparametric estimation of a mixed discrete-continuous distribution under anisotropic smoothness conditions and possibly increasing number of support points for the discrete part of the distribution. For these settings, we…

Statistics Theory · Mathematics 2018-06-21 Andriy Norets , Justinas Pelenis

This paper continues the research started in \cite{LW16}. In the framework of the convolution structure density model on $\bR^d$, we address the problem of adaptive minimax estimation with $\bL_p$--loss over the scale of anisotropic…

Statistics Theory · Mathematics 2017-04-17 Oleg Lepski , Thomas Willer

We consider the problem of model selection type aggregation in the context of density estimation. We first show that empirical risk minimization is sub-optimal for this problem and it shares this property with the exponential weights…

Statistics Theory · Mathematics 2016-09-29 Pierre C. Bellec

Transfer learning for nonparametric regression is considered. We first study the non-asymptotic minimax risk for this problem and develop a novel estimator called the confidence thresholding estimator, which is shown to achieve the minimax…

Machine Learning · Statistics 2024-01-24 T. Tony Cai , Hongming Pu

We investigate function estimation in nonparametric regression models with random design and heteroscedastic correlated noise. Adaptive properties of warped wavelet nonlinear approximations are studied over a wide range of Besov scales,…

Statistics Theory · Mathematics 2009-09-03 Rafał Kulik , Marc Raimondo

In the present paper we consider the problem of estimating a periodic $(r+1)$-dimensional function $f$ based on observations from its noisy convolution. We construct a wavelet estimator of $f$, derive minimax lower bounds for the $L^2$-risk…

Statistics Theory · Mathematics 2013-05-24 Rida Benhaddou , Marianna Pensky , Dominique Picard