English
Related papers

Related papers: Adapting to Unknown Smoothness by Aggregation of T…

200 papers

The present paper investigates theoretical performance of various Bayesian wavelet shrinkage rules in a nonparametric regression model with i.i.d. errors which are not necessarily normally distributed. The main purpose is comparison of…

Statistics Theory · Mathematics 2007-06-13 Marianna Pensky

We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent observations. The unknown density is assumed to be uniformly bounded and to belong to the…

Statistics Theory · Mathematics 2024-05-28 Galatia Cleanthous , Athanasios G. Georgiadis , Oleg V. Lepski

This paper addresses the problem of estimating a convex regression function under both the sup-norm risk and the pointwise risk using B-splines. The presence of the convex constraint complicates various issues in asymptotic analysis,…

Statistics Theory · Mathematics 2012-05-02 Xiao Wang , Jinglai Shen

Quantile estimation in deconvolution problems is studied comprehensively. In particular, the more realistic setup of unknown error distributions is covered. Our plug-in method is based on a deconvolution density estimator and is minimax…

Statistics Theory · Mathematics 2016-01-18 Itai Dattner , Markus Reiß , Mathias Trabs

Empirical research typically involves a robustness-efficiency tradeoff. A researcher seeking to estimate a scalar parameter can invoke strong assumptions to motivate a restricted estimator that is precise but may be heavily biased, or they…

Econometrics · Economics 2025-09-17 Timothy B. Armstrong , Patrick Kline , Liyang Sun

We consider the statistical deconvolution problem where one observes $n$ replications from the model $Y=X+\epsilon$, where $X$ is the unobserved random signal of interest and $\epsilon$ is an independent random error with distribution…

Statistics Theory · Mathematics 2011-03-09 Karim Lounici , Richard Nickl

We study the convergence properties, in Hellinger and related distances, of nonparametric density estimators based on measure transport. These estimators represent the measure of interest as the pushforward of a chosen reference…

Statistics Theory · Mathematics 2022-09-20 Sven Wang , Youssef Marzouk

In this paper we introduce a method for nonparametric density estimation on geometric networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation problem. We provide…

Methodology · Statistics 2018-12-06 Robert Bassett , James Sharpnack

Wavelet shrinkage estimators are widely applied in several fields of science for denoising data in wavelet domain by reducing the magnitudes of empirical coefficients. In nonparametric regression problem, most of the shrinkage rules are…

Methodology · Statistics 2021-09-14 Alex Rodrigo dos Santos Sousa , Nancy Lopes Garcia

We construct an adaptive estimator of a density function on $d$ dimensional unit sphere $S^d$ ($d \geq 2 $), using a new type of spherical frames. The frames, or as we call them, stereografic wavelets are obtained by transforming a wavelet…

Statistics Theory · Mathematics 2018-10-15 Bogdan Ćmiel , Karol Dziedziul , Natalia Jarzębkowska

This article is dedicated to the estimation of the regression function when the explanatory variable is a weakly dependent process whose correlation coefficient exhibits exponential decay and has a known bounded density function. The…

Statistics Theory · Mathematics 2025-07-17 Karine Bertin , Lisandro Fermin , Miguel Padrino

We study the problem of nonparametric regression when the regressor is endogenous, which is an important nonparametric instrumental variables (NPIV) regression in econometrics and a difficult ill-posed inverse problem with unknown operator…

Statistics Theory · Mathematics 2017-10-03 Xiaohong Chen , Timothy Christensen

This paper studies statistical aggregation procedures in regression setting. A motivating factor is the existence of many different methods of estimation, leading to possibly competing estimators. We consider here three different types of…

Statistics Theory · Mathematics 2007-06-13 Florentina Bunea , Alexandre Tsybakov , Marten Wegkamp

Necessary and sufficient conditions for the square-integrability of recently proposed unbiased estimators are established. A geometric characterization of a distribution that optimizes the performance of these estimators is given. An…

Statistics Theory · Mathematics 2019-09-09 Nabil Kahale

In the nonparametric regression setting, we construct an estimator which is a continuous function interpolating the data points with high probability, while attaining minimax optimal rates under mean squared risk on the scale of H\"older…

Statistics Theory · Mathematics 2022-06-28 Julien Chhor , Suzanne Sigalla , Alexandre B. Tsybakov

Given a sample from some unknown continuous density $f:\mathbb{R}\to\mathbb{R}$, we construct adaptive confidence bands that are honest for all densities in a "generic" subset of the union of $t$-H\"older balls, $0<t\le r$, where $r$ is a…

Statistics Theory · Mathematics 2010-02-26 Evarist Giné , Richard Nickl

The goal of the paper is development of an optimization method with the superlinear convergence rate for a nonsmooth convex function. For optimization an approximation is used that is similar to the Steklov integral averaging. The…

Optimization and Control · Mathematics 2023-08-03 I. M. Prudnikov

Although ADAM is a very popular algorithm for optimizing the weights of neural networks, it has been recently shown that it can diverge even in simple convex optimization examples. Several variants of ADAM have been proposed to circumvent…

Optimization and Control · Mathematics 2020-09-25 Anas Barakat , Pascal Bianchi

This paper deals with the problem of the multivariate copula density estimation. Using wavelet methods we provide two shrinkage procedures based on thresholding rules for which the knowledge of the regularity of the copula density to be…

Statistics Theory · Mathematics 2011-11-04 Florent Autin , Erwan Le Pennec , Karine Tribouley

We consider the framework of non-stationary stochastic optimization [Besbes et al, 2015] with squared error losses and noisy gradient feedback where the dynamic regret of an online learner against a time varying comparator sequence is…

Machine Learning · Computer Science 2020-10-02 Dheeraj Baby , Yu-Xiang Wang