English
Related papers

Related papers: Estimation of smooth functionals in high-dimension…

200 papers

We consider Grenander type estimators for monotone functions $f$ in a very general setting, which includes estimation of monotone regression curves, monotone densities, and monotone failure rates. These estimators are defined as the…

Statistics Theory · Mathematics 2014-10-09 Cécile Durot , Hendrik P. Lopuhaä

Let $(X_1,\ldots,X_n)$ be an i.i.d. sequence of random variables in $\mathbb{R}^d$, $d\geq 1$. We show that, for any function $\varphi :\mathbb{R}^d\rightarrow\mathbb{R}$, under regularity conditions, \[n^…

Statistics Theory · Mathematics 2016-06-07 Bernard Delyon , François Portier

Given a smooth function $f$, we develop a general approach to turn Monte Carlo samples with expectation $m$ into an unbiased estimate of $f(m)$. Specifically, we develop estimators that are based on randomly truncating the Taylor series…

Methodology · Statistics 2025-04-01 Nicolas Chopin , Francesca R. Crucinio , Sumeetpal S. Singh

We develop and implement a novel fast bootstrap for dependent data. Our scheme is based on the i.i.d. resampling of the smoothed moment indicators. We characterize the class of parametric and semi-parametric estimation problems for which…

Methodology · Statistics 2022-01-19 Davide La Vecchia , Alban Moor , Olivier Scaillet

Let $\hat\Sigma=\frac{1}{n}\sum_{i=1}^n X_i\otimes X_i$ denote the sample covariance operator of centered i.i.d.~observations $X_1,\dots,X_n$ in a real separable Hilbert space, and let $\Sigma=\mathbb{E}(X_1\otimes X_1)$. The focus of this…

Statistics Theory · Mathematics 2024-01-25 Miles E. Lopes

Estimating the mean of a random vector from i.i.d. data has received considerable attention, and the optimal accuracy one may achieve with a given confidence is fairly well understood by now. When the data take values in more general metric…

Statistics Theory · Mathematics 2025-09-18 Daniel Bartl , Gabor Lugosi , Roberto Imbuzeiro Oliveira , Zoraida F. Rico

Nonparametric estimation of the mean and covariance functions is ubiquitous in functional data analysis and local linear smoothing techniques are most frequently used. Zhang and Wang (2016) explored different types of asymptotic properties…

Statistics Theory · Mathematics 2025-01-28 Shaojun Guo , Dong Li , Xinghao Qiao , Yizhu Wang

We study the convergence of $Z$-estimators $\widehat \theta(\eta)\in \mathbb R^p$ for which the objective function depends on a parameter $\eta$ that belongs to a Banach space $\mathcal H$. Our results include the uniform consistency over…

Statistics Theory · Mathematics 2015-09-16 François Portier

In this paper, we study distributional reinforcement learning from the perspective of statistical efficiency. We investigate distributional policy evaluation, aiming to estimate the complete return distribution (denoted $\eta^\pi$) attained…

Machine Learning · Statistics 2025-11-13 Liangyu Zhang , Yang Peng , Jiadong Liang , Wenhao Yang , Zhihua Zhang

This paper studies Gaussian random fields with Mat\'ern covariance functions with smooth parameter $\nu>2$. Two cases of parameter spaces, the Euclidean space and $N$-dimensional sphere, are considered. For such smooth Gaussian fields, we…

Probability · Mathematics 2024-03-27 Dan Cheng

Westling and Carone (2020) proposed a framework for studying the large sample distributional properties of generalized Grenander-type estimators, a versatile class of nonparametric estimators of monotone functions. The limiting distribution…

Statistics Theory · Mathematics 2024-07-08 Matias D. Cattaneo , Michael Jansson , Kenichi Nagasawa

Empirical likelihood is an attractive inferential framework that respects natural parameter boundaries, but existing approaches typically require smoothness of the functional and miscalibrate substantially when these assumptions are…

Methodology · Statistics 2026-03-31 Hongseok Namkoong

We propose modeling raw functional data as a mixture of a smooth function and a high-dimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2022-04-13 Yuan Gao , Han Lin Shang , Yanrong Yang

We study the problem of estimating the value of a known smooth function $f$ at an unknown point $\boldsymbol{\mu} \in \mathbb{R}^n$, where each component $\mu_i$ can be sampled via a noisy oracle. Sampling more frequently components of…

Machine Learning · Computer Science 2022-03-22 Tavor Z. Baharav , Gary Cheng , Mert Pilanci , David Tse

In many areas of science one aims to estimate latent sub-population mean curves based only on observations of aggregated population curves. By aggregated curves we mean linear combination of functional data that cannot be observed…

Methodology · Statistics 2011-02-15 Ronaldo Dias , Nancy L. Garcia , Alexandra M. Schmidt

We consider the problem of estimating an arbitrary smooth functional of $k \geq 1 $ distribution functions (d.f.s.) in terms of random samples from them. The natural estimate replaces the d.f.s by their empirical d.f.s. Its bias is…

Statistics Theory · Mathematics 2010-08-03 C. S. Withers , S. Nadarajah

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

Estimation of linear functionals from observed data is an important task in many subjects. Juditsky & Nemirovski [The Annals of Statistics 37.5A (2009): 2278-2300] propose a framework for non-parametric estimation of linear functionals in a…

Statistics Theory · Mathematics 2021-12-08 Akshay Seshadri , Stephen Becker

We consider the problems of \emph{learning} and \emph{testing} real-valued convex functions over Gaussian space. Despite the extensive study of function convexity across mathematics, statistics, and computer science, its learnability and…

Data Structures and Algorithms · Computer Science 2025-11-17 Renato Ferreira Pinto , Cassandra Marcussen , Elchanan Mossel , Shivam Nadimpalli

Let $K \subset \mathbb{R}^n$ be a centered convex body of volume one. We prove that there exist absolute constants $c,C > 0$ and an orthonormal set of vectors $\Theta \subset S^{n-1}$ with size $\left|\Theta\right| \ge 9n/10$ such that, if…

Metric Geometry · Mathematics 2026-05-12 Brayden Letwin , Dan Mikulincer