English
Related papers

Related papers: Efficient functional estimation and the super-orac…

200 papers

Estimators of doubly robust functionals typically rely on estimating two complex nuisance functions, such as the propensity score and conditional outcome mean for the average treatment effect functional. We consider the problem of how to…

Statistics Theory · Mathematics 2026-03-10 Sean McGrath , Rajarshi Mukherjee

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

Maximum Likelihood Estimators (MLE) has many good properties. For example, the asymptotic variance of MLE solution attains equality of the asymptotic Cram{\'e}r-Rao lower bound (efficiency bound), which is the minimum possible variance for…

Machine Learning · Statistics 2019-11-05 Song Liu , Takafumi Kanamori , Wittawat Jitkrittum , Yu Chen

We discuss the problem of adaptive discrete-time signal denoising in the situation where the signal to be recovered admits a "linear oracle" -- an unknown linear estimate that takes the form of convolution of observations with a…

Statistics Theory · Mathematics 2021-02-15 Zaid Harchaoui , Anatoli Juditsky , Arkadi Nemirovski , Dmitrii Ostrovskii

In two landmark papers, Akaike introduced the AIC and FPE, demonstrating their significant usefulness for prediction. In subsequent seminal works, Shibata developed a notion of asymptotic efficiency and showed that both AIC and FPE are…

Statistics Theory · Mathematics 2024-06-21 Moritz Jirak , Georg Köstenberger

In this paper we build provably near-optimal, in the minimax sense, estimates of linear forms and, more generally, "$N$-convex functionals" (the simplest example being the maximum of several fractional-linear functions) of unknown "signal"…

Statistics Theory · Mathematics 2019-04-01 Anatoli Juditsky , Arkadi Nemirovski

We extend the problem of obtaining an estimator for the finite population mean parameter incorporating complete auxiliary information through calibration estimation in survey sampling but considering a functional data framework. The…

Statistics Theory · Mathematics 2013-02-06 Santiago Gallón , Jean-Michel Loubes , Fabrice Gamboa

We tackle the problem of estimating a regression function observed in an instrumental regression framework. This model is an inverse problem with unknown operator. We provide a spectral cut-off estimation procedure which enables to derive…

Statistics Theory · Mathematics 2009-01-28 Jean-Michel Loubes , Clément Marteau

We present and study semi-parametric estimators for the mean of functional outcomes in situations where some of these outcomes are missing and covariate information is available on all units. Assuming that the missingness mechanism depends…

Statistics Theory · Mathematics 2026-02-25 Xijia Liu , Kreske Felix Ecker , Lina Schelin , Xavier de Luna

We consider the estimation of the value of a linear functional of the slope parameter in functional linear regression, where scalar responses are modeled in dependence of random functions. The theory in this paper covers in particular…

Statistics Theory · Mathematics 2011-12-19 J. Johannes , R. Schenk

Difference-in-differences (DiD) is a cornerstone of causal inference, yet extending it to functional outcomes is not a routine scalar generalization; rather, it entails three fundamental challenges in identification, inference, and…

Methodology · Statistics 2026-05-29 Junzhu Nie , Chengxiu Ling , Mengfei Ran

In this paper we give effective estimates for some classical arithmetic functions defined over prime numbers. First we find the smallest real number $x_0$ so that some inequality involving Chebyshev's $\vartheta$-function holds for every $x…

Number Theory · Mathematics 2022-06-30 Christian Axler

The problem of adaptive multivariate function estimation in the single-index regression model with random design and weak assumptions on the noise is investigated. A novel estimation procedure that adapts simultaneously to the unknown index…

Statistics Theory · Mathematics 2014-01-29 Oleg Lepski , Nora Serdyukova

The paper studies the asymptotic behaviour of weighted functionals of long-range dependent data over increasing observation windows. Various important statistics, including sample means, high order moments, occupation measures can be given…

Statistics Theory · Mathematics 2019-05-27 Tareq Alodat , Andriy Olenko

A problem of improving the accuracy of nonparametric entropy estimation for a stationary ergodic process is considered. New weak metrics are introduced and relations between metrics, measures, and entropy are discussed. Based on weak…

Information Theory · Computer Science 2024-11-04 Evgeniy Timofeev , Alexei Kaltchenko

We study prediction in the functional linear model with functional outputs : $Y=SX+\epsilon $ where the covariates $X$ and $Y$ belong to some functional space and $S$ is a linear operator. We provide the asymptotic mean square prediction…

Statistics Theory · Mathematics 2011-02-14 Christophe Crambes , André Mas

This paper provides refined versions of some known functional central limit theorems for conditional Poisson sampling which are more suitable for applications. The theorems presented in this paper are generalizations of some results that…

Statistics Theory · Mathematics 2019-06-18 Leo Pasquazzi

We investigate a semiparametric regression model where one gets noisy non linear non invertible functions of the observations. We focus on the application to bearings-only tracking. We first investigate the least squares estimator and prove…

Statistics Theory · Mathematics 2008-12-17 Elisabeth Gassiat , Benoit Landelle

In this paper, we study estimation of certain integral functionals of one or two densities with samples from stationary m-dependent sequences. We consider two types of U-statistic estimators for these functionals that are functions of the…

Statistics Theory · Mathematics 2013-09-20 David Källberg , Oleg Seleznjev

In the era of deep learning, understanding over-fitting phenomenon becomes increasingly important. It is observed that carefully designed deep neural networks achieve small testing error even when the training error is close to zero. One…

Machine Learning · Statistics 2018-12-04 Yue Xing , Qifan Song , Guang Cheng