English
Related papers

Related papers: Efficient Estimation of Smooth Functionals in Gaus…

200 papers

In state space models, smoothing refers to the task of estimating a latent stochastic process given noisy measurements related to the process. We propose an unbiased estimator of smoothing expectations. The lack-of-bias property has…

Methodology · Statistics 2018-09-07 Pierre E. Jacob , Fredrik Lindsten , Thomas B. Schön

Bootstrap smoothed (bagged) estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. Efron, 2014, derived a widely applicable formula for a delta method approximation to the standard…

Methodology · Statistics 2019-07-11 Paul Kabaila , Christeen Wijethunga

We study Hessian estimators for functions defined over an $n$-dimensional complete analytic Riemannian manifold. We introduce new stochastic zeroth-order Hessian estimators using $O (1)$ function evaluations. We show that, for an analytic…

Machine Learning · Statistics 2022-09-28 Tianyu Wang

This paper studies a Bayesian approach to non-asymptotic minimax adaptation in nonparametric estimation. Estimating an input function on the basis of output functions in a Gaussian white-noise model is discussed. The input function is…

Statistics Theory · Mathematics 2018-08-30 Keisuke Yano , Fumiyasu Komaki

This article introduces a method for estimating the smoothness of a stationary, isotropic Gaussian random field from irregularly spaced data. This involves novel constructions of higher-order quadratic variations and the establishment of…

Statistics Theory · Mathematics 2015-10-30 Wei-Liem Loh

Smoothed functional (SF) schemes for gradient estimation are known to be efficient in stochastic optimization algorithms, specially when the objective is to improve the performance of a stochastic system. However, the performance of these…

Information Theory · Computer Science 2014-07-04 Debarghya Ghoshdastidar , Ambedkar Dukkipati , Shalabh Bhatnagar

We consider the problem of estimation of a linear functional in the Gaussian sequence model where the unknown vector theta in R^d belongs to a class of s-sparse vectors with unknown s. We suggest an adaptive estimator achieving a…

Statistics Theory · Mathematics 2017-10-09 Olivier Collier , Laëtitia Comminges , Alexandre B. Tsybakov , Nicolas Verzélen

This paper proposes a new formulation of functional Gaussian Process regression in manifolds, based on an Empirical Bayes approach, in the spatiotemporal random field context. We apply the machinery of tight Gaussian measures in separable…

Machine Learning · Statistics 2026-03-24 MD Ruiz-Medina , AE Madrid , A Torres-Signes , JM Angulo

The problem of the mean-square optimal linear estimation of the functional $A\xi=\ \int\limits_{R^s}a(t)\xi(-t)dt,$ which depends on the unknown values of stochastic stationary process $\xi(t)$ from observations of the process…

Statistics Theory · Mathematics 2025-10-21 Mykhailo Moklyachuk , Maria Sidei

The problem of estimating a high-dimensional sparse vector $\boldsymbol{\theta} \in \mathbb{R}^n$ from an observation in i.i.d. Gaussian noise is considered. The performance is measured using squared-error loss. An empirical Bayes shrinkage…

Information Theory · Computer Science 2018-12-31 Pavan Srinath , Ramji Venkataramanan

We consider the estimation of quadratic functionals in a Gaussian sequence model where the eigenvalues are supposed to be unknown and accessible through noisy observations only. Imposing smoothness assumptions both on the signal and the…

Statistics Theory · Mathematics 2019-07-16 Martin Kroll

We consider in this paper a Gaussian sequence model of observations $Y_i$, $i\geq 1$ having mean (or signal) $\theta_i$ and variance $\sigma_i$ which is growing polynomially like $i^\gamma$, $\gamma >0$. This model describes a large panel…

Statistics Theory · Mathematics 2009-02-16 Cristina Butucea , Katia Méziani

This paper proposes and analyzes fully data driven methods for inference about the mean function of a stochastic process from a sample of independent trajectories of the process, observed at discrete time points and corrupted by additive…

Methodology · Statistics 2009-05-20 F. Bunea , M. H. Wegkamp , A. E. Ivanescu

We study the problem of estimation of the value N_gamma(\theta) = sum(i=1)^d |\theta_i|^gamma for 0 < gamma <= 1 based on the observations y_i = \theta_i + \epsilon\xi_i, i = 1,...,d, where \theta = (\theta_1,...,\theta_d) are unknown…

Statistics Theory · Mathematics 2019-10-08 Olivier Collier , Laëtitia Comminges , Alexandre B. Tsybakov

Given a nonconvex function that is an average of $n$ smooth functions, we design stochastic first-order methods to find its approximate stationary points. The convergence of our new methods depends on the smallest (negative) eigenvalue…

Optimization and Control · Mathematics 2018-09-28 Zeyuan Allen-Zhu

We consider the regression model with errors-in-variables where we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f(X)+\xi, Z=X+\sigma\epsilon$, involving independent and unobserved random variables $X,\xi,\epsilon$. The density $g$ of…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Marie-Luce Taupin

The problem of the mean-square optimal linear estimation of the functional $A\xi=\ \int\limits_{R^s}a(t)\xi(-t)dt,$ which depends on the unknown values of stochastic stationary process $\xi(t)$ from observations of the process…

Statistics Theory · Mathematics 2024-02-13 Mikhail Moklyachuk , Maria Sidei

Motivated by applications in genomics, this paper studies the problem of optimal estimation of a quadratic functional of two normal mean vectors, $Q(\mu, \theta) = \frac{1}{n}\sum_{i=1}^n\mu_i^2\theta_i^2$, with a particular focus on the…

Statistics Theory · Mathematics 2015-05-08 T. Tony Cai , Xin Lu Tan

In this paper the notion of an abstract square function (estimate) is introduced as an operator X to gamma (H; Y), where X, Y are Banach spaces, H is a Hilbert space, and gamma(H; Y) is the space of gamma-radonifying operators. By the…

Functional Analysis · Mathematics 2013-11-05 Bernhard Hermann Haak , Markus Haase

Given a nonincreasing null sequence $T = (T_j)_{j \ge 1}$ of nonnegative random variables satisfying some classical integrability assumptions and $\mathbb{E}(\sum_{j}T_{j}^{\alpha})=1$ for some $\alpha>0$, we characterize the solutions of…

Probability · Mathematics 2021-11-11 Gerold Alsmeyer , Bastien Mallein