English
Related papers

Related papers: Asymptotic Bounds for Smoothness Parameter Estimat…

200 papers

This article provides an introduction to the asymptotic analysis of covariance parameter estimation for Gaussian processes. Maximum likelihood estimation is considered. The aim of this introduction is to be accessible to a wide audience and…

Statistics Theory · Mathematics 2020-09-16 François Bachoc

The Matern family of covariance functions is currently the most commonly used for the analysis of geostatistical data due to its ability to describe different smoothness behaviors. Yet, in many applications the smoothness parameter is set…

Applications · Statistics 2022-08-30 Victor De Oliveira , Zifei Han

Gaussian process (GP) regression is a Bayesian nonparametric method for regression and interpolation, offering a principled way of quantifying the uncertainties of predicted function values. For the quantified uncertainties to be…

Statistics Theory · Mathematics 2025-08-22 Masha Naslidnyk , Motonobu Kanagawa , Toni Karvonen , Maren Mahsereci

The asymptotic analysis of covariance parameter estimation of Gaussian processes has been subject to intensive investigation. However, this asymptotic analysis is very scarce for non-Gaussian processes. In this paper, we study a class of…

Statistics Theory · Mathematics 2019-11-27 François Bachoc , José Bétancourt , Reinhard Furrer , Thierry Klein

In the nonparametric Gaussian sequence space model an $\ell^2$-confidence ball $C_n$ is constructed that adapts to unknown smoothness and Sobolev-norm of the infinite-dimensional parameter to be estimated. The confidence ball has exact and…

Statistics Theory · Mathematics 2015-07-10 Richard Nickl , Botond Szabó

Sobolev quantities (norms, inner products, and distances) of probability density functions are important in the theory of nonparametric statistics, but have rarely been used in practice, partly due to a lack of practical estimators. They…

Statistics Theory · Mathematics 2016-07-25 Shashank Singh , Simon S. Du , Barnabás Póczos

Non-conservative uncertainty bounds are key for both assessing an estimation algorithm's accuracy and in view of downstream tasks, such as its deployment in safety-critical contexts. In this paper, we derive a tight, non-asymptotic…

Machine Learning · Computer Science 2026-01-16 Amon Lahr , Johannes Köhler , Anna Scampicchio , Melanie N. Zeilinger

In this paper, we give sufficient conditions to establish central limit theorems for boundary estimates of Poisson point processes. The considered estimates are obtained by smoothing some bias corrected extreme values of the point process.…

Statistics Theory · Mathematics 2011-03-31 Stéphane Girard , Ludovic Menneteau

Non-parametric maximum likelihood estimation encompasses a group of classic methods to estimate distribution-associated functions from potentially censored and truncated data, with extensive applications in survival analysis. These methods,…

Methodology · Statistics 2021-08-05 Justin D. Tubbs , Lane Guolan Chen , Thuan Quoc Thach , Pak C. Sham

In this work, we investigate Gaussian process regression used to recover a function based on noisy observations. We derive upper and lower error bounds for Gaussian process regression with possibly misspecified correlation functions. The…

Statistics Theory · Mathematics 2022-07-20 Wenjia Wang , Bing-Yi Jing

Covariance parameter estimation of Gaussian processes is analyzed in an asymptotic framework. The spatial sampling is a randomly perturbed regular grid and its deviation from the perfect regular grid is controlled by a single scalar…

Statistics Theory · Mathematics 2014-12-09 François Bachoc

Ordinary differential equations (ODEs) are commonly used to model dynamic behavior of a system. Because many parameters are unknown and have to be estimated from the observed data, there is growing interest in statistics to develop…

Statistics Theory · Mathematics 2010-01-13 Xin Qi , Hongyu Zhao

In this note, we provide upper bounds on the expectation of the supremum of empirical processes indexed by H\"older classes of any smoothness and for any distribution supported on a bounded set in $\mathbb R^d$. These results can be…

Statistics Theory · Mathematics 2020-12-18 Nicolas Schreuder

Psychiatric neuroscience is increasingly aware of the need to define psychopathology in terms of abnormal neural computation. The central tool in this endeavour is the fitting of computational models to behavioural data. The most prominent…

Quantitative Methods · Quantitative Biology 2018-03-28 Abraham Nunes , Alexander Rudiuk

The focus of this work is the convergence of non-stationary and deep Gaussian process regression. More precisely, we follow a Bayesian approach to regression or interpolation, where the prior placed on the unknown function $f$ is a…

Statistics Theory · Mathematics 2025-03-19 Conor Osborne , Aretha L. Teckentrup

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

Information Theory · Computer Science 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

Two canonical problems in geostatistics are estimating the parameters in a specified family of stochastic process models and predicting the process at new locations. A number of asymptotic results addressing these problems over a fixed…

Statistics Theory · Mathematics 2012-10-11 Cari Kaufman , Benjamin Shaby

Gaussian process (GP) regression is a fundamental tool in Bayesian statistics. It is also known as kriging and is the Bayesian counterpart to the frequentist kernel ridge regression. Most of the theoretical work on GP regression has focused…

Statistics Theory · Mathematics 2023-10-27 Simon Barthelmé , Pierre-Olivier Amblard , Nicolas Tremblay , Konstantin Usevich

We show that common choices of kernel functions for a highly accurate and massively scalable nearest-neighbour based GP regression model (GPnn: \cite{GPnn}) exhibit gradual convergence to asymptotic behaviour as dataset-size $n$ increases.…

Statistics Theory · Mathematics 2024-04-10 Anthony Stephenson , Robert Allison , Edward Pyzer-Knapp

We establish in this work approximation results of deep neural networks for smooth functions measured in Sobolev norms, motivated by recent development of numerical solvers for partial differential equations using deep neural networks. {Our…

Numerical Analysis · Mathematics 2022-07-25 Sean Hon , Haizhao Yang