English
Related papers

Related papers: Posterior contraction in Gaussian process regressi…

200 papers

In Bayesian statistics, posterior contraction rates (PCRs) quantify the speed at which the posterior distribution concentrates on arbitrarily small neighborhoods of a true model, in a suitable way, as the sample size goes to infinity. In…

Statistics Theory · Mathematics 2023-09-07 Emanuele Dolera , Stefano Favaro , Edoardo Mainini

Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-wise and…

Statistics Theory · Mathematics 2017-08-17 Yun Yang , Anirban Bhattacharya , Debdeep Pati

The autocovariance and cross-covariance functions naturally appear in many time series procedures (e.g., autoregression or prediction). Under assumptions, empirical versions of the autocovariance and cross-covariance are asymptotically…

Statistics Theory · Mathematics 2023-05-09 Andreas Anastasiou , Tobias Kley

We derive quantitative bounds on the rate of convergence in $L^1$ Wasserstein distance of general M-estimators, with an almost sharp (up to a logarithmic term) behavior in the number of observations. We focus on situations where the…

Statistics Theory · Mathematics 2021-11-19 François Bachoc , Max Fathi

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in…

Statistics Theory · Mathematics 2011-09-26 Debdeep Pati , Anirban Bhattacharya , David B. Dunson

The Poisson model is frequently employed to describe count data, but in a Bayesian context it leads to an analytically intractable posterior probability distribution. In this work, we analyze a variational Gaussian approximation to the…

Numerical Analysis · Mathematics 2018-02-14 Simon Arridge , Kazufumi Ito , Bangti Jin , Chen Zhang

In a general class of Bayesian nonparametric models, we prove that the posterior distribution can be asymptotically approximated by a Gaussian process. Our results apply to nonparametric exponential family that contains both Gaussian and…

Statistics Theory · Mathematics 2017-11-01 Zuofeng Shang , Guang Cheng

Recent works have shown an interest in investigating the frequentist asymptotic properties of Bayesian procedures for high-dimensional linear models under sparsity constraints. However, there exists a gap in the literature regarding…

Statistics Theory · Mathematics 2025-09-23 Marion Naveau , Maud Delattre , Laure Sansonnet

We consider Bayesian inference of banded covariance matrices and propose a post-processed posterior. The post-processing of the posterior consists of two steps. In the first step, posterior samples are obtained from the conjugate…

Statistics Theory · Mathematics 2020-11-26 Kwangmin Lee , Kyoungjae Lee , Jaeyong Lee

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Gaussian process regression techniques have been used in fluid mechanics for the reconstruction of flow fields from a reduction-of-dimension perspective. A main ingredient in this setting is the construction of adapted covariance functions,…

Fluid Dynamics · Physics 2026-01-13 Adrian Padilla-Segarra , Pascal Noble , Olivier Roustant , Éric Savin

We rigorously prove that deep Gaussian process priors can outperform Gaussian process priors if the target function has a compositional structure. To this end, we study information-theoretic lower bounds for posterior contraction rates for…

Machine Learning · Statistics 2022-09-28 Matteo Giordano , Kolyan Ray , Johannes Schmidt-Hieber

We review definitions and properties of reproducing kernel Hilbert spaces attached to Gaussian variables and processes, with a view to applications in nonparametric Bayesian statistics using Gaussian priors. The rate of contraction of…

Functional Analysis · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

We consider a Bayesian nonparametric approach to a family of linear inverse problems in a separable Hilbert space setting with Gaussian noise. We assume Gaussian priors, which are conjugate to the model, and present a method of identifying…

Statistics Theory · Mathematics 2013-08-05 Sergios Agapiou , Stig Larsson , Andrew M. Stuart

We study the use of Gaussian process emulators to approximate the parameter-to-observation map or the negative log-likelihood in Bayesian inverse problems. We prove error bounds on the Hellinger distance between the true posterior…

Numerical Analysis · Mathematics 2024-10-01 Andrew M. Stuart , Aretha L. Teckentrup

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

We propose a projected Wasserstein gradient descent method (pWGD) for high-dimensional Bayesian inference problems. The underlying density function of a particle system of WGD is approximated by kernel density estimation (KDE), which faces…

Machine Learning · Computer Science 2021-02-16 Yifei Wang , Peng Chen , Wuchen Li

This paper is a continuation of work arXiv:2006.09583 devoted to establishment of the convergence rate in the strong invariance principle for cumulative processes. We establish optimal rate of convergence for the case when regeneration…

Probability · Mathematics 2020-07-31 Elena Bashtova , Alexey Shashkin

Regularized least-squares (kernel-ridge / Gaussian process) regression is a fundamental algorithm of statistics and machine learning. Because generic algorithms for the exact solution have cubic complexity in the number of datapoints, large…

Machine Learning · Computer Science 2019-11-15 Simon Bartels , Philipp Hennig

Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian…

Methodology · Statistics 2018-10-30 Jize Zhang , Lizhen Lin