English
Related papers

Related papers: Posterior contraction rates for constrained deep G…

200 papers

We study posterior contraction rates for a class of deep Gaussian process priors applied to the nonparametric regression problem under a general composition assumption on the regression function. It is shown that the contraction rates can…

Statistics Theory · Mathematics 2022-08-16 Gianluca Finocchio , Johannes Schmidt-Hieber

We derive rates of contraction of posterior distributions on nonparametric or semiparametric models based on Gaussian processes. The rate of contraction is shown to depend on the position of the true parameter relative to the reproducing…

Statistics Theory · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

This paper considers the posterior contraction of non-parametric Bayesian inference on non-homogeneous Poisson processes. We consider the quality of inference on a rate function $\lambda$, given non-identically distributed realisations,…

Statistics Theory · Mathematics 2019-06-26 James A. Grant , David S. Leslie

The frequentist behavior of nonparametric Bayes estimates, more specifically, rates of contraction of the posterior distributions to shrinking $L^r$-norm neighborhoods, $1\le r\le\infty$, of the unknown parameter, are studied. A theorem for…

Statistics Theory · Mathematics 2012-03-12 Evarist Giné , Richard Nickl

Gaussian processes are used in many machine learning applications that rely on uncertainty quantification. Recently, computational tools for working with these models in geometric settings, such as when inputs lie on a Riemannian manifold,…

Machine Learning · Statistics 2023-10-31 Paul Rosa , Viacheslav Borovitskiy , Alexander Terenin , Judith Rousseau

We introduce constrained Gaussian process (CGP), a Gaussian process model for random functions that allows easy placement of mathematical constrains (e.g., non-negativity, monotonicity, etc) on its sample functions. CGP comes with…

Statistics Theory · Mathematics 2019-04-23 Jeremiah Zhe Liu

Given a sample of a Poisson point process with intensity $\lambda_f(x,y) = n \mathbf{1}(f(x) \leq y),$ we study recovery of the boundary function $f$ from a nonparametric Bayes perspective. Because of the irregularity of this model, the…

Statistics Theory · Mathematics 2020-06-15 Markus Reiss , Johannes Schmidt-Hieber

We rigorously prove that deep Gaussian process priors can outperform Gaussian process priors if the target function has a compositional structure. To this end, we study information-theoretic lower bounds for posterior contraction rates for…

Machine Learning · Statistics 2022-09-28 Matteo Giordano , Kolyan Ray , Johannes Schmidt-Hieber

We investigate the problem of deriving posterior concentration rates under different loss functions in nonparametric Bayes. We first provide a lower bound on posterior coverages of shrinking neighbourhoods that relates the metric or loss…

Statistics Theory · Mathematics 2015-11-06 Marc Hoffmann , Judith Rousseau , Johannes Schmidt-Hieber

We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…

Statistics Theory · Mathematics 2009-09-29 Aad van der Vaart , Harry van Zanten

We study posterior rates of contraction in Gaussian process regression with unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen--Lo\'{e}ve…

Statistics Theory · Mathematics 2015-10-06 Anirban Bhattacharya , Debdeep Pati

We consider a Bayesian nonparametric approach to a family of linear inverse problems in a separable Hilbert space setting with Gaussian noise. We assume Gaussian priors, which are conjugate to the model, and present a method of identifying…

Statistics Theory · Mathematics 2013-08-05 Sergios Agapiou , Stig Larsson , Andrew M. Stuart

We consider a family of infinite dimensional product measures with tails between Gaussian and exponential, which we call $p$-exponential measures. We study their measure-theoretic properties and in particular their concentration. Our…

Statistics Theory · Mathematics 2020-10-09 Sergios Agapiou , Masoumeh Dashti , Tapio Helin

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

The nonparametric regression model with normal errors has been extensively studied, both from the frequentist and Bayesian viewpoint. A central result in Bayesian nonparametrics is that under assumptions on the prior, the data-generating…

Statistics Theory · Mathematics 2025-12-24 Paul Rosa

We study nonparametric Bayesian inference for the intensity function of a covariate-driven point process. We extend recent results from the literature, showing that a wide class of Gaussian priors, combined with flexible link functions,…

Statistics Theory · Mathematics 2025-05-27 Patric Dolmeta , Matteo Giordano

We derive the posterior contraction rate for non-parametric Bayesian estimation of the intensity function of a Poisson point process.

Statistics Theory · Mathematics 2018-04-17 Shota Gugushvili , Peter Spreij

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in…

Statistics Theory · Mathematics 2011-09-26 Debdeep Pati , Anirban Bhattacharya , David B. Dunson

In nonparameteric Bayesian approaches, Gaussian stochastic processes can serve as priors on real-valued function spaces. Existing literature on the posterior convergence rates under Gaussian process priors shows that it is possible to…

Statistics Theory · Mathematics 2025-07-11 Xiao Fang , Anindya Bhadra
‹ Prev 1 2 3 10 Next ›