English
Related papers

Related papers: Posterior contraction for deep Gaussian process pr…

200 papers

We study the use of a deep Gaussian process (DGP) prior in a general nonlinear inverse problem satisfying certain regularity conditions. We prove that when the data arises from a true parameter $\theta^*$ with a compositional structure, the…

Statistics Theory · Mathematics 2023-12-25 Kweku Abraham , Neil Deo

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

Gaussian process regression (GPR) is a non-parametric Bayesian technique for interpolating or fitting data. The main barrier to further uptake of this powerful tool rests in the computational costs associated with the matrices which arise…

Machine Learning · Statistics 2016-05-16 Christopher J. Moore , Alvin J. K. Chua , Christopher P. L. Berry , Jonathan R. Gair

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

Machine Learning · Statistics 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

We propose a kernel mixture of polynomials prior for Bayesian nonparametric regression. The regression function is modeled by local averages of polynomials with kernel mixture weights. We obtain the minimax-optimal rate of contraction of…

Statistics Theory · Mathematics 2018-09-17 Fangzheng Xie , Yanxun Xu

We consider Bayesian inference of banded covariance matrices and propose a post-processed posterior. The post-processing of the posterior consists of two steps. In the first step, posterior samples are obtained from the conjugate…

Statistics Theory · Mathematics 2020-11-26 Kwangmin Lee , Kyoungjae Lee , Jaeyong Lee

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

We investigate Bayesian nonparametric density estimation via orthogonal polynomial expansions in weighted Sobolev spaces. A core challenge is establishing minimax optimal posterior convergence rates, especially for densities on unbounded…

Statistics Theory · Mathematics 2026-03-20 Yiqi Luo , Xue Luo

This paper studies posterior contraction rates in multi-category logit models with priors incorporating group sparse structures. We consider a general class of logit models that includes the well-known multinomial logit models as a special…

Statistics Theory · Mathematics 2022-02-01 Seonghyun Jeong

Gaussian processes are probabilistic models that are commonly used as functional priors in machine learning. Due to their probabilistic nature, they can be used to capture the prior information on the statistics of noise, smoothness of the…

Computation · Statistics 2024-02-02 Ahmad Farooq , Cristian A. Galvis-Florez , Simo Särkkä

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

The goal of this paper is to provide theorems on convergence rates of posterior distributions that can be applied to obtain good convergence rates in the context of density estimation as well as regression. We show how to choose priors so…

Statistics Theory · Mathematics 2007-06-13 Tzee-Ming Huang

We review definitions and properties of reproducing kernel Hilbert spaces attached to Gaussian variables and processes, with a view to applications in nonparametric Bayesian statistics using Gaussian priors. The rate of contraction of…

Functional Analysis · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

We introduce a novel Bayesian estimator for the class proportion in an unlabeled dataset, based on the targeted learning framework. Our procedure requires the specification of a prior (and outputs a posterior) only for the target of…

Methodology · Statistics 2019-11-26 Iván Díaz , Oleksander Savenkov , Hooman Kamel

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based predictions on…

Machine Learning · Statistics 2014-04-08 Maurizio Filippone , Mark Girolami

We propose a novel Bayesian nonparametric method for hierarchical modelling on a set of related density functions, where grouped data in the form of samples from each density function are available. Borrowing strength across the groups is a…

Computation · Statistics 2014-10-31 G. S. Rodrigues , David J. Nott , S. A. Sisson

In this article, we investigate the problem of estimating a spatially inhomogeneous function and its derivatives in the white noise model using Besov-Laplace priors. We show that smoothness-matching priors attains minimax optimal posterior…

Statistics Theory · Mathematics 2024-11-12 Emanuele Dolera , Stefano Favaro , Matteo Giordano

Gaussian processes provide a framework for nonlinear nonparametric Bayesian inference widely applicable across science and engineering. Unfortunately, their computational burden scales cubically with the training sample size, which in the…

Machine Learning · Statistics 2021-07-16 Alec Koppel , Hrusikesha Pradhan , Ketan Rajawat

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk