Related papers: Small Deviations of Smooth Stationary Gaussian Pro…
We study large deviation principles for Gaussian processes lifted to the free nilpotent group of step N. We apply this to a large class of Gaussian processes lifted to geometric rough paths. A large deviation principle for enhanced…
We investigate the relation between the small deviation problem for a symmetric $\alpha$-stable random vector in a Banach space and the metric entropy properties of the operator generating it. This generalizes former results due to Li and…
We investigate the Large Deviation behavior in small time of continuous Gaussian processes. We introduce a general procedure allowing to derive Large Deviation Principles in small time starting from the well understood context of Large…
Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…
We investigate small deviation properties of Gaussian random fields in the space $L_q(\R^N,\mu)$ where $\mu$ is an arbitrary finite compactly supported Borel measure. Of special interest are hereby "thin" measures $\mu$, i.e., those which…
We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…
We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…
This paper presents a novel variational inference framework for deriving a family of Bayesian sparse Gaussian process regression (SGPR) models whose approximations are variationally optimal with respect to the full-rank GPR model enriched…
Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…
In this paper we provide an upper bound for the conjunction probability of independent Gaussian smooth processes and then we prove that this bound is a good approximation with exponentially smaller error. Our result confirms the heuristic…
We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…
This article introduces a method for estimating the smoothness of a stationary, isotropic Gaussian random field from irregularly spaced data. This involves novel constructions of higher-order quadratic variations and the establishment of…
We investigate the large deviation behaviour of a point process sequence based on a stationary symmetric stable non-Gaussian discrete-parameter random field using the framework of Hult and Samorodnitsky (2010). Depending on the ergodic…
Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…
Lower bounds for persistence probabilities of stationary Gaussian processes in discrete time are obtained under various conditions on the spectral measure of the process. Examples are given to show that the persistence probability can decay…
We show how to use a variational approximation to the logistic function to perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert the logistic function to a Gaussian,…
Smooth random Gaussian functions play an important role in mathematical physics, a main example being the random plane wave model conjectured by Berry to give a universal description of high-energy eigenfunctions of the Laplacian on generic…
We introduce a nonparametric approach for estimating drift and diffusion functions in systems of stochastic differential equations from observations of the state vector. Gaussian processes are used as flexible models for these functions and…
Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…
Gaussian processes (GPs) are a well-known nonparametric Bayesian inference technique, but they suffer from scalability problems for large sample sizes, and their performance can degrade for non-stationary or spatially heterogeneous data. In…