English
Related papers

Related papers: Sparsifying Suprema of Gaussian Processes

200 papers

The problem of CSP sparsification asks: for a given CSP instance, what is the sparsest possible reweighting such that for every possible assignment to the instance, the number of satisfied constraints is preserved up to a factor of $1 \pm…

Data Structures and Algorithms · Computer Science 2026-02-12 Joshua Brakensiek , Venkatesan Guruswami , Aaron Putterman

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

Machine Learning · Statistics 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias

We propose an algorithm to approximate solutions of global optimization problems in Sobolev spaces that follows the spirit of Consensus-based algorithms in finite dimensions. The main ingredient are Gaussian processes. In fact, we exploit…

Optimization and Control · Mathematics 2026-03-17 Mahmoud Khatab , Claudia Totzeck

In this paper, we consider the distribution of the supremum of non-stationary Gaussian processes, and present a new theoretical result on the asymptotic behaviour of this distribution. Unlike previously known facts in this field, our main…

Probability · Mathematics 2020-05-25 Valentin Konakov , Vladimir Panov , Vladimir Piterbarg

Gaussian processes (GPs) offer a principled probabilistic model over functions, but exact inference is restricted to the linear-Gaussian regime. We establish an explicit equivalence between GPs and a class of linear diffusion models,…

For every $n\in\N$, let $X_{1n},..., X_{nn}$ be independent copies of a zero-mean Gaussian process $X_n=\{X_n(t), t\in T\}$. We describe all processes which can be obtained as limits, as $n\to\infty$, of the process $a_n(M_n-b_n)$, where…

Probability · Mathematics 2009-09-03 Zakhar Kabluchko

Gaussian process is one of the most popular non-parametric Bayesian methodologies for modeling the regression problem. It is completely determined by its mean and covariance functions. And its linear property makes it relatively…

Machine Learning · Statistics 2020-06-16 Wenqi Fang , Huiyun Li , Hui Huang , Shaobo Dang , Zhejun Huang , Zheng Wang

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

We introduce stochastic variational inference for Gaussian process models. This enables the application of Gaussian process (GP) models to data sets containing millions of data points. We show how GPs can be vari- ationally decomposed to…

Machine Learning · Computer Science 2013-09-27 James Hensman , Nicolo Fusi , Neil D. Lawrence

We revisit the problem of bounding the expected supremum of a canonical Gaussian process indexed by a convex set $T \subset \mathbf{R}^d$. We develop two decompositions for the Gaussian width, based on the geometry of the index set. The…

Probability · Mathematics 2026-03-04 Reese Pathak , Nikita Zhivotovskiy

Gaussian processes (GPs) are widely-used tools in spatial statistics and machine learning and the formulae for the mean function and covariance kernel of a GP $T u$ that is the image of another GP $u$ under a linear transformation $T$…

Probability · Mathematics 2024-10-08 Tadashi Matsumoto , T. J. Sullivan

In this paper, we study the asymptotic behavior of supremum distribution of some classes of iterated stochastic processes $\{X(Y(t)) : t \in [0, \infty)\}$, where $\{X(t) : t \in \mathbb{R} \}$ is a centered Gaussian process and $\{Y(t): t…

Probability · Mathematics 2016-04-22 Marek Arendarczyk

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

We propose a simple generalization of the matrix resolvent to a resolvent for real symmetric tensors $T\in \otimes^p \mathbb{R}^N$ of order $p\ge 3$. The tensor resolvent yields an integral representation for a class of tensor invariants…

Mathematical Physics · Physics 2020-04-15 Razvan Gurau

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

Machine Learning · Computer Science 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

Stochastic processes wherein the size of the state space is changing as a function of time offer models for the emergence of scale-invariant features observed in complex systems. I consider such a sample-space reducing (SSR) stochastic…

Statistical Mechanics · Physics 2016-05-04 Avinash Chand Yadav

Gaussian processes are distributions over functions that are versatile and mathematically convenient priors in Bayesian modelling. However, their use is often impeded for data with large numbers of observations, $N$, due to the cubic (in…

Machine Learning · Statistics 2020-08-04 David R. Burt , Carl Edward Rasmussen , Mark van der Wilk

Let $\{X(\mathbf{t}):\mathbf{t}=(t_1, t_2, \ldots, t_d)\in[0,\infty)^d\}$ be a centered stationary Gaussian field with almost surely continuous sample paths, unit variance and correlation function $r$ satisfying conditions $r(\mathbf{t})<1$…

Probability · Mathematics 2018-05-14 Natalia Soja-Kukieła

We establish a sprinkled decoupling inequality for increasing events of Gaussian vectors with an error that depends only on the maximum pairwise correlation. As an application we prove the non-triviality of the percolation phase transition…

Probability · Mathematics 2023-07-18 Stephen Muirhead