English
Related papers

Related papers: Large deviations for conditionally Gaussian proces…

200 papers

One goal in Bayesian machine learning is to encode prior knowledge into prior distributions, to model data efficiently. We consider prior knowledge from systems of linear partial differential equations together with their boundary…

Machine Learning · Computer Science 2021-02-16 Markus Lange-Hegermann

We study large deviations for the current of one-dimensional stochastic particle systems with periodic boundary conditions. Following a recent approach based on an earlier result by Jensen and Varadhan, we compare several candidates for…

Statistical Mechanics · Physics 2018-10-02 Paul Chleboun , Stefan Grosskinsky , Andrea Pizzoferrato

We obtain large deviations theorems for nonconventional sums with underlying process being a Markov process satisfying the Doeblin condition or a dynamical system such as subshift of finite type or hyperbolic or expanding transformation.

Probability · Mathematics 2013-02-21 Yuri Kifer , S. R. S. Varadhan

This paper explores certain kinds of empirical process with respect to the components of multivariate Gaussian. We put forward some finite sample bounds which hold for multivariate Gaussian under general dependence. We give necessary and…

Probability · Mathematics 2020-07-03 Jikai Hou

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Extensions and variants are given for the well-known comparison principle for Gaussian processes based on ordering by pairwise distance.

Probability · Mathematics 2007-05-23 Richard A. Vitale

Neural Processes (NPs; Garnelo et al., 2018a,b) are a rich class of models for meta-learning that map data sets directly to predictive stochastic processes. We provide a rigorous analysis of the standard maximum-likelihood objective used to…

Machine Learning · Statistics 2021-01-12 Wessel P. Bruinsma , James Requeima , Andrew Y. K. Foong , Jonathan Gordon , Richard E. Turner

Gaussian processes retain the linear model either as a special case, or in the limit. We show how this relationship can be exploited when the data are at least partially linear. However from the perspective of the Bayesian posterior, the…

Methodology · Statistics 2008-07-13 Robert B. Gramacy , Herbert K. H. Lee

We study the persistence probability of a centered stationary Gaussian process on $\mathbb{Z}$ or $\mathbb{R}$, that is, its probability to remain positive for a long time. We describe the delicate interplay between this probability and the…

Probability · Mathematics 2020-08-05 Naomi Feldheim , Ohad Feldheim , Shahaf Nitzan

In this short note we study the asymptotic behaviour of the minima over compact intervals of Gaussian processes, whose paths are not necessarily smooth. We show that, beyond the logarithmic large deviation Gaussian estimates, this problem…

Probability · Mathematics 2019-08-27 Zhixin Wu , Arijit Chakrabarty , Gennady Samorodnitsky

The theory of sparse stochastic processes offers a broad class of statistical models to study signals. In this framework, signals are represented as realizations of random processes that are solution of linear stochastic differential…

Probability · Mathematics 2017-02-17 Julien Fageot , Virginie Uhlmann , Michael Unser

This thesis focuses on Bayesian optimization with the improvements coming from two aspects:(i) the use of derivative information to accelerate the optimization convergence; and (ii) the consideration of scalable GPs for handling massive…

Machine Learning · Computer Science 2024-12-09 Ang Yang

We formulate the large deviations for a class of two scale chemical kinetic processes motivated from biological applications. The result is successfully applied to treat a genetic switching model with positive feedbacks. The corresponding…

Probability · Mathematics 2016-04-05 Tiejun Li , Feng Lin

Gaussian processes constitute a very powerful and well-understood method for non-parametric regression and classification. In the classical framework, the training data consists of deterministic vector-valued inputs and the corresponding…

Systems and Control · Computer Science 2018-09-26 Maxim Dolgov , Uwe D. Hanebeck

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

The theory of large deviations is concerned with the exponential decay of probabilities of large fluctuations in random systems. These probabilities are important in many fields of study, including statistics, finance, and engineering, as…

Statistical Mechanics · Physics 2009-08-20 Hugo Touchette

We introduce a new interpretation of sparse variational approximations for Gaussian processes using inducing points, which can lead to more scalable algorithms than previous methods. It is based on decomposing a Gaussian process as a sum of…

Machine Learning · Statistics 2024-02-27 Jiaxin Shi , Michalis K. Titsias , Andriy Mnih

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

The large deviation principle is established for the distributions of a class of generalized stochastic porous media equations for both small noise and short time.

Probability · Mathematics 2007-05-23 Michael Röckner , Feng-Yu Wang , Liming Wu