English
Related papers

Related papers: LDP for the covariance process in fully connected …

200 papers

In this paper, we focus on two kinds of large deviations principles (LDPs) of the invariant measures of Langevin equations and their numerical methods, as the noise intensity $\epsilon\to 0$ and the dissipation intensity $\nu\to\infty$…

Numerical Analysis · Mathematics 2020-09-29 Jialin Hong , Diancong Jin , Derui Sheng , Liying Sun

We introduce Latent Gaussian Process Regression which is a latent variable extension allowing modelling of non-stationary multi-modal processes using GPs. The approach is built on extending the input space of a regression problem with a…

Machine Learning · Statistics 2017-09-19 Erik Bodin , Neill D. F. Campbell , Carl Henrik Ek

We prove large deviation principles (LDPs) for random matrices in the orthogonal group and Stiefel manifold, determining both the speed and good convex rate functions that are explicitly given in terms of certain log-determinants of…

Probability · Mathematics 2022-11-04 Zakhar Kabluchko , Joscha Prochno

This work proposes a compositional data-driven technique for the construction of finite Markov decision processes (MDPs) for large-scale stochastic networks with unknown mathematical models. Our proposed framework leverages dissipativity…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Abolfazl Lavaei

This work introduces the concept of parametric Gaussian processes (PGPs), which is built upon the seemingly self-contradictory idea of making Gaussian processes parametric. Parametric Gaussian processes, by construction, are designed to…

Machine Learning · Statistics 2017-05-08 Maziar Raissi

In this paper, we present a comprehensive analysis of the posterior covariance field in Gaussian processes, with applications to the posterior covariance matrix. The analysis is based on the Gaussian prior covariance but the approach also…

Machine Learning · Statistics 2025-04-03 Difeng Cai , Edmond Chow , Yuanzhe Xi

Combining Gaussian processes with the expressive power of deep neural networks is commonly done nowadays through deep kernel learning (DKL). Unfortunately, due to the kernel optimization process, this often results in losing their Bayesian…

Machine Learning · Computer Science 2023-05-16 Idan Achituve , Gal Chechik , Ethan Fetaya

From the classical and influential works of Neal (1996), it is known that the infinite width scaling limit of a Bayesian neural network with one hidden layer is a Gaussian process, when the network weights have bounded prior variance.…

Machine Learning · Statistics 2024-06-06 Jorge Loría , Anindya Bhadra

We construct flexible likelihoods for multi-output Gaussian process models that leverage neural networks as components. We make use of sparse variational inference methods to enable scalable approximate inference for the resulting class of…

Machine Learning · Statistics 2019-06-03 Martin Jankowiak , Jacob Gardner

This work analyzes Graph Neural Networks, a generalization of Fully-Connected Deep Neural Nets on Graph structured data, when their width, that is the number of nodes in each fullyconnected layer is increasing to infinity. Infinite Width…

Machine Learning · Computer Science 2023-11-21 Yunus Cobanoglu

We continue the development, started in of the asymptotic description of certain stochastic neural networks. We use the Large Deviation Principle (LDP) and the good rate function H announced there to prove that H has a unique minimum mu_e,…

Probability · Mathematics 2014-07-10 Olivier Faugeras , James MacLaurin

We present a series of new differentially private (DP) algorithms with dimension-independent margin guarantees. For the family of linear hypotheses, we give a pure DP learning algorithm that benefits from relative deviation margin…

Machine Learning · Computer Science 2022-04-25 Raef Bassily , Mehryar Mohri , Ananda Theertha Suresh

This work concerns about multiscale multivalued McKean-Vlasov stochastic systems. First of all, we use a contractive mapping principle to establish the well-posedness for fully coupled multivalued McKean-Vlasov stochastic systems under…

Probability · Mathematics 2025-09-30 Huijie Qiao

We establish novel rates for the Gaussian approximation of random deep neural networks with Gaussian parameters (weights and biases) and Lipschitz activation functions, in the wide limit. Our bounds apply for the joint output of a network…

Statistics Theory · Mathematics 2023-12-20 Dario Trevisan

We prove the small-noise large deviation principle (LDP) for stochastic evolution equations in an $L^2$-setting. As the coefficients are allowed to be non-coercive, our framework encompasses a much broader scope than variational settings.…

Probability · Mathematics 2025-12-23 Esmée Theewis

We provide a new approach to approximate emulation of large computer experiments. By focusing expressly on desirable properties of the predictive equations, we derive a family of local sequential design schemes that dynamically define the…

Methodology · Statistics 2014-10-13 Robert B. Gramacy , Daniel W. Apley

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

Machine Learning · Computer Science 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

In this paper we cast the well-known convolutional neural network in a Gaussian process perspective. In this way we hope to gain additional insights into the performance of convolutional networks, in particular understand under what…

Machine Learning · Statistics 2019-01-10 Anastasia Borovykh

Deep Gaussian processes (DGPs) provide a rich class of models that can better represent functions with varying regimes or sharp changes, compared to conventional GPs. In this work, we propose a novel inference method for DGPs for computer…

Machine Learning · Statistics 2022-08-18 Deyu Ming , Daniel Williamson , Serge Guillas

We consider a dynamic Erd\H{o}s-R\'enyi random graph (ERRG) on $n$ vertices in which each edge switches on at rate $\lambda$ and switches off at rate $\mu$, independently of other edges. The focus is on the analysis of the evolution of the…

Probability · Mathematics 2020-09-29 Peter Braunsteins , Frank den Hollander , Michel Mandjes