English
Related papers

Related papers: Bayesian Gaussian Process ODEs via Double Normaliz…

200 papers

Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning. We develop Variational Auto-Regressive Gaussian Processes (VAR-GPs), a principled posterior updating…

Machine Learning · Statistics 2021-06-15 Sanyam Kapoor , Theofanis Karaletsos , Thang D. Bui

Studying the dynamics of open quantum systems can enable breakthroughs both in fundamental physics and applications to quantum engineering and quantum computation. Since the density matrix $\rho$, which is the fundamental description for…

Quantum Physics · Physics 2023-06-08 Owen Dugan , Peter Y. Lu , Rumen Dangovski , Di Luo , Marin Soljačić

This article shortly introduces Gaussian processes (GP) as a new approach for modelling time series in the field of blazar physics. In the second part of the paper, recent results from an application of GP modelling to the multi-wavelength…

High Energy Astrophysical Phenomena · Physics 2017-03-08 V. Karamanavis

Due to the increasing complexity of technical systems, accurate first principle models can often not be obtained. Supervised machine learning can mitigate this issue by inferring models from measurement data. Gaussian process regression is…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Armin Lederer , Jonas Umlauft , Sandra Hirche

We introduce an entirely new class of high-order methods for computational fluid dynamics (CFD) based on the Gaussian Process (GP) family of stochastic functions. Our approach is to use kernel-based GP prediction methods to…

Computational Physics · Physics 2017-05-16 Adam Reyes , Dongwook Lee , Carlo Graziani , Petros Tzeferacos

Complex-valued Gaussian processes are commonly used in Bayesian frequency-domain system identification as prior models for regression. If each realization of such a process were an $H_\infty$ function with probability one, then the same…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Alex Devonport , Peter Seiler , Murat Arcak

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

Machine Learning · Computer Science 2021-09-09 Sarem Seitz

Neural networks often make predictions relying on the spurious correlations from the datasets rather than the intrinsic properties of the task of interest, facing sharp degradation on out-of-distribution (OOD) test data. Existing de-bias…

Machine Learning · Computer Science 2023-01-20 Xinzhe Han , Shuhui Wang , Chi Su , Qingming Huang , Qi Tian

Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on…

Methodology · Statistics 2023-10-25 Mingwei Xu , Samuel W. K. Wong , Peijun Sang

A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of…

Machine Learning · Computer Science 2021-12-10 Derek Onken , Samy Wu Fung , Xingjian Li , Lars Ruthotto

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

Machine Learning · Statistics 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Stokes inversion techniques are very powerful methods for obtaining information on the thermodynamic and magnetic properties of solar and stellar atmospheres. In recent years, very sophisticated inversion codes have been developed that are…

Solar and Stellar Astrophysics · Physics 2022-03-23 C. J. Díaz Baso , A. Asensio Ramos , J. de la Cruz Rodríguez

Statistical physics approaches can be used to derive accurate predictions for the performance of inference methods learning from potentially noisy data, as quantified by the learning curve defined as the average error versus number of…

Machine Learning · Statistics 2012-11-07 Matthew J. Urry , Peter Sollich

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to construct a…

Machine Learning · Statistics 2019-02-20 Steven Atkinson , Nicholas Zabaras

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are probabilistic and non-parametric…

Gradient matching with Gaussian processes is a promising tool for learning parameters of ordinary differential equations (ODE's). The essence of gradient matching is to model the prior over state variables as a Gaussian process which…

Machine Learning · Statistics 2016-10-25 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

Earth observation (EO) by airborne and satellite remote sensing and in-situ observations play a fundamental role in monitoring our planet. In the last decade, machine learning and Gaussian processes (GPs) in particular has attained…

Machine Learning · Computer Science 2020-07-03 Gustau Camps-Valls , Dino Sejdinovic , Jakob Runge , Markus Reichstein