English
Related papers

Related papers: Constraining Gaussian Processes to Systems of Line…

200 papers

This work describes the implementation of a data-driven approach for the reduction of the complexity of parametrical partial differential equations (PDEs) employing Proper Orthogonal Decomposition (POD) and Gaussian Process Regression…

Numerical Analysis · Mathematics 2024-01-22 Giulio Ortali , Nicola Demo , Gianluigi Rozza

Nonstationary Gaussian processes (GPs) are essential for modeling complex, locally heterogeneous spatial data. A common modeling approach is the spatial deformation method that warps the domain to recover isotropy. However, this static…

Machine Learning · Computer Science 2026-05-01 Minghao Gu , Weizhi Lin , Qiang Huang

Deep Gaussian processes (DGPs) provide a rich class of models that can better represent functions with varying regimes or sharp changes, compared to conventional GPs. In this work, we propose a novel inference method for DGPs for computer…

Machine Learning · Statistics 2022-08-18 Deyu Ming , Daniel Williamson , Serge Guillas

Parametric partial differential equations (PDEs) serve as fundamental mathematical tools for modeling complex physical phenomena, yet repeated high-fidelity numerical simulations across parameter spaces remain computationally prohibitive.…

Machine Learning · Statistics 2026-04-08 Pucheng Tang , Hongqiao Wang , Wenzhou Lin , Qian Chen , Heng Yong

Gaussian processes (GPs), or distributions over arbitrary functions in a continuous domain, can be generalized to the multi-output case: a linear model of coregionalization (LMC) is one approach. LMCs estimate and exploit correlations…

Machine Learning · Statistics 2017-10-24 Vladimir Feinberg , Li-Fang Cheng , Kai Li , Barbara E Engelhardt

Linear partial differential equations (PDEs) are an important, widely applied class of mechanistic models, describing physical processes such as heat transfer, electromagnetism, and wave propagation. In practice, specialized numerical…

Machine Learning · Computer Science 2024-04-30 Marvin Pförtner , Ingo Steinwart , Philipp Hennig , Jonathan Wenger

Gaussian processes (GPs) are canonical as surrogates for computer experiments because they enjoy a degree of analytic tractability. But that breaks when the response surface is constrained, say to be monotonic. Here, we provide a mono-GP…

Computation · Statistics 2026-01-28 Steven D. Barnett , Lauren J. Beesley , Annie S. Booth , Robert B. Gramacy , Dave Osthus

Out-of-distribution (OOD) generalization has long been a challenging problem that remains largely unsolved. Gaussian processes (GP), as popular probabilistic model classes, especially in the small data regime, presume strong OOD…

Machine Learning · Computer Science 2023-12-19 Xilong Zhao , Siyuan Bian , Yaoyun Zhang , Yuliang Zhang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

We algorithmically construct multi-output Gaussian process priors which satisfy linear differential equations. Our approach attempts to parametrize all solutions of the equations using Gr\"obner bases. If successful, a push forward Gaussian…

Machine Learning · Statistics 2019-01-07 Markus Lange-Hegermann

Machine learning based solvers have garnered much attention in physical simulation and scientific computing, with a prominent example, physics-informed neural networks (PINNs). However, PINNs often struggle to solve high-frequency and…

Machine Learning · Computer Science 2024-03-20 Shikai Fang , Madison Cooley , Da Long , Shibo Li , Robert Kirby , Shandian Zhe

Gaussian Process (GP) models provide a flexible framework for prediction and uncertainty quantification. For most covariance functions, however, exact GP prediction with $n$ points scales as $\mathcal{O}(n^3)$, making it prohibitively…

Computation · Statistics 2026-05-29 Samanyu Arora , Christopher J. Geoga

Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$…

Machine Learning · Computer Science 2018-10-30 David Eriksson , Kun Dong , Eric Hans Lee , David Bindel , Andrew Gordon Wilson

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

Quantum Physics · Physics 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

We propose a principled algorithm for robust Bayesian filtering and smoothing in nonlinear stochastic dynamic systems when both the transition function and the measurement function are described by non-parametric Gaussian process (GP)…

Systems and Control · Computer Science 2012-08-13 Marc Peter Deisenroth , Ryan Turner , Marco F. Huber , Uwe D. Hanebeck , Carl Edward Rasmussen

In this paper we introduce deep Gaussian process (GP) models. Deep GPs are a deep belief network based on Gaussian process mappings. The data is modeled as the output of a multivariate GP. The inputs to that Gaussian process are then…

Machine Learning · Statistics 2013-03-26 Andreas C. Damianou , Neil D. Lawrence

In geostatistics, traditional spatial models often rely on the Gaussian Process (GP) to fit stationary covariances to data. It is well known that this approach becomes computationally infeasible when dealing with large data volumes,…

Computation · Statistics 2024-09-17 Antony Sikorski , Daniel McKenzie , Douglas Nychka

Partial differential equations (PDEs) are important tools to model physical systems and including them into machine learning models is an important way of incorporating physical knowledge. Given any system of linear PDEs with constant…

Machine Learning · Statistics 2023-11-03 Marc Härkönen , Markus Lange-Hegermann , Bogdan Raiţă

The key task of physical simulation is to solve partial differential equations (PDEs) on discretized domains, which is known to be costly. In particular, high-fidelity solutions are much more expensive than low-fidelity ones. To reduce the…

Machine Learning · Statistics 2020-06-11 Zheng Wang , Wei Xing , Robert Kirby , Shandian Zhe

The understanding and modeling of complex physical phenomena through dynamical systems has historically driven scientific progress, as it provides the tools for predicting the behavior of different systems under diverse conditions through…

Machine Learning · Computer Science 2025-10-03 Karin L. Yu , Eleni Chatzi , Georgios Kissas