English
Related papers

Related papers: Inferring the unknown parameters in Differential E…

200 papers

We develop a framework for Gaussian processes regression constrained by boundary value problems. The framework may be applied to infer the solution of a well-posed boundary value problem with a known second-order differential operator and…

Machine Learning · Computer Science 2020-12-23 Mamikon Gulian , Ari Frankel , Laura Swiler

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

Gaussian Process (GP) regression models typically assume that residuals are Gaussian and have the same variance for all observations. However, applications with input-dependent noise (heteroscedastic residuals) frequently arise in practice,…

Machine Learning · Statistics 2012-12-27 Chunyi Wang , Radford M. Neal

Gaussian processes (GPs) are non-parametric Bayesian models that are widely used for diverse prediction tasks. Previous work in adding strong privacy protection to GPs via differential privacy (DP) has been limited to protecting only the…

Machine Learning · Computer Science 2021-11-12 Antti Honkela , Laila Melkas

A common task is the determination of system parameters from spectroscopy, where one compares the experimental spectrum with calculated spectra, that depend on the desired parameters. Here we discuss an approach based on a machine learning…

Quantum Physics · Physics 2022-05-04 Farhad Taher-Ghahramani , Fulu Zheng , Alexander Eisfeld

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

Machine Learning · Computer Science 2024-04-17 Dongwei Ye , Mengwu Guo

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\theta$ of physical significance which…

Statistics Theory · Mathematics 2014-03-05 Prithwish Bhaumik , Subhashis Ghosal

Parameter inference in ordinary differential equations is an important problem in many applied sciences and in engineering, especially in a data-scarce setting. In this work, we introduce a novel generative modeling approach based on…

Machine Learning · Computer Science 2019-12-06 Philippe Wenk , Gabriele Abbati , Michael A Osborne , Bernhard Schölkopf , Andreas Krause , Stefan Bauer

Mechanistic simulation models are inverted against observations in order to gain inference on modeled processes. However, with the increasing ability to collect high resolution observations, these observations represent more patterns of…

Computation · Statistics 2018-12-20 Thomas Wutzler

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a…

Machine Learning · Computer Science 2019-05-20 Issam H. Laradji , Mark Schmidt , Vladimir Pavlovic , Minyoung Kim

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

In this work, a Gaussian process regression(GPR) model incorporated with given physical information in partial differential equations(PDEs) is developed: physics-assisted Gaussian processes(PAGP). The targets of this model can be divided…

Machine Learning · Statistics 2022-04-07 Jiahao Zhang , Shiqi Zhang , Guang Lin

Gaussian processes (GPs) provide a powerful framework for extrapolation, interpolation, and noise removal in regression and classification. This paper considers constraining GPs to arbitrarily-shaped domains with boundary conditions. We…

Machine Learning · Statistics 2019-04-11 Arno Solin , Manon Kok

Model Predictive Control (MPC) of an unknown system that is modelled by Gaussian Process (GP) techniques is studied in this paper. Using GP, the variances computed during the modelling and inference processes allow us to take model…

Systems and Control · Computer Science 2016-12-06 Gang Cao , Edmund M-K Lai , Fakhrul Alam

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

We study the problem of identifying unknown processes embedded in time-dependent partial differential equation (PDE) using observational data, with an application to advection-diffusion type PDE. We first conduct theoretical analysis and…

Numerical Analysis · Mathematics 2021-07-13 Zhen Chen , Kailiang Wu , Dongbin Xiu