English
Related papers

Related papers: Gaussian processes meet NeuralODEs: A Bayesian fra…

200 papers

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

In this work, a Gaussian process regression(GPR) model incorporated with given physical information in partial differential equations(PDEs) is developed: physics-assisted Gaussian processes(PAGP). The targets of this model can be divided…

Machine Learning · Statistics 2022-04-07 Jiahao Zhang , Shiqi Zhang , Guang Lin

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

This study introduces a novel theoretical framework for analyzing heteroscedastic Gaussian processes (HGPs) that identify unknown systems in a data-driven manner. Although HGPs effectively address the heteroscedasticity of noise in complex…

Optimization and Control · Mathematics 2024-10-22 Yuji Ito

A key challenge with controlling complex dynamical systems is to accurately model them. However, this requirement is very hard to satisfy in practice. Data-driven approaches such as Gaussian processes (GPs) have proved quite effective by…

Robotics · Computer Science 2022-03-08 Mouhyemen Khan , Akash Patel , Abhijit Chatterjee

Many real-world systems, such as moving planets, can be considered as multi-agent dynamic systems, where objects interact with each other and co-evolve along with the time. Such dynamics is usually difficult to capture, and understanding…

Machine Learning · Computer Science 2020-11-10 Zijie Huang , Yizhou Sun , Wei Wang

This paper proposes an online learning method of Gaussian process state-space model (GP-SSM). GP-SSM is a probabilistic representation learning scheme that represents unknown state transition and/or measurement models as Gaussian processes…

Robotics · Computer Science 2024-10-30 Soon-Seo Park , Young-Jin Park , Youngjae Min , Han-Lim Choi

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

Robotics · Computer Science 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

We propose an effective and robust algorithm for identifying partial differential equations (PDEs) with space-time varying coefficients from a single trajectory of noisy observations. Identifying unknown differential equations from noisy…

Numerical Analysis · Mathematics 2023-04-13 Yuchen He , Sung-Ha Kang , Wenjing Liao , Hao Liu , Yingjie Liu

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

Unveiling the underlying governing equations of nonlinear dynamic systems remains a significant challenge. Insufficient prior knowledge hinders the determination of an accurate candidate library, while noisy observations lead to imprecise…

Machine Learning · Computer Science 2024-04-30 Mengge Du , Yuntian Chen , Longfeng Nie , Siyu Lou , Dongxiao Zhang

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

This paper presents a structure-preserving Bayesian approach for learning nonseparable Hamiltonian systems using stochastic dynamic models allowing for statistically-dependent, vector-valued additive and multiplicative measurement noise.…

Machine Learning · Statistics 2024-07-23 Nicholas Galioto , Harsh Sharma , Boris Kramer , Alex Arkady Gorodetsky

This work is concerned with uncertainty quantification in reduced-order dynamical system identification. Reduced-order models for system dynamics are ubiquitous in design and control applications and recent efforts focus on their…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Prem Ratan Mohan Ram , Ulrich Römer , Richard Semaan

Earth observation (EO) by airborne and satellite remote sensing and in-situ observations play a fundamental role in monitoring our planet. In the last decade, machine learning and Gaussian processes (GPs) in particular has attained…

Machine Learning · Computer Science 2020-07-03 Gustau Camps-Valls , Dino Sejdinovic , Jakob Runge , Markus Reichstein

There is significant interest in learning and optimizing a complex system composed of multiple sub-components, where these components may be agents or autonomous sensors. Among the rich literature on this topic, agent-based and…

Machine Learning · Computer Science 2021-07-08 Kai Wang , Bryan Wilder , Sze-chuan Suen , Bistra Dilkina , Milind Tambe

Both experimental and computational methods for the exploration of structure, functionality, and properties of materials often necessitate the search across broad parameter spaces to discover optimal experimental conditions and regions of…

Computational Physics · Physics 2021-08-31 Maxim Ziatdinov , Ayana Ghosh , Sergei V. Kalinin

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang