English
Related papers

Related papers: Learning Partially Known Stochastic Dynamics with …

200 papers

We propose a novel non-parametric learning paradigm for the identification of drift and diffusion coefficients of multi-dimensional non-linear stochastic differential equations, which relies upon discrete-time observations of the state. The…

Machine Learning · Computer Science 2025-03-11 Riccardo Bonalli , Alessandro Rudi

A systematic Bayesian framework is developed for physics constrained parameter inference ofstochastic differential equations (SDE) from partial observations. The physical constraints arederived for stochastic climate models but are…

Data Analysis, Statistics and Probability · Physics 2016-11-25 Daniel Peavoy , Christian L. E. Franzke , Gareth O. Roberts

We present a numerical method for learning unknown nonautonomous stochastic dynamical system, i.e., stochastic system subject to time dependent excitation or control signals. Our basic assumption is that the governing equations for the…

Machine Learning · Computer Science 2025-03-04 Yuan Chen , Dongbin Xiu

Linear dynamical systems are canonical models for learning-based control of plants with uncertain dynamics. The setting consists of a stochastic differential equation that captures the state evolution of the plant understudy, while the true…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

Bayesian inference methods are applied within a Bayesian hierarchical modelling framework to the problems of joint state and parameter estimation, and of state forecasting. We explore and demonstrate the ideas in the context of a simple…

Applications · Statistics 2012-11-09 John Parslow , Noel Cressie , Edward P. Campbell , Emlyn Jones , Lawrence Murray

One of the defining properties of deep learning is that models are chosen to have many more parameters than available training data. In light of this capacity for overfitting, it is remarkable that simple algorithms like SGD reliably return…

Machine Learning · Computer Science 2017-10-20 Gintare Karolina Dziugaite , Daniel M. Roy

Uncertainties are abundant in complex systems. Mathematical models for these systems thus contain random effects or noises. The models are often in the form of stochastic differential equations, with some parameters to be determined by…

Numerical Analysis · Mathematics 2015-03-13 Jiarui Yang , Jinqiao Duan

We identify an issue in recent approaches to learning-based control that reformulate systems with uncertain dynamics using a stochastic differential equation. Specifically, we discuss the approximation that replaces a model with fixed but…

Systems and Control · Electrical Eng. & Systems 2021-11-12 Thomas Lew , Apoorva Sharma , James Harrison , Edward Schmerling , Marco Pavone

In this paper we focus on the parameter estimation of dynamic load models with stochastic terms, in particular, load models where protection settings are uncertain, such as in aggregated air conditioning units. We show how the uncertainty…

Optimization and Control · Mathematics 2020-04-30 Daniel Adrian Maldonado , Vishwas Rao , Mihai Anitescu , Vivak Patel

In this paper we derive a PAC-Bayesian-Like error bound for a class of stochastic dynamical systems with inputs, namely, for linear time-invariant stochastic state-space models (stochastic LTI systems for short). This class of systems is…

Machine Learning · Statistics 2023-01-02 Deividas Eringis , John Leth , Zheng-Hua Tan , Rafal Wisniewski , Mihaly Petreczky

In this paper we derive a PAC-Bayesian error bound for autonomous stochastic LTI state-space models. The motivation for deriving such error bounds is that they will allow deriving similar error bounds for more general dynamical systems,…

We study stochastic optimization with data-adaptive sampling schemes to train pairwise learning models. Pairwise learning is ubiquitous, and it covers several popular learning tasks such as ranking, metric learning and AUC maximization. A…

Machine Learning · Computer Science 2025-04-10 Sijia Zhou , Yunwen Lei , Ata Kabán

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

The physical sciences are replete with dynamical systems that require the resolution of a wide range of length and time scales. This presents significant computational challenges since direct numerical simulation requires discretization at…

Machine Learning · Computer Science 2025-11-11 Andrew F. Ilersich , Prasanth B. Nair

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

Machine Learning · Computer Science 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time…

Machine Learning · Statistics 2018-08-01 Cagatay Yildiz , Markus Heinonen , Jukka Intosalmi , Henrik Mannerström , Harri Lähdesmäki

Discovering the underlying relationships among variables from temporal observations has been a longstanding challenge in numerous scientific disciplines, including biology, finance, and climate science. The dynamics of such systems are…

Machine Learning · Computer Science 2024-05-07 Benjie Wang , Joel Jennings , Wenbo Gong

Nonlinear systems with model uncertainty are often described by stochastic differential equations. Some techniques from random dynamical systems are discussed. They are relevant to better understanding of solution processes of stochastic…

Dynamical Systems · Mathematics 2008-11-25 Jinqiao Duan

This work introduces a neural architecture for learning forward models of stochastic environments. The task is achieved solely through learning from temporal unstructured observations in the form of images. Once trained, the model allows…

Machine Learning · Computer Science 2021-12-16 Marian Andrecki , Nicholas K. Taylor