English
Related papers

Related papers: Systems of ODEs Parameters Estimation by Using Sto…

200 papers

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

We present a novel model Graph Neural Stochastic Differential Equations (Graph Neural SDEs). This technique enhances the Graph Neural Ordinary Differential Equations (Graph Neural ODEs) by embedding randomness into data representation using…

Machine Learning · Computer Science 2023-08-25 Richard Bergna , Felix Opolka , Pietro Liò , Jose Miguel Hernandez-Lobato

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\theta$ of physical significance which…

Statistics Theory · Mathematics 2014-03-05 Prithwish Bhaumik , Subhashis Ghosal

Differential equations (DEs) are commonly used to describe dynamic systems evolving in one (ordinary differential equations or ODEs) or in more than one dimensions (partial differential equations or PDEs). In real data applications the…

Methodology · Statistics 2013-11-25 Gianluca Frasso , Jonathan Jaeger , Philippe Lambert

Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a…

Machine Learning · Statistics 2019-03-04 Philippe Wenk , Alkis Gotovos , Stefan Bauer , Nico Gorbach , Andreas Krause , Joachim M. Buhmann

Ordinary differential equations (ODEs) can provide mechanistic models of temporally local changes of processes, where parameters are often informed by external knowledge. While ODEs are popular in systems modeling, they are less established…

Methodology · Statistics 2025-07-10 Maren Hackenberg , Astrid Pechmann , Clemens Kreutz , Janbernd Kirschner , Harald Binder

We consider the problem of parameter estimation in dynamic systems described by ordinary differential equations. A review of the existing literature emphasizes the need for deterministic global optimization methods due to the nonconvex…

Optimization and Control · Mathematics 2025-06-16 M. Fernández de Dios , Ángel M. González-Rueda , Julio R. Banga , Julio González-Díaz , David R. Penas

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Non-autonomous differential equations are crucial for modeling systems influenced by external signals, yet fitting these models to data becomes particularly challenging when the signals change abruptly. To address this problem, we propose a…

Machine Learning · Computer Science 2025-07-10 Hyeontae Jo , Krešimir Josić , Jae Kyoung Kim

We introduce ODE-GS, a novel approach that integrates 3D Gaussian Splatting with latent neural ordinary differential equations (ODEs) to enable future extrapolation of dynamic 3D scenes. Unlike existing dynamic scene reconstruction methods,…

Graphics · Computer Science 2026-04-28 Daniel Wang , Patrick Rim , Tian Tian , Dong Lao , Alex Wong , Ganesh Sundaramoorthi

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\bm\theta$ of physical significance…

Statistics Theory · Mathematics 2014-11-05 Prithwish Bhaumik , Subhashis Ghosal

Solving elliptic partial differential equations (PDEs) is a fundamental step in various scientific and engineering studies. As a classic stochastic solver, the Walk-on-Spheres (WoS) method is a well-established and efficient algorithm that…

Numerical Analysis · Mathematics 2025-09-03 Silei Song , Arash Fahim , Michael Mascagni

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

Statistical regression models whose mean functions are represented by ordinary differential equations (ODEs) can be used to describe phenomenons dynamical in nature, which are abundant in areas such as biology, climatology and genetics. The…

Methodology · Statistics 2017-05-15 Kyoungjae Lee , Jaeyong Lee , Sarat C. Dass

First-order methods like stochastic gradient descent(SGD) are recently the popular optimization method to train deep neural networks (DNNs), but second-order methods are scarcely used because of the overpriced computing cost in getting the…

Machine Learning · Computer Science 2021-04-01 Jingcheng Zhou , Wei Wei , Zhiming Zheng

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

Machine Learning · Computer Science 2023-08-29 Ziheng Wang , Justin Sirignano

Many relevant problems in the area of systems and control, such as controller synthesis, observer design and model reduction, can be viewed as optimization problems involving dynamical systems: for instance, maximizing performance in the…

Optimization and Control · Mathematics 2023-11-15 Pascal Den Boef , Jos Maubach , Wil Schilders , Nathan van de Wouw

Ordinary Differential Equations are a simple but powerful framework for modeling complex systems. Parameter estimation from times series can be done by Nonlinear Least Squares (or other classical approaches), but this can give…

Methodology · Statistics 2014-10-29 Quentin Clairon , Nicolas Brunel

We present a new approach for estimating parameters in rational ODE models from given (measured) time series data. In typical existing approaches, an initial guess for the parameter values is made from a given search interval. Then, in a…

Mathematical Software · Computer Science 2023-12-19 Oren Bassik , Yosef Berman , Soo Go , Hoon Hong , Ilia Ilmer , Alexey Ovchinnikov , Chris Rackauckas , Pedro Soto , Chee Yap