English
Related papers

Related papers: Modeling Systems with Machine Learning based Diffe…

200 papers

Many natural systems, such as neurons firing in the brain or basketball teams traversing a court, give rise to time series data with complex, nonlinear dynamics. We can gain insight into these systems by decomposing the data into segments…

Multiscale dynamical systems, modeled by high-dimensional stiff ordinary differential equations (ODEs) with wide-ranging characteristic timescales, arise across diverse fields of science and engineering, but their numerical solvers often…

Numerical Analysis · Mathematics 2025-08-14 Junjie Yao , Yuxiao Yi , Liangkai Hang , Weinan E , Weizong Wang , Yaoyu Zhang , Tianhan Zhang , Zhi-Qin John Xu

Spurred by tremendous success in pattern matching and prediction tasks, researchers increasingly resort to machine learning to aid original scientific discovery. Given large amounts of observational data about a system, can we uncover the…

Machine Learning · Computer Science 2025-01-31 Hananeh Aliee , Fabian J. Theis , Niki Kilbertus

A recent line of work in the machine learning community addresses the problem of predicting high-dimensional spatiotemporal phenomena by leveraging specific tools from the differential equations theory. Following this direction, we propose…

Machine Learning · Computer Science 2021-03-24 Jérémie Donà , Jean-Yves Franceschi , Sylvain Lamprier , Patrick Gallinari

Probabilistic models help us encode latent structures that both model the data and are ideally also useful for specific downstream tasks. Among these, mixture models and their time-series counterparts, hidden Markov models, identify…

Machine Learning · Computer Science 2021-10-29 Abhishek Sharma , Catherine Zeng , Sanjana Narayanan , Sonali Parbhoo , Finale Doshi-Velez

Research on control using models based on machine-learning methods has now shifted to the practical engineering stage. Achieving high performance and theoretically guaranteeing the safety of the system is critical for such applications. In…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Ryuta Moriyasu , Masayuki Kusunoki , Kenji Kashima

We propose a neural network based approach for extracting models from dynamic data using ordinary and partial differential equations. In particular, given a time-series or spatio-temporal dataset, we seek to identify an accurate governing…

Machine Learning · Computer Science 2019-08-09 Yifan Sun , Linan Zhang , Hayden Schaeffer

Theoretical developments in sequential Bayesian analysis of multivariate dynamic models underlie new methodology for causal prediction. This extends the utility of existing models with computationally efficient methodology, enabling routine…

Methodology · Statistics 2024-06-05 Kevin Li , Graham Tierney , Christoph Hellmayr , Mike West

Data-driven modeling of dynamical systems often faces numerous data-related challenges. A fundamental requirement is the existence of a unique set of parameters for a chosen model structure, an issue commonly referred to as identifiability.…

Systems and Control · Electrical Eng. & Systems 2024-05-24 Arthur N. Montanari , François Lamoline , Robert Bereza , Jorge Gonçalves

The literature is rich with studies, analyses, and examples on parameter estimation for describing the evolution of chaotic dynamical systems based on measurements, even when only partial information is available through observations.…

Chaotic Dynamics · Physics 2025-08-07 Michele Baia , Tommaso Matteuzzi , Franco Bagnoli

Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably…

Machine Learning · Computer Science 2024-12-05 Congxi Zhang , Yongchun Xie

Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning…

Machine Learning · Computer Science 2021-01-07 Satya Narayan Shukla , Benjamin M. Marlin

The automatic generation of decision trees based on off-line reasoning on models of a domain is a reasonable compromise between the advantages of using a model-based approach in technical domains and the constraints imposed by embedded…

Artificial Intelligence · Computer Science 2011-06-28 L. Console , C. Picardi , D. Theseider Duprè

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

A deep latent variable model is a powerful method for capturing complex distributions. These models assume that underlying structures, but unobserved, are present within the data. In this dissertation, we explore high-dimensional problems…

Machine Learning · Computer Science 2024-06-13 Khuong Vo

Atmospheric modeling has recently experienced a surge with the advent of deep learning. Most of these models, however, predict concentrations of pollutants following a data-driven approach in which the physical laws that govern their…

Applications · Statistics 2021-07-08 Javier Rubio-Herrero , Carlos Ortiz Marrero , Wai-Tong Louis Fan

Stable dynamical systems are a flexible tool to plan robotic motions in real-time. In the robotic literature, dynamical system motions are typically planned without considering possible limitations in the robot's workspace. This work…

Robotics · Computer Science 2020-03-26 Matteo Saveriano , Dongheui Lee

To understand and predict the performance of scientific applications, several analytical and machine learning approaches have been proposed, each having its advantages and disadvantages. In this paper, we propose and validate a hybrid…

Performance · Computer Science 2019-02-27 Huda Ibeid , Siping Meng , Oliver Dobon , Luke Olson , William Gropp

The intersection of machine learning and dynamical systems has generated considerable interest recently. Neural Ordinary Differential Equations (NODEs) represent a rich overlap between these fields. In this paper, we develop a continuous…

Optimization and Control · Mathematics 2023-06-16 Maria Oprea , Mark Walth , Robert Stephany , Gabriella Torres Nothaft , Arnaldo Rodriguez-Gonzalez , William Clark

This short review describes mathematical techniques for statistical analysis and prediction in dynamical systems. Two problems are discussed, namely (i) the supervised learning problem of forecasting the time evolution of an observable…

Statistics Theory · Mathematics 2020-07-01 Tyrus Berry , Dimitrios Giannakis , John Harlim