English
Related papers

Related papers: Learning stochastic dynamics and predicting emerge…

200 papers

Using transformers over large generated datasets, we train models to learn mathematical properties of differential systems, such as local stability, behavior at infinity and controllability. We achieve near perfect prediction of qualitative…

Machine Learning · Computer Science 2021-03-22 François Charton , Amaury Hayat , Guillaume Lample

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

Two of the many trends in neural network research of the past few years have been (i) the learning of dynamical systems, especially with recurrent neural networks such as long short-term memory networks (LSTMs) and (ii) the introduction of…

Numerical Analysis · Mathematics 2024-11-15 Benedikt Brantner , Guillaume de Romemont , Michael Kraus , Zeyuan Li

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

Recurrent Neural Networks excel at predicting and generating complex high-dimensional temporal patterns. Due to their inherent nonlinear dynamics and memory, they can learn unbounded temporal dependencies from data. In a Machine Learning…

Machine Learning · Computer Science 2024-05-14 Guillaume Pourcel , Mirko Goldmann , Ingo Fischer , Miguel C. Soriano

Modern learning systems increasingly interact with data that evolve over time and depend on hidden internal state. We ask a basic question: when is such a dynamical system learnable from observations alone? This paper proposes a research…

Machine Learning · Computer Science 2025-12-23 Elad Hazan , Shai Shalev Shwartz , Nathan Srebro

Complex time-varying systems are often studied by abstracting away from the dynamics of individual components to build a model of the population-level dynamics from the start. However, when building a population-level description, it can be…

Neurons and Cognition · Quantitative Biology 2022-10-21 Ran Liu , Mehdi Azabou , Max Dabagia , Jingyun Xiao , Eva L. Dyer

Machine learning models often require large datasets and struggle to generalize beyond their training distribution. These limitations pose significant challenges in scientific and engineering contexts, where generating exhaustive datasets…

Chemical Physics · Physics 2025-06-12 Salman N. Salman , Sergey A. Shteingolts , Ron Levie , Dan Mendels

Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and PDE trajectories. Our method is designed to identify underlying…

Pattern Formation and Solitons · Physics 2024-04-23 Alex D. Richardson , Tibor Antal , Richard A. Blythe , Linus J. Schumacher

We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic…

Neurons and Cognition · Quantitative Biology 2026-02-10 Ahmed ElGazzar , Marcel van Gerven

Manipulation tasks often consist of subtasks, each representing a distinct skill. Mastering these skills is essential for robots, as it enhances their autonomy, efficiency, adaptability, and ability to work in their environment. Learning…

Robotics · Computer Science 2025-05-21 Juyan Zhang , Dana Kulic , Michael Burke

Non-stationary sequences arise naturally in control, forecasting, and decision-making. The data-generating process shifts at unknown times, and models must detect the change, discard or downweight obsolete evidence, and adapt to new…

Machine Learning · Computer Science 2026-04-21 Carson Dudley , Yutong Bi , Xiaofeng Liu , Samet Oymak

Learning network dynamics from the empirical structure and spatio-temporal observation data is crucial to revealing the interaction mechanisms of complex networks in a wide range of domains. However, most existing methods only aim at…

Machine Learning · Computer Science 2024-11-22 Jiaxu Cui , Bingyi Sun , Jiming Liu , Bo Yang

We show that it is possible to learn protocols that effect fast and efficient state-to-state transformations in simulation models of active particles. By encoding the protocol in the form of a neural network we use evolutionary methods to…

Statistical Mechanics · Physics 2024-03-29 Corneel Casert , Stephen Whitelam

Many real-world complex systems, such as epidemic spreading networks and ecosystems, can be modeled as networked dynamical systems that produce multivariate time series. Learning the intrinsic dynamics from observational data is pivotal for…

Machine Learning · Computer Science 2024-12-30 Yanna Ding , Zijie Huang , Malik Magdon-Ismail , Jianxi Gao

We study the problem of system identification for stochastic continuous-time dynamics, based on a single finite-length state trajectory. We present a method for estimating the possibly unstable open-loop matrix by employing properly…

Machine Learning · Statistics 2025-09-30 Reza Sadeghi Hafshejani , Mohamad Kazem Shirani Fradonbeh

We introduce Neural Dynamical Systems (NDS), a method of learning dynamical models in various gray-box settings which incorporates prior knowledge in the form of systems of ordinary differential equations. NDS uses neural networks to…

Humans leverage the dynamics of the environment and their own bodies to accomplish challenging tasks such as grasping an object while walking past it or pushing off a wall to turn a corner. Such tasks often involve switching dynamics as the…

Robotics · Computer Science 2021-03-29 Saumya Saxena , Alex LaGrassa , Oliver Kroemer

We study the dynamics of on-line learning in large perceptrons, for the case of training sets with a structural bias of the input vectors, by deriving exact and closed macroscopic dynamical laws using non-equilibrium statistical mechanical…

Disordered Systems and Neural Networks · Physics 2009-10-31 H. C. Rae , J. A. F. Heimel , A. C. C. Coolen

In this study, we propose a predictive model composed of a recurrent neural network including parametric bias and stochastic elements, and an environmentally adaptive robot control method including variance minimization using the model.…

Robotics · Computer Science 2024-12-12 Kento Kawaharazuka , Koki Shinjo , Yoichiro Kawamura , Kei Okada , Masayuki Inaba