English
Related papers

Related papers: Learning Dissipative Neural Dynamical Systems

200 papers

We consider the following learning problem: Given sample pairs of input and output signals generated by an unknown nonlinear system (which is not assumed to be causal or time-invariant), we wish to find a continuous-time recurrent neural…

Machine Learning · Computer Science 2021-11-18 Joshua Hanson , Maxim Raginsky , Eduardo Sontag

Learning the dynamics of spatiotemporal events is a fundamental problem. Neural point processes enhance the expressivity of point process models with deep neural networks. However, most existing methods only consider temporal dynamics…

Machine Learning · Computer Science 2024-12-10 Zihao Zhou , Xingyi Yang , Ryan Rossi , Handong Zhao , Rose Yu

Understanding natural symmetries is key to making sense of our complex and ever-changing world. Recent work has shown that neural networks can learn such symmetries directly from data using Hamiltonian Neural Networks (HNNs). But HNNs…

Machine Learning · Computer Science 2022-01-27 Andrew Sosanya , Sam Greydanus

Recurrent neural networks are capable of learning the dynamics of an unknown nonlinear system purely from input-output measurements. However, the resulting models do not provide any stability guarantees on the input-output mapping. In this…

Machine Learning · Computer Science 2022-12-19 Daniel Frank , Decky Aspandi Latif , Michael Muehlebach , Benjamin Unger , Steffen Staab

Euler's elastica is a classical model of flexible slender structures, relevant in many industrial applications. Static equilibrium equations can be derived via a variational principle. The accurate approximation of solutions of this problem…

The exploding research interest for neural networks in modeling nonlinear dynamical systems is largely explained by the networks' capacity to model complex input-output relations directly from data. However, they typically need vast…

Artificial Intelligence · Computer Science 2023-02-27 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Dirk Reinhardt , Sebastien Gros , Jan Tommy Gravdahl

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics. The key idea is to develop a new control-theoretic regularizer for dynamics fitting rooted in the notion of…

Systems and Control · Computer Science 2018-11-13 Sumeet Singh , Vikas Sindhwani , Jean-Jacques E. Slotine , Marco Pavone

Small neural networks with a constrained number of trainable parameters, can be suitable resource-efficient candidates for many simple tasks, where now excessively large models are used. However, such models face several problems during the…

Machine Learning · Computer Science 2021-09-21 Alexander Kovalenko , Pavel Kordík , Magda Friedjungová

Neural Ordinary Differential Equations (ODE) are a promising approach to learn dynamic models from time-series data in science and engineering applications. This work aims at learning Neural ODE for stiff systems, which are usually raised…

Numerical Analysis · Mathematics 2021-10-04 Suyong Kim , Weiqi Ji , Sili Deng , Yingbo Ma , Christopher Rackauckas

We address the tracking problem for a class of uncertain non-affine nonlinear systems with high relative degrees, performing non-repetitive tasks. We propose a rigorously proven, robust adaptive learning control scheme that relies on a…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Shuai Gao , Dong Shen , Abdelhamid Tayebi

We consider the problem of learning stabilizable systems governed by nonlinear state equation $h_{t+1}=\phi(h_t,u_t;\theta)+w_t$. Here $\theta$ is the unknown system dynamics, $h_t $ is the state, $u_t$ is the input and $w_t$ is the…

Machine Learning · Computer Science 2021-11-22 Yahya Sattar , Samet Oymak

Topology learning of networked dynamical systems is an important problem with implications to optimal control, decision-making over networks, cybersecurity and safety. The majority of prior work in consistent topology estimation relies on…

Optimization and Control · Mathematics 2024-10-15 Harish Doddi , Deepjyoti Deka , Murti Salapaka

Contraction metrics are crucial in control theory because they provide a powerful framework for analyzing stability, robustness, and convergence of various dynamical systems. However, identifying these metrics for complex nonlinear systems…

Optimization and Control · Mathematics 2025-04-25 Haoyu Li , Xiangru Zhong , Bin Hu , Huan Zhang

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Underpinning the past decades of work on the design, initialization, and optimization of neural networks is a seemingly innocuous assumption: that the network is trained on a \textit{stationary} data distribution. In settings where this…

Machine Learning · Computer Science 2024-03-01 Clare Lyle , Zeyu Zheng , Khimya Khetarpal , Hado van Hasselt , Razvan Pascanu , James Martens , Will Dabney

The ability of a brain or a neural network to efficiently learn depends crucially on both the task structure and the learning rule. Previous works have analyzed the dynamical equations describing learning in the relatively simplified…

Machine Learning · Computer Science 2025-02-26 Christian Schmid , James M. Murray

The optimal design of neural networks is a critical problem in many applications. Here, we investigate how dynamical systems with polynomial nonlinearities can inform the design of neural systems that seek to emulate them. We propose a…

Machine Learning · Computer Science 2021-06-23 Margaret Trautner , Ziwei Li , Sai Ravela

Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Yizeng Han , Gao Huang , Shiji Song , Le Yang , Honghui Wang , Yulin Wang

Complex systems in science and engineering sometimes exhibit behavior that changes across different regimes. Traditional global models struggle to capture the full range of this complex behavior, limiting their ability to accurately…

Machine Learning · Computer Science 2023-07-24 Okezzi F. Ukorigho , Opeoluwa Owoyele

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate