English
Related papers

Related papers: Learning Dissipative Neural Dynamical Systems

200 papers

Learning to remember over long timescales is fundamentally challenging for recurrent neural networks (RNNs). While much prior work has explored why RNNs struggle to learn long timescales and how to mitigate this, we still lack a clear…

Neurons and Cognition · Quantitative Biology 2025-03-25 Blake Bordelon , Jordan Cotler , Cengiz Pehlevan , Jacob A. Zavatone-Veth

In this work, we propose a multi-stage training strategy for the development of deep learning algorithms applied to problems with multiscale features. Each stage of the pro-posed strategy shares an (almost) identical network structure and…

Numerical Analysis · Mathematics 2020-09-25 Eric Chung , Wing Tat Leung , Sai-Mang Pun , Zecheng Zhang

Stable dynamical systems are a flexible tool to plan robotic motions in real-time. In the robotic literature, dynamical system motions are typically planned without considering possible limitations in the robot's workspace. This work…

Robotics · Computer Science 2020-03-26 Matteo Saveriano , Dongheui Lee

Training deep neural networks is a highly nontrivial task, involving carefully selecting appropriate training algorithms, scheduling step sizes and tuning other hyperparameters. Trying different combinations can be quite labor-intensive and…

Machine Learning · Computer Science 2017-06-13 Kaifeng Lv , Shunhua Jiang , Jian Li

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

We present a data-driven modeling strategy to overcome improperly modeled dynamics for systems exhibiting complex spatio-temporal behaviors. We propose a Deep Learning framework to resolve the differences between the true dynamics of the…

Machine Learning · Computer Science 2020-10-28 Maan Qraitem , Dhanushka Kularatne , Eric Forgoston , M. Ani Hsieh

Regardless of the marked differences between biological and artificial neural systems, one fundamental similarity is that they are essentially dynamical systems that can learn to imitate other dynamical systems, without knowing their…

Neurons and Cognition · Quantitative Biology 2019-11-06 Zhixin Lu , Danielle S. Bassett

Continual learning is the ability to acquire new knowledge without forgetting the previously learned one, assuming no further access to past training data. Neural network approximators trained with gradient descent are known to fail in this…

Machine Learning · Computer Science 2021-11-05 Rodrigue Siry

The reduction of dynamical systems has a rich history, with many important applications related to stability, control and verification. Reduction of nonlinear systems is typically performed in an exact manner - as is the case with…

Optimization and Control · Mathematics 2007-07-26 Paulo Tabuada , Aaron D. Ames , Agung Julius , George J. Pappas

Bilinear dynamical systems are ubiquitous in many different domains and they can also be used to approximate more general control-affine systems. This motivates the problem of learning bilinear systems from a single trajectory of the…

Machine Learning · Computer Science 2022-08-31 Yahya Sattar , Samet Oymak , Necmiye Ozay

Model reduction of high-dimensional dynamical systems alleviates computational burdens faced in various tasks from design optimization to model predictive control. One popular model reduction approach is based on projecting the governing…

Dynamical Systems · Mathematics 2018-08-24 Francisco J. Gonzalez , Maciej Balajewicz

Differentiable simulators provide an avenue for closing the sim-to-real gap by enabling the use of efficient, gradient-based optimization algorithms to find the simulation parameters that best fit the observed sensor readings. Nonetheless,…

Robotics · Computer Science 2021-05-21 Eric Heiden , David Millard , Erwin Coumans , Yizhou Sheng , Gaurav S. Sukhatme

The paper describes a neural approach for modelling and control of a turbocharged Diesel engine. A neural model, whose structure is mainly based on some physical equations describing the engine behaviour, is built for the rotation speed and…

Machine Learning · Computer Science 2019-08-24 Mustapha Ouladsine , Gérard Bloch , Xavier Dovifaaz

This work concerns the control of unknown nonlinear systems corrupted by disturbances. For such systems, we propose an anti-disturbance dual control approach with active learning of the disturbances. Our approach holds the dual property of…

Optimization and Control · Mathematics 2024-12-18 Xuehui Ma , Shiliang Zhang , Fucai Qian , Jinbao Wang , Yushuai Li

The physical sciences are replete with dynamical systems that require the resolution of a wide range of length and time scales. This presents significant computational challenges since direct numerical simulation requires discretization at…

Machine Learning · Computer Science 2025-11-11 Andrew F. Ilersich , Prasanth B. Nair

We consider the problem of learning the dynamics of a linear system when one has access to data generated by an auxiliary system that shares similar (but not identical) dynamics, in addition to data from the true system. We use a weighted…

Machine Learning · Statistics 2025-01-20 Lei Xin , Lintao Ye , George Chiu , Shreyas Sundaram

We present a data-driven numerical approach for modeling unknown dynamical systems with missing/hidden parameters. The method is based on training a deep neural network (DNN) model for the unknown system using its trajectory data. A key…

Machine Learning · Statistics 2022-02-07 Xiaohan Fu , Weize Mao , Lo-Bin Chang , Dongbin Xiu

Learning to control unknown nonlinear dynamical systems is a fundamental problem in reinforcement learning and control theory. A commonly applied approach is to first explore the environment (exploration), learn an accurate model of it…

Machine Learning · Computer Science 2023-06-16 Andrew Wagenmaker , Guanya Shi , Kevin Jamieson

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

Learning to follow human instructions is a long-pursued goal in artificial intelligence. The task becomes particularly challenging if no prior knowledge of the employed language is assumed while relying only on a handful of examples to…

Computation and Language · Computer Science 2019-04-03 Rezka Leonandya , Elia Bruni , Dieuwke Hupkes , Germán Kruszewski