English
Related papers

Related papers: Online Learning for Nonlinear Dynamical Systems wi…

200 papers

We introduce the "NoBackTrack" algorithm to train the parameters of dynamical systems such as recurrent neural networks. This algorithm works in an online, memoryless setting, thus requiring no backpropagation through time, and is scalable,…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Yann Ollivier , Corentin Tallec , Guillaume Charpiat

We consider the problem of learning the dynamics of autonomous linear systems (i.e., systems that are not affected by external control inputs) from observations of multiple trajectories of those systems, with finite sample guarantees.…

Systems and Control · Electrical Eng. & Systems 2022-09-27 Lei Xin , George Chiu , Shreyas Sundaram

We present a numerical method to learn an accurate predictive model for an unknown stochastic dynamical system from its trajectory data. The method seeks to approximate the unknown flow map of the underlying system. It employs the idea of…

Machine Learning · Computer Science 2024-12-24 Zhongshu Xu , Yuan Chen , Qifan Chen , Dongbin Xiu

In the random-order model for online learning, the sequence of losses is chosen upfront by an adversary and presented to the learner after a random permutation. Any random-order input is \emph{asymptotically} equivalent to a stochastic…

Machine Learning · Computer Science 2025-10-06 Martino Bernasconi , Andrea Celli , Riccardo Colini-Baldeschi , Federico Fusco , Stefano Leonardi , Matteo Russo

A strategy is proposed for adaptive stabilization of linear systems, depending on an uncertain parameter. Offline, the Riccati stabilizing feedback input control operators, corresponding to parameters in a finite training set of chosen…

Optimization and Control · Mathematics 2023-07-27 Philipp A. Guth , Karl Kunisch , Sérgio S. Rodrigues

This paper investigates parameter learning problems under deficient excitation (DE). The DE condition is a rank-deficient, and therefore, a more general evolution of the well-known persistent excitation condition. Under the DE condition, a…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Ganghui Cao , Shimin Wang , Martin Guay , Jinzhi Wang , Zhisheng Duan , Marios M. Polycarpou

The Expectation Maximization (EM) algorithm is a versatile tool for model parameter estimation in latent data models. When processing large data sets or data stream however, EM becomes intractable since it requires the whole data set to be…

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

This paper addresses the estimation of a time- varying parameter in a network. A group of agents sequentially receive noisy signals about the parameter (or moving target), which does not follow any particular dynamics. The parameter is not…

Optimization and Control · Mathematics 2016-03-03 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

We develop an online learning method for prediction, which is important in problems with large and/or streaming data sets. We formulate the learning approach using a covariance-fitting methodology, and show that the resulting predictor has…

Machine Learning · Computer Science 2017-03-16 Dave Zachariah , Petre Stoica , Thomas B. Schön

Safety-critical control of uncertain, adaptive systems often relies on conservative, worst-case uncertainty bounds that limit closed-loop performance. Online conformal prediction is a powerful data-driven method for quantifying uncertainty…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Daniel M. Cherenson , Dimitra Panagou

Although persistent excitation is often acknowledged as a sufficient condition to exponentially converge in the field of adaptive parameter estimation, it must be noted that in practical applications this may be unguaranteed. Recently, more…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Siyu Chen , Jing Na , Yingbo Huang

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

This work provides a framework for nonlinear model-free control of systems with unknown input-output dynamics, but outputs that can be controlled by the inputs. This framework leads to real-time control of the system such that a feasible…

Systems and Control · Electrical Eng. & Systems 2019-08-13 Amit K. Sanyal

Autonomous robots need to interact with unknown, unstructured and changing environments, constantly facing novel challenges. Therefore, continuous online adaptation for lifelong-learning and the need of sample-efficient mechanisms to adapt…

Artificial Intelligence · Computer Science 2018-11-09 Daniel Tanneberg , Jan Peters , Elmar Rueckert

Policy design in non-stationary Markov Decision Processes (MDPs) is inherently challenging due to the complexities introduced by time-varying system transition and reward, which make it difficult for learners to determine the optimal…

Machine Learning · Computer Science 2025-11-17 Ziyi Zhang , Yorie Nakahira , Guannan Qu

We present a data-driven numerical approach for modeling unknown dynamical systems with missing/hidden parameters. The method is based on training a deep neural network (DNN) model for the unknown system using its trajectory data. A key…

Machine Learning · Statistics 2022-02-07 Xiaohan Fu , Weize Mao , Lo-Bin Chang , Dongbin Xiu

The use of algorithmic predictions in decision-making leads to a feedback loop where the models we deploy actively influence the data distributions we see, and later use to retrain on. This dynamic was formalized by Perdomo et al. 2020 in…

Machine Learning · Computer Science 2026-03-02 Gabriele Farina , Juan Carlos Perdomo

This paper introduces a novel approach to evaluating the asymptotic stability of equilibrium points in both continuous-time (CT) and discrete-time (DT) nonlinear autonomous systems. By utilizing indirect Lyapunov methods and linearizing…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Sadredin Hokmi , Mohammad Khajenejad

This paper addresses the problem of online learning in a dynamic setting. We consider a social network in which each individual observes a private signal about the underlying state of the world and communicates with her neighbors at each…

Optimization and Control · Mathematics 2013-10-02 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

This paper proposes a Koopman-based framework for modeling, prediction, and control of unknown nonlinear time-varying systems. We present a novel Koopman-based learning method for predicting the state of unknown nonlinear time-varying…

Systems and Control · Electrical Eng. & Systems 2026-01-30 Hengde Zhang , Yunxiao Ren , Zhisheng Duan , Zhiyong Sun , Guanrong Chen