English
Related papers

Related papers: Spectral Filtering for General Linear Dynamical Sy…

200 papers

We study the learning ability of linear recurrent neural networks with Gradient Descent. We prove the first theoretical guarantee on linear RNNs to learn any stable linear dynamic system using any a large type of loss functions. For an…

Machine Learning · Computer Science 2023-10-24 Lifu Wang , Tianyu Wang , Shengwei Yi , Bo Shen , Bo Hu , Xing Cao

We present a pragmatic approach to the sparse identification of nonlinear dynamics for systems with discrete delays. It relies on approximating the underlying delay model with a system of ordinary differential equations via pseudospectral…

Dynamical Systems · Mathematics 2024-08-06 Enrico Bozzo , Dimitri Breda , Muhammad Tanveer

We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system.…

Machine Learning · Computer Science 2019-02-12 Moritz Hardt , Tengyu Ma , Benjamin Recht

This paper addresses a system identification for linear periodically time-varying plants in the discrete-time setting. A system identification algorithm for linear, periodically time-varying plants is introduced based on a cyclic…

Systems and Control · Electrical Eng. & Systems 2025-02-17 Hiroshi Okajima , Yusuke Fujimoto , Hiroshi Oku , Haruto Kondo

There has been much recent progress in forecasting the next observation of a linear dynamical system (LDS), which is known as the improper learning, as well as in the estimation of its system matrices, which is known as the proper learning…

Optimization and Control · Mathematics 2024-02-28 Quan Zhou , Jakub Marecek

Observable operator models (OOMs) and related models are one of the most important and powerful tools for modeling and analyzing stochastic systems. They exactly describe dynamics of finite-rank systems and can be efficiently and…

Machine Learning · Computer Science 2017-06-22 Hao Wu , Frank Noé

The well-known Kalman filters model dynamical systems by relying on state-space representations with the next state updated, and its uncertainty controlled, by fresh information associated with newly observed system outputs. This paper…

Machine Learning · Computer Science 2023-06-21 Cesare Alippi , Daniele Zambon

We present a novel spectral learning algorithm for simultaneous localization and mapping (SLAM) from range data with known correspondences. This algorithm is an instance of a general spectral system identification framework, from which it…

Machine Learning · Computer Science 2012-07-12 Byron Boots , Geoffrey J. Gordon

The dynamics of a linear dynamical system over a finite field can be described by using the elementary divisors of the corresponding matrix. It is natural to extend the investigation to a general finite commutative ring. In a previous…

Rings and Algebras · Mathematics 2017-09-26 Yangjiang Wei , Guangwu Xu , Yi Ming Zou

We introduce algorithms for learning nonlinear dynamical systems of the form $x_{t+1}=\sigma(\Theta^{\star}x_t)+\varepsilon_t$, where $\Theta^{\star}$ is a weight matrix, $\sigma$ is a nonlinear link function, and $\varepsilon_t$ is a…

Machine Learning · Computer Science 2020-05-01 Dylan J. Foster , Alexander Rakhlin , Tuhin Sarkar

In this paper we develop a method for learning nonlinear systems with multiple outputs and inputs. We begin by modelling the errors of a nominal predictor of the system using a latent variable framework. Then using the maximum likelihood…

Machine Learning · Statistics 2018-05-28 Per Mattsson , Dave Zachariah , Petre Stoica

In the present work, a simple algorithm for stabilizing an unknown linear time-invariant system is proposed, assuming only that this system is stabilizable. The suggested algorithm is based on first performing a partial identification of…

Optimization and Control · Mathematics 2022-11-14 Dennis Gramlich , Christian Ebenbauer

We consider the problem of computing the maximal invariant set of discrete-time linear systems subject to a class of non-convex constraints that admit quadratic relaxations. These non-convex constraints include semialgebraic sets and other…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Zheming Wang , Raphaël M. Jungers , Chong-Jin Ong

In the traditional framework of spectral learning of stochastic time series models, model parameters are estimated based on trajectories of fully recorded observations. However, real-world time series data often contain missing values, and…

Machine Learning · Computer Science 2018-10-22 Tianlin Liu

While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have discrete states and…

Machine Learning · Statistics 2020-06-19 Horia Mania , Michael I. Jordan , Benjamin Recht

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning. Despite their complexity, such systems can often be approximated well by a set of linear…

Machine Learning · Statistics 2019-05-30 Philip Becker-Ehmck , Jan Peters , Patrick van der Smagt

In this paper, we consider the problem of unmixing a time series of hyperspectral images. We propose a dynamical model based on linear mixing processes at each time instant. The spectral signatures and fractional abundances of the pure…

Computer Vision and Pattern Recognition · Computer Science 2016-06-29 Simon Henrot , Jocelyn Chanussot , Christian Jutten

Particle filtering is a popular method for inferring latent states in stochastic dynamical systems, whose theoretical properties have been well studied in machine learning and statistics communities. In many control problems, e.g.,…

Machine Learning · Computer Science 2021-07-12 Simon S. Du , Wei Hu , Zhiyuan Li , Ruoqi Shen , Zhao Song , Jiajun Wu

Phase retrieval refers to algorithmic methods for recovering a signal from its phaseless measurements. Local search algorithms that work directly on the non-convex formulation of the problem have been very popular recently. Due to the…

Information Theory · Computer Science 2020-03-06 Rishabh Dudeja , Milad Bakhshizadeh , Junjie Ma , Arian Maleki

We consider the problem of reconstructing the dynamic state matrix of transmission power grids from time-stamped PMU measurements in the regime of ambient fluctuations. Using a maximum likelihood based approach, we construct a family of…

Systems and Control · Computer Science 2017-10-31 Andrey Y. Lokhov , Marc Vuffray , Dmitry Shemetov , Deepjyoti Deka , Michael Chertkov