English
Related papers

Related papers: Learning Linear Dynamical Systems via Spectral Fil…

200 papers

This paper re-visits the spectral method for learning latent variable models defined in terms of observable operators. We give a new perspective on the method, showing that operators can be recovered by minimizing a loss defined on a finite…

Machine Learning · Computer Science 2012-07-03 Borja Balle , Ariadna Quattoni , Xavier Carreras

We address the problem of learning the parameters of a mean square stable switched linear systems (SLS) with unknown latent space dimension, or \textit{order}, from its noisy input--output data. In particular, we focus on learning a good…

Systems and Control · Electrical Eng. & Systems 2020-05-06 Tuhin Sarkar , Alexander Rakhlin , Munther A. Dahleh

Identification of a linear time-invariant dynamical system from partial observations is a fundamental problem in control theory. Particularly challenging are systems exhibiting long-term memory. A natural question is how learn such systems…

Machine Learning · Computer Science 2022-03-08 Holden Lee

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at…

Machine Learning · Computer Science 2024-06-28 Peter Halmos , Jonathan Pillow , David A. Knowles

Latent linear dynamical systems with Bernoulli observations provide a powerful modeling framework for identifying the temporal dynamics underlying binary time series data, which arise in a variety of contexts such as binary decision-making…

Machine Learning · Statistics 2023-07-28 Iris R. Stone , Yotam Sagiv , Il Memming Park , Jonathan W. Pillow

In this paper, online convex optimization is applied to the problem of controlling linear dynamical systems. An algorithm similar to online gradient descent, which can handle time-varying and unknown cost functions, is proposed. Then,…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

We propose a data-driven online convex optimization algorithm for controlling dynamical systems. In particular, the control scheme makes use of an initially measured input-output trajectory and behavioral systems theory which enable it to…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

We study the problem of learning complex-valued linear dynamical systems (CLDS) with sector-bounded spectrum. This class captures oscillatory and long-memory dynamics arising in signal processing, structured state space models, and quantum…

Quantum Physics · Physics 2026-05-11 Elad Hazan , Annie Marsden

We consider the problem of reconstructing the dynamic state matrix of transmission power grids from time-stamped PMU measurements in the regime of ambient fluctuations. Using a maximum likelihood based approach, we construct a family of…

Systems and Control · Computer Science 2017-10-31 Andrey Y. Lokhov , Marc Vuffray , Dmitry Shemetov , Deepjyoti Deka , Michael Chertkov

We study the problem of controlling linear time-invariant systems with known noisy dynamics and adversarially chosen quadratic losses. We present the first efficient online learning algorithms in this setting that guarantee $O(\sqrt{T})$…

Machine Learning · Computer Science 2018-06-20 Alon Cohen , Avinatan Hassidim , Tomer Koren , Nevena Lazic , Yishay Mansour , Kunal Talwar

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

We consider a setting, where the output of a linear dynamical system (LDS) is, with an unknown but fixed probability, replaced by noise. There, we present a robust method for the prediction of the outputs of the LDS and identification of…

Machine Learning · Computer Science 2018-08-06 Jakub Marecek , Tigran Tchrakian

The increasing reliance on numerical methods for controlling dynamical systems and training machine learning models underscores the need to devise algorithms that dependably and efficiently navigate complex optimization landscapes.…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Andrea Martin , Luca Furieri

We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system.…

Machine Learning · Computer Science 2019-02-12 Moritz Hardt , Tengyu Ma , Benjamin Recht

We survey the state of the art on the algorithmic analysis of discrete linear dynamical systems, focussing in particular on reachability, model-checking, and invariant-generation questions, both unconditionally as well as relative to…

Dynamical Systems · Mathematics 2022-09-21 Toghrul Karimov , Edon Kelmendi , Joël Ouaknine , James Worrell

We establish a connection between trend filtering and system identification which results in a family of new identification methods for linear, time-varying (LTV) dynamical models based on convex optimization. We demonstrate how the design…

Systems and Control · Computer Science 2018-02-28 Fredrik Bagge Carlson , Anders Robertsson , Rolf Johansson

The main purpose of this paper is to formulate new conditions for smooth linearization of nonautonomous systems with discrete and continuous time. Our results assume that the linear part admits a nonuniform polynomial dichotomy and that the…

Dynamical Systems · Mathematics 2022-10-11 Lucas Backes , Davor Dragicevic , Wenmeng Zhang

We consider the problem of learning the parameters of a $N$-dimensional stochastic linear dynamics under both full and partial observations from a single trajectory of time $T$. We introduce and analyze a new estimator that achieves a small…

Machine Learning · Statistics 2025-12-08 Minh Vu , Andrey Y. Lokhov , Marc Vuffray

We give the first provably efficient algorithms for learning neural networks with distribution shift. We work in the Testable Learning with Distribution Shift framework (TDS learning) of Klivans et al. (2024), where the learner receives…

Data Structures and Algorithms · Computer Science 2025-02-25 Gautam Chandrasekaran , Adam R. Klivans , Lin Lin Lee , Konstantinos Stavropoulos