English
Related papers

Related papers: Learning Linear Dynamical Systems via Spectral Fil…

200 papers

We give a polynomial-time algorithm for learning latent-state linear dynamical systems without system identification, and without assumptions on the spectral radius of the system's transition matrix. The algorithm extends the recently…

Machine Learning · Computer Science 2018-02-13 Elad Hazan , Holden Lee , Karan Singh , Cyril Zhang , Yi Zhang

There has been much recent progress in forecasting the next observation of a linear dynamical system (LDS), which is known as the improper learning, as well as in the estimation of its system matrices, which is known as the proper learning…

Optimization and Control · Mathematics 2024-02-28 Quan Zhou , Jakub Marecek

We propose a new method for controlling linear dynamical systems under adversarial disturbances and cost functions. Our algorithm achieves a running time that scales polylogarithmically with the inverse of the stability margin, improving…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Anand Brahmbhatt , Gon Buzaglo , Sofiia Druchyna , Elad Hazan

We study the fundamental problem of learning a marginally stable unknown nonlinear dynamical system. We describe an algorithm for this problem, based on the technique of spectral filtering, which learns a mapping from past observations to…

Machine Learning · Computer Science 2025-08-19 Evan Dogariu , Anand Brahmbhatt , Elad Hazan

We propose a principled method for projecting an arbitrary square matrix to the non-convex set of asymptotically stable matrices. Leveraging ideas from large deviations theory, we show that this projection is optimal in an…

Optimization and Control · Mathematics 2023-06-21 Wouter Jongeneel , Tobias Sutter , Daniel Kuhn

Kalman filter is a key tool for time-series forecasting and analysis. We show that the dependence of a prediction of Kalman filter on the past is decaying exponentially, whenever the process noise is non-degenerate. Therefore, Kalman filter…

Statistics Theory · Mathematics 2019-09-24 Mark Kozdoba , Jakub Marecek , Tigran Tchrakian , Shie Mannor

We study the problem of learning a mixture of multiple linear dynamical systems (LDSs) from unlabeled short sample trajectories, each generated by one of the LDS models. Despite the wide applicability of mixture models for time-series data,…

Machine Learning · Statistics 2022-05-26 Yanxi Chen , H. Vincent Poor

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

We present an efficient and practical (polynomial time) algorithm for online prediction in unknown and partially observed linear dynamical systems (LDS) under stochastic noise. When the system parameters are known, the optimal linear…

Machine Learning · Computer Science 2020-10-13 Paria Rashidinejad , Jiantao Jiao , Stuart Russell

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

Optimization and Control · Mathematics 2022-11-17 Marko Nonhoff , Matthias A. Müller

Linear dynamical systems are a fundamental and powerful parametric model class. However, identifying the parameters of a linear dynamical system is a venerable task, permitting provably efficient solutions only in special cases. This work…

Machine Learning · Computer Science 2020-03-03 Chloe Ching-Yun Hsu , Michaela Hardt , Moritz Hardt

Encoding time-series with Linear Dynamical Systems (LDSs) leads to rich models with applications ranging from dynamical texture recognition to video segmentation to name a few. In this paper, we propose to represent LDSs with…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Wenbing Huang , Fuchun Sun , Lele Cao , Mehrtash Harandi

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

Machine Learning · Computer Science 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

Linear Dynamical System (LDS) is an elegant mathematical framework for modeling and learning multivariate time series. However, in general, it is difficult to set the dimension of its hidden state space. A small number of hidden states may…

Artificial Intelligence · Computer Science 2013-12-04 Zitao Liu , Milos Hauskrecht

We address the problem of learning the parameters of a stable linear time invariant (LTI) system or linear dynamical system (LDS) with unknown latent space dimension, or order, from a single time--series of noisy input-output data. We focus…

Systems and Control · Computer Science 2020-04-09 Tuhin Sarkar , Alexander Rakhlin , Munther A. Dahleh

This paper investigates the problem of identifying state-dependent switching systems, a class of hybrid dynamical systems that combine multiple linear or nonlinear modes. We propose two broad classes of switching systems: switching linear…

Optimization and Control · Mathematics 2025-09-30 Kaito Iwasaki , Sangli Teng , Anthony Bloch , Maani Ghaffari

We consider the problem of computing the maximal invariant set of discrete-time linear systems subject to a class of non-convex constraints that admit quadratic relaxations. These non-convex constraints include semialgebraic sets and other…

Systems and Control · Electrical Eng. & Systems 2020-11-30 Zheming Wang , Raphaël M. Jungers , Chong-Jin Ong

Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear…

Machine Learning · Statistics 2024-01-03 Aditya Modi , Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis
‹ Prev 1 2 3 10 Next ›