English
Related papers

Related papers: Learning Linear Dynamical Systems via Spectral Fil…

200 papers

We prove in this work that the well-known lasso problem can be solved exactly without homotopy using novel differential inclusions techniques. Specifically, we show that a selection principle from the theory of differential inclusions…

Optimization and Control · Mathematics 2025-10-21 Gabriel P. Langlois , Jérôme Darbon

In this report, we propose a new adaptive time filter algorithm for the unsteady Stokes/Darcy model. First we present a first order ${\theta}$-scheme with the variable time step which is one parameter family of Linear Multi-step methods and…

Numerical Analysis · Mathematics 2022-08-29 Yi Qin , Yang Wang , Yi Li , Jian Li

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse…

Machine Learning · Computer Science 2019-05-31 Ashok Cutkosky , Tamas Sarlos

We present a mathematical and computational framework for the problem of learning a dynamical system from noisy observations of a few trajectories and subject to side information. Side information is any knowledge we might have about the…

Optimization and Control · Mathematics 2022-01-19 Amir Ali Ahmadi , Bachir El Khadir

We present an algorithm for robust model predictive control with consideration of uncertainty and safety constraints. Our framework considers a nonlinear dynamical system subject to disturbances from an unknown but bounded uncertainty set.…

Optimization and Control · Mathematics 2021-04-23 Dongchan Lee , Konstantin Turitsyn , Jean-Jacques Slotine

We present a deep neural network for a model-free prediction of a chaotic dynamical system from noisy observations. The proposed deep learning model aims to predict the conditional probability distribution of a state variable. The Long…

Machine Learning · Computer Science 2017-10-05 Kyongmin Yeo

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

This paper proposes a new algorithm for linear system identification from noisy measurements. The proposed algorithm balances a data fidelity term with a norm induced by the set of single pole filters. We pose a convex optimization problem…

Optimization and Control · Mathematics 2012-04-04 Parikshit Shah , Badri Narayan Bhaskar , Gongguo Tang , Benjamin Recht

Anomaly detection for non-linear dynamical system plays an important role in ensuring the system stability. However, it is usually complex and has to be solved by large-scale simulation which requires extensive computing resources. In this…

Signal Processing · Electrical Eng. & Systems 2020-06-08 Yue Tan , Chunjing Hu , Kuan Zhang , Kan Zheng , Ethan A. Davis , Jae Sung Park

We provide several applications of Optimistic Mirror Descent, an online learning algorithm based on the idea of predictable sequences. First, we recover the Mirror Prox algorithm for offline optimization, prove an extension to Holder-smooth…

Machine Learning · Computer Science 2013-11-11 Alexander Rakhlin , Karthik Sridharan

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

We address the problem of learning the dynamics of an unknown non-parametric system linking a target and a feature time series. The feature time series is measured on a sparse and irregular grid, while we have access to only a few points of…

Machine Learning · Statistics 2023-06-01 Linus Bleistein , Adeline Fermanian , Anne-Sophie Jannot , Agathe Guilloux

This paper investigates the learning, or system identification, of a class of piecewise-affine dynamical systems known as linear complementarity systems (LCSs). We propose a violation-based loss which enables efficient learning of the LCS…

Machine Learning · Computer Science 2021-12-28 Wanxin Jin , Alp Aydinoglu , Mathew Halm , Michael Posa

While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have discrete states and…

Machine Learning · Statistics 2020-06-19 Horia Mania , Michael I. Jordan , Benjamin Recht

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

This paper studies sequence modeling for prediction tasks with long range dependencies. We propose a new formulation for state space models (SSMs) based on learning linear dynamical systems with the spectral filtering algorithm (Hazan et…

Machine Learning · Computer Science 2024-07-12 Naman Agarwal , Daniel Suo , Xinyi Chen , Elad Hazan

Supervised topic models simultaneously model the latent topic structure of large collections of documents and a response variable associated with each document. Existing inference methods are based on variational approximation or Monte…

Machine Learning · Computer Science 2016-02-22 Yong Ren , Yining Wang , Jun Zhu

In a dynamic network, the neighborhood of the vertices evolve across different temporal snapshots of the network. Accurate modeling of this temporal evolution can help solve complex tasks involving real-life social and interaction networks.…

Social and Information Networks · Computer Science 2018-04-17 Tanay Kumar Saha , Thomas Williams , Mohammad Al Hasan , Shafiq Joty , Nicholas K. Varberg

We study the bit complexity of inverting diagonally dominant matrices, which are associated with random walk quantities such as hitting times and escape probabilities. Such quantities can be exponentially small, even on undirected…

Data Structures and Algorithms · Computer Science 2025-10-23 Mehrdad Ghadiri , Hoai-An Nguyen , Junzhao Yang

Linear programming has played a crucial role in shaping decision-making, resource allocation, and cost reduction in various domains. In this paper, we investigate the application of overparametrized neural networks and their implicit bias…

Optimization and Control · Mathematics 2023-10-05 Haoyue Wang , Promit Ghosal , Rahul Mazumder
‹ Prev 1 8 9 10 Next ›