English
Related papers

Related papers: Learning linear dynamical systems under convex con…

200 papers

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

A new approach to design of nonlinear observers (state estimators) is proposed. The main idea is to (i) construct a convex set of dynamical systems which are contracting observers for a particular system, and (ii) optimize over this set for…

Systems and Control · Computer Science 2017-11-23 Ian R. Manchester

Autoregressive exogenous (ARX) systems are the general class of input-output dynamical systems used for modeling stochastic linear dynamical systems (LDS) including partially observable LDS such as LQG systems. In this work, we study the…

Machine Learning · Computer Science 2021-08-30 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

We consider the problem of minimizing a convex function that is evolving according to unknown and possibly stochastic dynamics, which may depend jointly on time and on the decision variable itself. Such problems abound in the machine…

Optimization and Control · Mathematics 2023-05-30 Joshua Cutler , Dmitriy Drusvyatskiy , Zaid Harchaoui

We propose a sparse regression method capable of discovering the governing partial differential equation(s) of a given system by time series measurements in the spatial domain. The regression framework relies on sparsity promoting…

Pattern Formation and Solitons · Physics 2016-09-22 Samuel H. Rudy , Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

This manuscript studies statistical properties of linear classifiers obtained through minimization of an unregularized convex risk over a finite sample. Although the results are explicitly finite-dimensional, inputs may be passed through…

Machine Learning · Computer Science 2012-06-15 Matus Telgarsky

A novel adaptive identifier is developed for nonlinear time-delay systems composed of linear, Lipschitz and non-Lipschitz components. To begin with, an identifier is designed for uncertain systems with a priori known delay values, and then…

Systems and Control · Electrical Eng. & Systems 2020-05-06 Igor Furtat , Yury Orlov

This paper explores the observability and estimation capability of dynamical systems using predominantly relative measurements of the system's state-space variables, with minimal to no reliance on absolute measurements of these variables.…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Ioannis Raptis

We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Carlo Novara , Angelo Nicolì , Giuseppe C. Calafiore

We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems…

Optimization and Control · Mathematics 2026-05-18 Anik Kumar Paul , Shalabh Bhatnagar

We study the problem of learning to predict the next state of a dynamical system when the underlying evolution function is unknown. Unlike previous work, we place no parametric assumptions on the dynamical system, and study the problem from…

Machine Learning · Computer Science 2025-06-04 Vinod Raman , Unique Subedi , Ambuj Tewari

A learning-based safety filter is developed for discrete-time linear time-invariant systems with unknown models subject to Gaussian noises with unknown covariance. Safety is characterized using polytopic constraints on the states and…

Machine Learning · Computer Science 2023-05-09 Farhad Farokhi , Alex S. Leong , Mohammad Zamani , Iman Shames

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

Stability analysis and control of linear impulsive systems is addressed in a hybrid framework, through the use of continuous-time time-varying discontinuous Lyapunov functions. Necessary and sufficient conditions for stability of impulsive…

Optimization and Control · Mathematics 2013-11-15 Corentin Briat

Recently, Horv\'ath, Song, and Terlaky [\emph{A novel unified approach to invariance condition of dynamical system, submitted to Applied Mathematics and Computation}] proposed a novel unified approach to study, i.e., invariance conditions,…

Dynamical Systems · Mathematics 2016-09-06 Zoltán Horváth , Yunfei Song , Tamás Terlaky

We propose two practical non-convex approaches for learning near-isometric, linear embeddings of finite sets of data points. Given a set of training points $\mathcal{X}$, we consider the secant set $S(\mathcal{X})$ that consists of all…

Machine Learning · Statistics 2016-04-26 Jerry Luo , Kayla Shapiro , Hao-Jun Michael Shi , Qi Yang , Kan Zhu

This paper provides a comprehensive estimation framework for large covariance matrices via a log-det heuristics augmented by a nuclear norm plus $\ell_{1}$-norm penalty. We develop the model framework, which includes high-dimensional…

Statistics Theory · Mathematics 2025-05-06 Enrico Bernardi , Matteo Farnè

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

Information Theory · Computer Science 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi

Accurately modeling and verifying the correct operation of systems interacting in dynamic environments is challenging. By leveraging parametric uncertainty within the model description, one can relax the requirement to describe exactly the…

Optimization and Control · Mathematics 2016-04-05 Patrick Holmes , Shreyas Kousik , Shankar Mohan , Ram Vasudevan