English
Related papers

Related papers: On the Hardness of Learning to Stabilize Linear Sy…

200 papers

There has been a recent interest in imitation learning methods that are guaranteed to produce a stabilizing control law with respect to a known system. Work in this area has generally considered linear systems and controllers, for which…

Optimization and Control · Mathematics 2021-09-23 Sebastian East

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system…

Machine Learning · Statistics 2025-05-09 Lei Xin , Baike She , Qi Dou , George Chiu , Shreyas Sundaram

A fundamental challenge in learning an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. We formulate a mathematical definition of what it means to safely learn a dynamical system by…

Optimization and Control · Mathematics 2024-06-11 Amir Ali Ahmadi , Abraar Chaudhry , Vikas Sindhwani , Stephen Tu

The reliability of a learning model is key to the successful deployment of machine learning in various applications. However, it is difficult to describe the phenomenon due to the complicated nature of the problems in machine learning. It…

Machine Learning · Computer Science 2025-05-27 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati

Stability is a basic requirement when studying the behavior of dynamical systems. However, stabilizing dynamical systems via reinforcement learning is challenging because only little data can be collected over short time horizons before…

Optimization and Control · Mathematics 2024-11-01 Steffen W. R. Werner , Benjamin Peherstorfer

We study the problem of learning to stabilize (LTS) a linear time-invariant (LTI) system. Policy gradient (PG) methods for control assume access to an initial stabilizing policy. However, designing such a policy for an unknown system is one…

Machine Learning · Computer Science 2025-05-07 Leonardo F. Toso , Lintao Ye , James Anderson

We derive generalization bounds for learning algorithms based on their robustness: the property that if a testing sample is "similar" to a training sample, then the testing error is close to the training error. This provides a novel…

Machine Learning · Computer Science 2015-03-17 Huan Xu , Shie Mannor

This tutorial paper provides an introduction to recently developed tools for machine learning, especially learning dynamical systems (system identification), with stability and robustness constraints. The main ideas are drawn from…

Systems and Control · Electrical Eng. & Systems 2021-10-04 Ian R. Manchester , Max Revay , Ruigang Wang

Current techniques in machine learning are so far are unable to learn classifiers that are robust to adversarial perturbations. However, they are able to learn non-robust classifiers with very high accuracy, even in the presence of random…

Machine Learning · Computer Science 2019-01-04 Preetum Nakkiran

For multi-class classification under class-conditional label noise, we prove that the accuracy metric itself can be robust. We concretize this finding's inspiration in two essential aspects: training and validation, with which we address…

Machine Learning · Computer Science 2020-12-09 Pengfei Chen , Junjie Ye , Guangyong Chen , Jingwei Zhao , Pheng-Ann Heng

Complex classifiers may exhibit "embarassing" failures in cases where humans can easily provide a justified classification. Avoiding such failures is obviously of key importance. In this work, we focus on one such setting, where a label is…

Machine Learning · Computer Science 2019-06-14 Deborah Cohen , Amit Daniely , Amir Globerson , Gal Elidan

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

This paper uses the notion of algorithmic stability to derive novel generalization bounds for several families of transductive regression algorithms, both by using convexity and closed-form solutions. Our analysis helps compare the…

Machine Learning · Computer Science 2009-04-07 Corinna Cortes , Mehryar Mohri , Dmitry Pechyony , Ashish Rastogi

Large language models have shown their ability to become effective few-shot learners with prompting, revolutionizing the paradigm of learning with data scarcity. However, this approach largely depends on the quality of prompt…

Computation and Language · Computer Science 2024-10-04 Xiaoming Liu , Chen Liu , Zhaohan Zhang , Chengzhengxu Li , Longtian Wang , Yu Lan , Chao Shen

Learning with limited labelled data, such as prompting, in-context learning, fine-tuning, meta-learning or few-shot learning, aims to effectively train a model using only a small amount of labelled samples. However, these approaches have…

Machine Learning · Computer Science 2024-12-03 Branislav Pecher , Ivan Srba , Maria Bielikova

A common problem to all applications of linear finite dynamical systems is analyzing the dynamics without enumerating every possible state transition. Of particular interest is the long term dynamical behaviour. In this paper, we study the…

Dynamical Systems · Mathematics 2019-04-01 Björn Lindenberg

Learning stable dynamics from observed time-series data is an essential problem in robotics, physical modeling, and systems biology. Many of these dynamics are represented as an inputs-output system to communicate with the external…

Dynamical Systems · Mathematics 2023-01-18 Yuji Okamoto , Ryosuke Kojima

This work primarily focuses on an operator inference methodology aimed at constructing low-dimensional dynamical models based on a priori hypotheses about their structure, often informed by established physics or expert insights. Stability…

Machine Learning · Computer Science 2024-03-04 Igor Pontes Duff , Pawan Goyal , Peter Benner

Nowadays we are witnessing a transformation of the business processes towards a more computation driven approach. The ever increasing usage of Machine Learning techniques is the clearest example of such trend. This sort of revolution is…

Machine Learning · Computer Science 2022-03-18 Giorgio Visani , Enrico Bagli , Federico Chesani , Alessandro Poluzzi , Davide Capuzzo