English
Related papers

Related papers: On the Effect of Instability on Learning Continuou…

200 papers

Stochastic stability is a popular solution concept for stochastic learning dynamics in games. However, a critical limitation of this solution concept is its inability to distinguish between different learning rules that lead to the same…

Machine Learning · Computer Science 2018-04-10 Hassan Jaleel , Jeff S. Shamma

This paper studies the stochastic optimal control problem for systems with unknown dynamics. First, an open-loop deterministic trajectory optimization problem is solved without knowing the explicit form of the dynamical system. Next, a…

Systems and Control · Computer Science 2017-05-30 Dan Yu , Mohammadhussein Rafieisakhaei , Suman Chakravorty

In this paper, a non-autonomous stochastic logistic system is considered. An interesting result on the effect of stochastically perturbation for the dynamic behavior are obtained. That is, under certain conditions the stochastic system have…

Dynamical Systems · Mathematics 2012-08-08 Hu Hongxiao

Stabilizing an unknown dynamical system is one of the central problems in control theory. In this paper, we study the sample complexity of the learn-to-stabilize problem in Linear Time-Invariant (LTI) systems on a single trajectory. Current…

Optimization and Control · Mathematics 2022-02-16 Yang Hu , Adam Wierman , Guannan Qu

While the identification of nonlinear dynamical systems is a fundamental building block of model-based reinforcement learning and feedback control, its sample complexity is only understood for systems that either have discrete states and…

Machine Learning · Statistics 2020-06-19 Horia Mania , Michael I. Jordan , Benjamin Recht

In this work we analyze and bound the effect of modeling errors on the stabilization of pure states or subspaces for quantum stochastic evolutions. Different approaches are used for open-loop and feedback control protocols. For both, we…

Quantum Physics · Physics 2024-09-27 Weichao Liang , Kentaro Ohki , Francesco Ticozzi

We provide a brief tutorial on the use of concentration inequalities as they apply to system identification of state-space parameters of linear time invariant systems, with a focus on the fully observed setting. We draw upon tools from the…

Optimization and Control · Mathematics 2019-08-30 Nikolai Matni , Stephen Tu

Despite the existence of formal guarantees for learning-based control approaches, the relationship between data and control performance is still poorly understood. In this paper, we propose a Lyapunov-based measure for quantifying the…

Systems and Control · Electrical Eng. & Systems 2021-08-02 Armin Lederer , Alexandre Capone , Thomas Beckers , Jonas Umlauft , Sandra Hirche

Stabilization of linear systems with unknown dynamics is a canonical problem in adaptive control. Since the lack of knowledge of system parameters can cause it to become destabilized, an adaptive stabilization procedure is needed prior to…

Systems and Control · Computer Science 2018-07-25 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

Electricity systems are experiencing increased effects of randomness and variability due to emerging stochastic assets. The increased effects introduce new uncertainties into power systems that can impact system operability and reliability.…

Systems and Control · Electrical Eng. & Systems 2022-11-10 Naeem Turner-Bandele , Amritanshu Pandey , Larry Pileggi

A fundamental challenge in learning an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. We formulate a mathematical definition of what it means to safely learn a dynamical system by…

Optimization and Control · Mathematics 2024-06-11 Amir Ali Ahmadi , Abraar Chaudhry , Vikas Sindhwani , Stephen Tu

Chaotic systems are notoriously challenging to predict because of their sensitivity to perturbations and errors due to time stepping. Despite this unpredictable behavior, for many dissipative systems the statistics of the long term…

Identification of a linear time-invariant dynamical system from partial observations is a fundamental problem in control theory. Particularly challenging are systems exhibiting long-term memory. A natural question is how learn such systems…

Machine Learning · Computer Science 2022-03-08 Holden Lee

This paper studies the stability and $\mathcal{H}_{\infty}$ performance analysis problem for linear networked and quantized control systems with both communication delays random packet losses. To deal with the network-induced uncertainties…

Systems and Control · Electrical Eng. & Systems 2021-03-05 Wei Ren , Junlin Xiong

We investigate stability analysis and controller design of unknown continuous-time systems under state-feedback with aperiodic sampling, using only noisy data but no model knowledge. We first derive a novel data-dependent parametrization of…

Optimization and Control · Mathematics 2022-08-26 Julian Berberich , Stefan Wildhagen , Michael Hertneck , Frank Allgöwer

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

This work proposes a new method for simultaneous probabilistic identification and control of an observable, fully-actuated mechanical system. Identification is achieved by conditioning stochastic process priors on observations of…

Machine Learning · Computer Science 2014-04-02 Jan-Peter Calliess , Antonis Papachristodoulou , Stephen J. Roberts

The theory of covariance control and covariance steering (CS) deals with controlling the dispersion of trajectories of a dynamical system, under the implicit assumption that accurate prior knowledge of the system being controlled is…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Joshua Pilipovsky , Panagiotis Tsiotras

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

We develop a generalized stability framework for stochastic discrete-time systems, where the generality pertains to the ways in which the distribution of the state energy can be characterized. We use tools from finance and operations…

Systems and Control · Electrical Eng. & Systems 2022-11-23 Margaret P. Chapman , Dionysios S. Kalogerias