English
Related papers

Related papers: Learning to Control under Uncertainty with Data-Ba…

200 papers

In this paper, we directly design a state feedback controller that stabilizes a class of uncertain nonlinear systems solely based on input-state data collected from a finite-length experiment. Necessary and sufficient conditions are derived…

Systems and Control · Electrical Eng. & Systems 2021-03-30 Alessandro Luppi , Claudio De Persis , Pietro Tesi

The data-driven linear quadratic regulator (ddLQR) is a widely studied control method for unknown dynamical systems with disturbance. Existing approaches, both indirect, i.e., those that identify a model followed by model-based design, and…

Optimization and Control · Mathematics 2026-04-13 Thierry Schwaller , Feiran Zhao , Florian Dörfler

We study the problem of adaptive control of the linear quadratic regulator for systems in very high, or even infinite dimension. We demonstrate that while sublinear regret requires finite dimensional inputs, the ambient state dimension of…

Optimization and Control · Mathematics 2021-07-16 Juan C. Perdomo , Max Simchowitz , Alekh Agarwal , Peter Bartlett

This paper examines stochastic optimal control problems in which the state is perfectly known, but the controller's measure of time is a stochastic process derived from a strictly increasing L\'evy process. We provide dynamic programming…

Optimization and Control · Mathematics 2014-01-03 Andrew Lamperski , Noah J. Cowan

We present a framework for learning of modeling uncertainties in Linear Time Invariant (LTI) systems. We propose a methodology to extend the dynamics of an LTI (without uncertainty) with an uncertainty model, based on measured data, to…

Systems and Control · Electrical Eng. & Systems 2023-11-01 Farhad Ghanipoor , Carlos Murguia , Peyman Mohajerin Esfahani , Nathan van de Wouw

Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothesis, while recent…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Han Wang , Di Wu , Lin Cheng , Shengping Gong , Xu Huang

We consider the problem of controlling a possibly unknown linear dynamical system with adversarial perturbations, adversarially chosen convex loss functions, and partially observed states, known as non-stochastic control. We introduce a…

Machine Learning · Computer Science 2020-06-26 Max Simchowitz , Karan Singh , Elad Hazan

In this paper, we consider the closed-loop control problem of nonlinear robotic systems in the presence of probabilistic uncertainties and disturbances. More precisely, we design a state feedback controller that minimizes deviations of the…

Robotics · Computer Science 2023-08-15 Weiqiao Han , Ashkan Jasour , Brian Williams

We study in this paper the linear quadratic optimal control (linear quadratic regulation, LQR for short) for discrete-time complex-valued linear systems, which have shown to have several potential applications in control theory. Firstly, an…

Optimization and Control · Mathematics 2017-09-18 Bin Zhou

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh

The linear quadratic regulator (LQR) problem is a cornerstone of automatic control, and it has been widely studied in the data-driven setting. The various data-driven approaches can be classified as indirect (i.e., based on an identified…

Optimization and Control · Mathematics 2021-09-15 Florian Dörfler , Pietro Tesi , Claudio De Persis

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial…

Systems and Control · Electrical Eng. & Systems 2022-02-11 Robin Strässer , Julian Berberich , Frank Allgöwer

This study presents a physics-informed machine learning-based control method for nonlinear dynamic systems with highly noisy measurements. Existing data-driven control methods that use machine learning for system identification cannot…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Mason Ma , Jiajie Wu , Chase Post , Tony Shi , Jingang Yi , Tony Schmitz , Hong Wang

Learning models or control policies from data has become a powerful tool to improve the performance of uncertain systems. While a strong focus has been placed on increasing the amount and quality of data to improve performance, data can…

Systems and Control · Electrical Eng. & Systems 2024-10-02 Ralf Römer , Lukas Brunke , Siqi Zhou , Angela P. Schoellig

As the benchmark of data-driven control methods, the linear quadratic regulator (LQR) problem has gained significant attention. A growing trend is direct LQR design, which finds the optimal LQR gain directly from raw data and bypassing…

Systems and Control · Electrical Eng. & Systems 2025-03-06 Feiran Zhao , Alessandro Chiuso , Florian Dörfler

Declines in cost and concerns about the environmental impact of traditional generation have boosted the penetration of renewables and non-conventional distributed energy resources into the power grid. The intermittent availability of these…

Systems and Control · Electrical Eng. & Systems 2022-03-10 Priyank Srivastava , Patricia Hidalgo-Gonzalez , Jorge Cortes

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

Recent research has shown that supervised learning can be an effective tool for designing optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of these neural network (NN) controllers is still not…

Optimization and Control · Mathematics 2022-10-10 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

In this paper, we investigate a continuous-time linear quadratic control problem for systems with unknown matrices, where only input-output data are available. We propose an output-feedback learning framework based on a canonical nonminimal…

Optimization and Control · Mathematics 2026-05-19 Weijian Li , Bowen Yi , Panos J. Antsaklis , Hai Lin