English
Related papers

Related papers: LQR with Tracking: A Zeroth-order Approach and Its…

200 papers

Iterative linear quadratic regulator (iLQR) has gained wide popularity in addressing trajectory optimization problems with nonlinear system models. However, as a model-based shooting method, it relies heavily on an accurate system model to…

Machine Learning · Computer Science 2022-09-16 Zilong Cheng , Yulin Li , Kai Chen , Jun Ma , Tong Heng Lee

We develop a model-free learning algorithm for the infinite-horizon linear quadratic regulator (LQR) problem. Specifically, (risk) constraints and structured feedback are considered, in order to reduce the state deviation while allowing for…

Optimization and Control · Mathematics 2022-04-06 Kyung-bin Kwon , Lintao Ye , Vijay Gupta , Hao Zhu

We address the problem of designing an LQR controller in a distributed setting, where M similar but not identical systems share their locally computed policy gradient (PG) estimates with a server that aggregates the estimates and computes a…

Optimization and Control · Mathematics 2024-04-16 Leonardo F. Toso , Han Wang , James Anderson

This paper studies the robustness of policy iteration in the context of continuous-time infinite-horizon linear quadratic regulation (LQR) problem. It is shown that Kleinman's policy iteration algorithm is inherently robust to small…

Systems and Control · Electrical Eng. & Systems 2020-09-01 Bo Pang , Tao Bian , Zhong-Ping Jiang

The Linear Quadratic Regulator (LQR), which is arguably the most classical problem in control theory, was recently related to kernel methods in (Aubin-Frankowski, SICON, 2021) for finite dimensional systems. We show that this result extends…

Optimization and Control · Mathematics 2022-10-12 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

The Linear Quadratic Regulator (LQR) framework considers the problem of regulating a linear dynamical system perturbed by environmental noise. We compute the policy regret between three distinct control policies: i) the optimal online…

Optimization and Control · Mathematics 2020-02-10 Gautam Goel , Babak Hassibi

This article presents a method to automatically generate energy-optimal trajectories for systems with linear dynamics, linear constraints, and a quadratic cost functional (LQ systems). First, using recent advancements in optimal control, we…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Logan E. Beaver

In this paper, we discuss an approximation strategy for solving the Linear Quadratic Tracking that is both forward and local in time. We exploit the known form of the value function along with a time reversal transformation that nicely…

Optimization and Control · Mathematics 2023-01-02 Alessandro Betti , Michele Casoni , Marco Gori

Recent developments in cyber-physical systems and event-triggered control have led to an increased interest in the impact of sparse disturbances on dynamical processes. We study Linear Quadratic Regulator (LQR) control under sparse…

Systems and Control · Electrical Eng. & Systems 2022-09-23 Samuel Pfrommer , Somayeh Sojoudi

This paper introduces a receding horizon like control scheme for localizable distributed systems, in which the effect of each local disturbance is limited spatially and temporally. We characterize such systems by a set of linear equality…

Systems and Control · Computer Science 2014-09-24 Yuh-Shyang Wang , Nikolai Matni , John C. Doyle

In this paper we present a set of projection-based designs for constructing simplified linear quadratic regulator (LQR) controllers for large-scale network systems. When such systems have tens of thousands of states, the design of…

Systems and Control · Computer Science 2017-10-05 Nan Xue , Aranya Chakrabortty

We study in this paper the linear quadratic optimal control (linear quadratic regulation, LQR for short) for discrete-time complex-valued linear systems, which have shown to have several potential applications in control theory. Firstly, an…

Optimization and Control · Mathematics 2017-09-18 Bin Zhou

Direct policy search has achieved great empirical success in reinforcement learning. Many recent studies have revisited its theoretical foundation for continuous control, which reveals elegant nonconvex geometry in various benchmark…

Optimization and Control · Mathematics 2023-12-27 Yang Zheng , Chih-fan Pai , Yujie Tang

This paper addresses the inverse optimal control for the linear quadratic tracking problem with a fixed but unknown target state, which aims to estimate the possible triplets comprising the target state, the state weight matrix, and the…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Yao Li , Chengpu Yu , Hao Fang , Jie Chen

The linear quadratic regulator (LQR) problem has reemerged as an important theoretical benchmark for reinforcement learning-based control of complex dynamical systems with continuous state and action spaces. In contrast with nearly all…

Machine Learning · Computer Science 2020-05-04 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

We consider a class of $\ell_0$-regularized linear-quadratic (LQ) optimal control problems. This class of problems is obtained by augmenting a penalizing sparsity measure to the cost objective of the standard linear-quadratic regulator…

Optimization and Control · Mathematics 2015-07-31 MirSaleh Bahavarnia

For various typical cases and situations where the formulation results in an optimal control problem, the Linear Quadratic Regulator (LQR) approach and its variants continue to be highly attractive. In certain scenarios, it can happen that…

Optimization and Control · Mathematics 2023-02-14 Jun Ma , Zilong Cheng , Xiaocong Li , Wenxin Wang , Masayoshi Tomizuka , Tong Heng Lee

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

Linear Quadratic Regulators (LQR) achieve enormous successful real-world applications. Very recently, people have been focusing on efficient learning algorithms for LQRs when their dynamics are unknown. Existing results effectively learn to…

Machine Learning · Computer Science 2021-02-15 Tianyu Wang , Lin F. Yang

This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the…

Optimization and Control · Mathematics 2022-11-22 Ugo Rosolia , Yuxiao Chen , Shreyansh Daftry , Masahiro Ono , Yisong Yue , Aaron D. Ames