Related papers: Linear quadratic regulation control for falling li…
This paper presents a convex optimization-based solution to the design of state-feedback controllers for solving the linear quadratic regulator (LQR) problem of uncertain discrete-time systems with multiplicative noise. To synthesize a…
We consider linear feedback flow control of the largest scales in an incompressible turbulent channel flow at a friction Reynolds number of Re$_{\tau}$ = 2000. A linear model is formed by linearizing the Navier-Stokes equations about the…
This paper presents a state and state-input constrained variant of the discrete-time iterative Linear Quadratic Regulator (iLQR) algorithm, with linear time-complexity in the number of time steps. The approach is based on a projection of…
The control of nonlinear large-scale dynamical models such as the incompressible Navier-Stokes equations is a challenging task. The computational challenges in the controller design come from both the possibly large state space and the…
Understanding the optimization landscape of linear quadratic regulation (LQR) problems is fundamental to the design of efficient reinforcement learning solutions. Recent work has made significant progress in characterizing the landscape of…
We consider the continuous-time Linear-Quadratic-Regulator (LQR) problem in terms of optimizing a real-valued matrix function over the set of feedback gains. The results developed are in parallel to those in Bu et al. [1] for discrete-time…
To address the operational challenges of in-pipe robots in large pipes of water distribution systems (WDS), in this research, a control algorithm is proposed for our previously designed robot [4]. Our size adaptable robot has an…
This letter presents a robust data-driven receding-horizon control framework for the discrete time linear quadratic regulator (LQR) with input constraints. Unlike existing data-driven approaches that design a controller from initial data…
For linear time-invariant (LTI) systems, the design of an optimal controller is a commonly encountered problem in many applications. Among all the optimization approaches available, the linear quadratic regulator (LQR) methodology certainly…
This paper focuses on adaptive control of the discrete-time linear quadratic regulator (adaptive LQR). Recent literature has made significant contributions in proving non-asymptotic convergence rates, but existing approaches have a few…
We explore reinforcement learning methods for finding the optimal policy in the linear quadratic regulator (LQR) problem. In particular, we consider the convergence of policy gradient methods in the setting of known and unknown parameters.…
In this work, we develop and analyze adaptive feedback control strategies to stabilize and confine a nanoparticle at the unstable intensity minimum of an optical double-well potential. The resulting stochastic optimal control problem for a…
This article presents an error-state Linear Quadratic Regulator (LQR) formulation for robust trajectory tracking in quadrotor Unmanned Aerial Vehicles (UAVs). The proposed approach leverages error-state dynamics and employs exponential…
In this paper, we propose a nonintrusive filter-based stabilization of reduced order models (ROMs) for uncertainty quantification (UQ) of the time-dependent Navier-Stokes equations in convection-dominated regimes. We propose a novel…
We present an estimator-based control design procedure for flow control, using reduced-order models of the governing equations, linearized about a possibly unstable steady state. The reduced models are obtained using an approximate balanced…
Linear quadratic Gaussian (LQG) control is a well-established method for optimal control through state estimation, particularly in stabilizing an inverted pendulum on a cart. In standard laboratory setups, sensor redundancy enables direct…
This paper presents a novel direct data-driven control framework for solving the linear quadratic regulator (LQR) under disturbances and noisy state measurements. The system dynamics are assumed unknown, and the LQR solution is learned…
Considering channel flow at Reynolds numbers below the linear stability threshold of the laminar profile as a generic example system showing a subcritical transition to turbulence connected with the existence of simple invariant solutions,…
We explore order reduction techniques for solving the algebraic Riccati equation (ARE), and investigating the numerical solution of the linear-quadratic regulator problem (LQR). A classical approach is to build a surrogate low dimensional…
This paper studies the robustness of reinforcement learning algorithms to errors in the learning process. Specifically, we revisit the benchmark problem of discrete-time linear quadratic regulation (LQR) and study the long-standing open…