English
Related papers

Related papers: Model-Free Output Feedback Stabilization via Polic…

200 papers

In this paper we propose a methodology for stabilizing single-input single-output feedback linearizable systems when no system model is known and no prior data is available to identify a model. Conceptually, we have been greatly inspired by…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Lucas Fraile , Matteo Marchi , Paulo Tabuada

Policy gradient (PG) methods have played an essential role in the empirical successes of reinforcement learning. In order to handle large state-action spaces, PG methods are typically used with function approximation. In this setting, the…

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

Machine Learning · Computer Science 2023-05-16 Adithya Ramesh , Balaraman Ravindran

The OGY method is one of control methods for a chaotic system. In the method, we have to calculate a stabilizing periodic orbit embedded in its chaotic attractor. Thus, we cannot use this method in the case where a precise mathematical…

Systems and Control · Electrical Eng. & Systems 2019-08-27 Junya Ikemoto , Toshimitsu Ushio

ReParameterization (RP) Policy Gradient Methods (PGMs) have been widely adopted for continuous control tasks in robotics and computer graphics. However, recent studies have revealed that, when applied to long-term reinforcement learning…

Machine Learning · Computer Science 2023-11-01 Shenao Zhang , Boyi Liu , Zhaoran Wang , Tuo Zhao

In this paper, we propose a model-free feedback solution method to solve generic constrained optimization problems, without knowing the specific formulations of the objective and constraint functions. This solution method is termed…

Optimization and Control · Mathematics 2022-06-23 Xin Chen , Jorge I. Poveda , Na Li

Control using quantized feedback is a fundamental approach to system synthesis with limited communication capacity. In this paper, we address the stabilization problem for unknown linear systems with logarithmically quantized feedback, via…

Optimization and Control · Mathematics 2022-03-11 Feiran Zhao , Xingchen Li , Keyou You

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

This paper presents a novel framework for stabilizing nonlinear systems represented in state-dependent form. We first reformulate the nonlinear dynamics as a state-dependent parameter-varying model and synthesize a stabilizing controller…

Systems and Control · Electrical Eng. & Systems 2025-10-21 Lidong Li , Rui Huang , Lin Zhao

Data-driven control strategies for dynamical systems with unknown parameters are popular in theory and applications. An essential problem is to prevent stochastic linear systems becoming destabilized, due to the uncertainty of the…

Systems and Control · Computer Science 2019-05-20 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

We revisit in this paper the discrete-time linear quadratic regulator (LQR) problem from the perspective of receding-horizon policy gradient (RHPG), a newly developed model-free learning framework for control applications. We provide a…

Optimization and Control · Mathematics 2024-02-02 Xiangyuan Zhang , Tamer Başar

This work provides a framework for nonlinear model-free control of systems with unknown input-output dynamics, but outputs that can be controlled by the inputs. This framework leads to real-time control of the system such that a feasible…

Systems and Control · Electrical Eng. & Systems 2019-08-13 Amit K. Sanyal

We consider the problem of learning stabilizable systems governed by nonlinear state equation $h_{t+1}=\phi(h_t,u_t;\theta)+w_t$. Here $\theta$ is the unknown system dynamics, $h_t $ is the state, $u_t$ is the input and $w_t$ is the…

Machine Learning · Computer Science 2021-11-22 Yahya Sattar , Samet Oymak

This paper considers the problem of regulating a linear dynamical system to the solution of a convex optimization problem with an unknown or partially-known cost. We design a data-driven feedback controller - based on gradient flow dynamics…

Optimization and Control · Mathematics 2022-04-05 Liliaokeawawa Cothren , Gianluca Bianchin , Emiliano Dall'Anese

Lane change is a challenging task which requires delicate actions to ensure safety and comfort. Some recent studies have attempted to solve the lane-change control problem with Reinforcement Learning (RL), yet the action is confined to…

Robotics · Computer Science 2019-06-07 Pin Wang , Hanhan Li , Ching-Yao Chan

Choosing an appropriate parameter set for the designed controller is critical for the final performance but usually requires a tedious and careful tuning process, which implies a strong need for automatic tuning methods. However, among…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Yuheng Lei , Jianyu Chen , Shengbo Eben Li , Sifa Zheng

This paper presents a robust reinforcement learning algorithm called robust deterministic policy gradient (RDPG), which reformulates the H-infinity control problem as a two-player zero-sum dynamic game between a user and an adversary. The…

Robotics · Computer Science 2025-12-04 Taeho Lee , Donghwan Lee

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This paper introduces a framework for learning a minimum-norm stabilizing controller for a system with unknown dynamics using model-free policy optimization methods. The approach begins by first designing a Control Lyapunov Function (CLF)…

Optimization and Control · Mathematics 2020-10-02 Tyler Westenbroek , Fernando Castaneda , Ayush Agrawal , S. Shankar Sastry , Koushil Sreenath

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil