English
Related papers

Related papers: Model-free Nearly Optimal Control of Constrained-I…

200 papers

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothesis, while recent…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Han Wang , Di Wu , Lin Cheng , Shengping Gong , Xu Huang

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

This work presents a novel methodology for analysis and control of nonlinear fluid systems using neural networks. The approach is demonstrated on four different study cases being the Lorenz system, a modified version of the…

Fluid Dynamics · Physics 2023-08-28 Tarcísio Déda , William Wolf , Scott Dawson

This work provides a framework for nonlinear model-free control of systems with unknown input-output dynamics, but outputs that can be controlled by the inputs. This framework leads to real-time control of the system such that a feasible…

Systems and Control · Electrical Eng. & Systems 2019-08-13 Amit K. Sanyal

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

In this paper, we focus on the problem about direct way to design a stable controller for nonlinear system. A framework of learning controller with Lyapunov-based constraint is proposed, which is intended to transform designing and analyis…

Systems and Control · Computer Science 2019-03-11 Me Le , Chi Yanxun , Li Zhiwei , Xu Dongfu , Zhang Yulong

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

This study presents a policy optimisation framework for structured nonlinear control of continuous-time (deterministic) dynamic systems. The proposed approach prescribes a structure for the controller based on relevant scientific knowledge…

Machine Learning · Computer Science 2024-10-28 Namhoon Cho , Hyo-Sang Shin

In this paper, we propose a Lyapunov-based reinforcement learning method for distributed control of nonlinear systems comprising interacting subsystems with guaranteed closed-loop stability. Specifically, we conduct a detailed stability…

Systems and Control · Electrical Eng. & Systems 2024-12-17 Jingshi Yao , Minghao Han , Xunyuan Yin

Adaptive control is subject to stability and performance issues when a learned model is used to enhance its performance. This paper thus presents a deep learning-based adaptive control framework for nonlinear systems with…

Machine Learning · Computer Science 2021-10-05 Hiroyasu Tsukamoto , Soon-Jo Chung , Jean-Jacques Slotine

The stable combination of optimal feedback policies with online learning is studied in a new control-theoretic framework for uncertain nonlinear systems. The framework can be systematically used in transfer learning and sim-to-real…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Brett T. Lopez , Jean-Jacques E. Slotine

This paper introduces a continuous-time constrained nonlinear control scheme which implements a model predictive control strategy as a continuous-time dynamic system. The approach is based on the idea that the solution of the optimal…

Systems and Control · Computer Science 2017-09-20 Marco M. Nicotra , Dominic Liao-McPherson , Ilya V. Kolmanovsky

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This work proposes a two-layered control scheme for constrained nonlinear systems represented by a class of recurrent neural networks and affected by additive disturbances. In particular, a base controller ensures global or regional…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Daniele Ravasio , Danilo Saccani , Marcello Farina , Giancarlo Ferrari-Trecate

Traditional dynamic models of continuum robots are in general computationally expensive and not suitable for real-time control. Recent approaches using learning-based methods to approximate the dynamic model of continuum robots for control…

Robotics · Computer Science 2022-05-16 Xinran Wang , Nicolas Rojas

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

This paper provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with unknown drift dynamics. Model-based reinforcement learning is used to…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Lindsey Andrews , Patrick Walters , Warren E. Dixon