English
Related papers

Related papers: Output-feedback online optimal control for a class…

200 papers

In this paper, we investigate the optimal output tracking problem for linear discrete-time systems with unknown dynamics using reinforcement learning and robust output regulation theory. This output tracking problem only allows to utilize…

Dynamical Systems · Mathematics 2021-01-22 Ci Chen , Lihua Xie , Yi Jiang , Kan Xie , Shengli Xie

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

Recent works in Reinforcement Learning (RL) combine model-free (Mf)-RL algorithms with model-based (Mb)-RL approaches to get the best from both: asymptotic performance of Mf-RL and high sample-efficiency of Mb-RL. Inspired by these works,…

Inverse reinforcement learning (IRL) is the problem of inferring a reward function from expert behavior. There are several approaches to IRL, but most are designed to learn a Markovian reward. However, a reward function might be…

Machine Learning · Computer Science 2024-06-21 Noah Topper , Alvaro Velasquez , George Atia

We study in this paper the problem of adaptive trajectory tracking control for a class of nonlinear systems with parametric uncertainties. We propose to use a modular approach, where we first design a robust nonlinear state feedback which…

Systems and Control · Computer Science 2015-09-28 Mouhacine Benosman , Amir-massoud Farahmand , Meng Xia

This paper explores multiple optimization methods to improve the performance of rating-based reinforcement learning (RbRL). RbRL, a method based on the idea of human ratings, has been developed to infer reward functions in reward-free…

Machine Learning · Computer Science 2025-01-15 Evelyn Rose , Devin White , Mingkang Wu , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Offline reinforcement learning (RL) enables policy optimization using static datasets, avoiding the risks and costs of extensive real-world exploration. However, it struggles with suboptimal offline behaviors and inaccurate value estimation…

Machine Learning · Computer Science 2025-05-20 Minting Pan , Yitao Zheng , Jiajian Li , Yunbo Wang , Xiaokang Yang

Model-Based Reinforcement Learning (MBRL) is one category of Reinforcement Learning (RL) algorithms which can improve sampling efficiency by modeling and approximating system dynamics. It has been widely adopted in the research of robotics,…

Machine Learning · Computer Science 2021-03-17 Linsen Dong , Guanyu Gao , Xinyi Zhang , Liangyu Chen , Yonggang Wen

This paper provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with unknown drift dynamics. Model-based reinforcement learning is used to…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Lindsey Andrews , Patrick Walters , Warren E. Dixon

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Model-based reinforcement learning (MBRL) typically relies on modeling environment dynamics for data efficiency. However, due to the accumulation of model errors over long-horizon rollouts, such methods often face challenges in maintaining…

Machine Learning · Computer Science 2026-01-06 Bin Wang , Boxiang Tao , Haifeng Jing , Hongbo Dou , Zijian Wang

We address the problem of output reference tracking for unknown nonlinear multi-input, multi-output systems with relative degree two and bounded-input bounded-state (BIBS) stable internal dynamics. We propose a novel model-free adaptive…

Optimization and Control · Mathematics 2025-12-22 D. Dennstädt , J. Schaa , T. Berger

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

An adaptive funnel control method is considered for the regulation of the output for a class of nonlinear infinite-dimensional systems on real Hilbert spaces. After a decomposition of the state space and some change of variables related to…

Optimization and Control · Mathematics 2022-04-06 Anthony Hastir , Joseph J. Winkin , Denis Dochain

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs).…

Machine Learning · Computer Science 2022-11-10 Max H. Cohen , Calin Belta

The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a…

Machine Learning · Computer Science 2022-03-25 Ran Wang , Karthikeya S. Parunandi , Aayushman Sharma , Raman Goyal , Suman Chakravorty

A limitation of model-based reinforcement learning (MBRL) is the exploitation of errors in the learned models. Black-box models can fit complex dynamics with high fidelity, but their behavior is undefined outside of the data…

Robotics · Computer Science 2020-11-04 Michael Lutter , Johannes Silberbauer , Joe Watson , Jan Peters