English
Related papers

Related papers: Adaptive Optimal Control for Reference Tracking In…

200 papers

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

This paper proposes a framework for adaptively learning a feedback linearization-based tracking controller for an unknown system using discrete-time model-free policy-gradient parameter update rules. The primary advantage of the scheme over…

Machine Learning · Computer Science 2020-04-07 Tyler Westenbroek , Eric Mazumdar , David Fridovich-Keil , Valmik Prabhu , Claire J. Tomlin , S. Shankar Sastry

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

We present one of the first algorithms on model based reinforcement learning and trajectory optimization with free final time horizon. Grounded on the optimal control theory and Dynamic Programming, we derive a set of backward differential…

Systems and Control · Computer Science 2015-09-04 Wei Sun , Evangelos Theodorou , Panagiotis Tsiotras

Autonomous navigation has recently gained great interest in the field of reinforcement learning. However, little attention was given to the time optimal velocity control problem, i.e. controlling a vehicle such that it travels at the…

Robotics · Computer Science 2019-07-26 Gabriel Hartmann , Zvi Shiller , Amos Azaria

This paper addresses the inverse optimal control problem of finding the state weighting function that leads to a quadratic value function when the cost on the input is fixed to be quadratic. The paper focuses on a class of infinite horizon…

Optimization and Control · Mathematics 2022-11-21 Luis Rodrigues

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Real-world physics can only be analytically modeled with a certain level of precision for modern intricate robotic systems. As a result, tracking aggressive trajectories accurately could be challenging due to the existence of residual…

Robotics · Computer Science 2026-04-16 Kexin Guo , Zihan Yang , Yuhang Liu , Jindou Jia , Xiang Yu

Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the…

Systems and Control · Electrical Eng. & Systems 2021-11-22 Efe C. Balta , Kira Barton , Dawn M. Tilbury , Alisa Rupenyan , John Lygeros

Recent success in deep reinforcement learning for continuous control has been dominated by model-free approaches which, unlike model-based approaches, do not suffer from representational limitations in making assumptions about the world…

Machine Learning · Computer Science 2019-05-07 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory…

Robotics · Computer Science 2022-02-03 Zihao Liang , Wanxin Jin , Shaoshuai Mou

We investigate the use of Reinforcement Learning for the optimal execution of meta-orders, where the objective is to execute incrementally large orders while minimizing implementation shortfall and market impact over an extended period of…

Trading and Market Microstructure · Quantitative Finance 2025-11-20 Tomas Espana , Yadh Hafsi , Fabrizio Lillo , Edoardo Vittori

This article addresses the problem of data-driven numerical optimal control for unknown nonlinear systems. In our scenario, we suppose to have the possibility of performing multiple experiments (or simulations) on the system. Experiments…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Marco Borghesi , Lorenzo Sforni , Giuseppe Notarstefano

This paper studies the fish growth trajectory tracking via reinforcement learning under a representative bioenergetic growth model. Due to the complex aquaculture condition and uncertain environmental factors such as temperature, dissolved…

Systems and Control · Electrical Eng. & Systems 2021-03-15 Abderrazak Chahid , Ibrahima N'Doye , John E. Majoris , Michael L. Berumen , Taous-Meriem Laleg-Kirati

This paper describes an online off-policy data-driven reinforcement learning based-algorithm to regulate and control the relative position of a deputy satellite in an autonomous satellite docking problem. The optimal control policy is…

Systems and Control · Electrical Eng. & Systems 2023-05-25 Omar Qasem , Madhur Tiwari , Hector Gutierrez

Robots must make and break contact with the environment to perform useful tasks, but planning and control through contact remains a formidable challenge. In this work, we achieve real-time contact-implicit model predictive control with a…

Robotics · Computer Science 2025-05-06 Vince Kurtz , Alejandro Castro , Aykut Özgün Önol , Hai Lin

Model-free reinforcement learning (RL) is a powerful approach for learning control policies directly from high-dimensional state and observation. However, it tends to be data-inefficient, which is especially costly in robotic learning…

Robotics · Computer Science 2020-10-14 Xubo Lyu , Mo Chen

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

Choosing an appropriate parameter set for the designed controller is critical for the final performance but usually requires a tedious and careful tuning process, which implies a strong need for automatic tuning methods. However, among…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Yuheng Lei , Jianyu Chen , Shengbo Eben Li , Sifa Zheng

Reinforcement Learning (RL) allows learning non-trivial robot control laws purely from data. However, many successful applications of RL have relied on ad-hoc regularizations, such as hand-crafted curricula, to regularize the learning…

Machine Learning · Computer Science 2023-09-26 Pascal Klink , Florian Wolf , Kai Ploeger , Jan Peters , Joni Pajarinen