English
Related papers

Related papers: Actor-Critic Model Predictive Control: Differentia…

200 papers

Greenhouse climate control is concerned with maximizing performance in terms of crop yield and resource efficiency. One promising approach is model predictive control (MPC), which leverages a model of the system to optimize the control…

Systems and Control · Electrical Eng. & Systems 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Congcong Sun , Bart De Schutter

In this paper, a continuous-time adaptive actor-critic reinforcement learning (RL) controller is developed for drift-free nonlinear systems. Practical examples of such systems are image-based visual servoing (IBVS) and wheeled mobile robots…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Ashwin P. Dani , Shubhendu Bhasin

We consider the problem of bridging the gap between geometric tracking control theory and implementation of model predictive control (MPC) for robotic systems operating on manifolds. We propose a generic on-manifold MPC formulation based on…

Robotics · Computer Science 2021-06-30 Guozheng Lu , Wei Xu , Fu Zhang

In this paper, we propose actor-director-critic, a new framework for deep reinforcement learning. Compared with the actor-critic framework, the director role is added, and action classification and action evaluation are applied…

Machine Learning · Computer Science 2023-01-11 Zongwei Liu , Yonghong Song , Yuanlin Zhang

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of…

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

Machine Learning · Statistics 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

This paper presents an approach to mutual collision avoidance based on Nonlinear Model Predictive Control (NMPC) with time-dependent Reciprocal Velocity Constraints (RVCs). Unlike most existing methods, the proposed approach relies solely…

Robotics · Computer Science 2025-12-10 Vit Kratky , Robert Penicka , Parakh M. Gupta , Ondrej Prochazka , Martin Saska

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

Systems and Control · Electrical Eng. & Systems 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

Fluidically actuated soft robots have promising capabilities such as inherent compliance and user safety. The control of soft robots needs to properly handle nonlinear actuation dynamics, motion constraints, workspace limitations, and…

Robotics · Computer Science 2023-01-02 Filippo A. Spinelli , Robert K. Katzschmann

The need for fully autonomous mobile robots has surged over the past decade, with the imperative of ensuring safe navigation in a dynamic setting emerging as a primary challenge impeding advancements in this domain. In this paper, a Safety…

Robotics · Computer Science 2024-04-17 Ali Mohamed Ali , Chao Shen , Hashim A. Hashim

In this paper we describe a new conceptual framework that connects approximate Dynamic Programming (DP), Model Predictive Control (MPC), and Reinforcement Learning (RL). This framework centers around two algorithms, which are designed…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Dimitri P. Bertsekas

This work is an exploratory research concerned with determining in what way reinforcement learning can be used to predict optimal PID parameters for a robot designed for apple harvest. To study this, an algorithm called Advantage Actor…

Machine Learning · Computer Science 2022-12-02 Vivien van Veldhuizen

A significant challenge in the development of control systems for diesel airpath applications is to tune the controller parameters to achieve satisfactory output performance, especially whilst adhering to input and safety constraints in the…

Systems and Control · Computer Science 2019-05-16 Gokul S. Sankar , Rohan C. Shekhar , Chris Manzie , Takeshi Sano , Hayato Nakada

An intelligent decision-making system enabled by Vehicle-to-Everything (V2X) communications is essential to achieve safe and efficient autonomous driving (AD), where two types of decisions have to be made at different timescales, i.e.,…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Tong Liu , Lei Lei , Kan Zheng , Xuemin , Shen

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with…

Systems and Control · Computer Science 2018-02-23 Sanket Kamthe , Marc Peter Deisenroth

Reinforcement learning (RL) has been successfully used in various simulations and computer games. Industry-related applications, such as autonomous mobile robot motion control, are somewhat challenging for RL up to date though. This paper…

Robotics · Computer Science 2021-08-25 Dmitrii Dobriborsci , Pavel Osinenko

Accurate trajectory tracking control for quadrotors is essential for safe navigation in cluttered environments. However, this is challenging in agile flights due to nonlinear dynamics, complex aerodynamic effects, and actuation constraints.…

Robotics · Computer Science 2024-01-05 Sihao Sun , Angel Romero , Philipp Foehn , Elia Kaufmann , Davide Scaramuzza

Model Predictive Control (MPC) is a powerful control strategy; however, its reliance on online optimization poses significant challenges for implementation on systems with limited computational resources. One possible approach to address…

Optimization and Control · Mathematics 2025-02-19 Hassan Jafari Ozoumchelooei , Mehdi Hosseinzadeh

Motion planning for autonomous robots and vehicles in presence of uncontrolled agents remains a challenging problem as the reactive behaviors of the uncontrolled agents must be considered. Since the uncontrolled agents usually demonstrate…

Systems and Control · Electrical Eng. & Systems 2021-09-21 Yuxiao Chen , Ugo Rosolia , Wyatt Ubellacker , Noel Csomay-Shanklin , Aaron D. Ames