中文
相关论文

相关论文: MPC4RL -- A Software Package for Reinforcement Lea…

200 篇论文

Model Predictive Control (MPC) is a powerful control technique that handles constraints, takes the system's dynamics into account, and optimizes for a given cost function. In practice, however, it often requires an expert to craft and tune…

机器人学 · 计算机科学 2020-04-21 Napat Karnchanachari , Miguel I. Valls , David Hoeller , Marco Hutter

Deep reinforcement learning (RL) is an optimization-driven framework for producing control strategies for general dynamical systems without explicit reliance on process models. Good results have been reported in simulation. Here we…

系统与控制 · 电气工程与系统科学 2022-01-14 Nathan P. Lawrence , Michael G. Forbes , Philip D. Loewen , Daniel G. McClement , Johan U. Backstrom , R. Bhushan Gopaluni

Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF).…

系统与控制 · 电气工程与系统科学 2025-12-05 Kerim Dzhumageldyev , Filippo Airaldi , Azita Dabiri

This paper introduces a novel reinforcement learning (RL) approach to scheduling mixed-criticality (MC) systems on processors with varying speeds. Building upon the foundation laid by [1], we extend their work to address the non-preemptive…

机器学习 · 计算机科学 2025-04-09 Muhammad El-Mahdy , Nourhan Sakr , Rodrigo Carrasco

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

系统与控制 · 电气工程与系统科学 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

Model-based optimization approaches for monitoring and control, such as model predictive control and optimal state and parameter estimation, have been used for decades in many engineering applications. Models describing the dynamics,…

系统与控制 · 电气工程与系统科学 2022-03-31 Johannes Pohlodek , Bruno Morabito , Christian Schlauch , Pablo Zometa , Rolf Findeisen

In this paper, we present the use of Reinforcement Learning (RL) based on Robust Model Predictive Control (RMPC) for the control of an Autonomous Surface Vehicle (ASV). The RL-MPC strategy is utilized for obstacle avoidance and target…

系统与控制 · 电气工程与系统科学 2021-10-26 Arash Bahari Kordabad , Hossein Nejatbakhsh Esfahani , Anastasios M. Lekkas , Sébastien Gros

In this paper we describe a new conceptual framework that connects approximate Dynamic Programming (DP), Model Predictive Control (MPC), and Reinforcement Learning (RL). This framework centers around two algorithms, which are designed…

系统与控制 · 电气工程与系统科学 2024-07-02 Dimitri P. Bertsekas

Model-free Reinforcement Learning (RL) offers an attractive approach to learn control policies for high-dimensional systems, but its relatively poor sample complexity often forces training in simulated environments. Even in simulation,…

机器人学 · 计算机科学 2018-09-18 Boris Ivanovic , James Harrison , Apoorva Sharma , Mo Chen , Marco Pavone

Reinforcement learning (RL) is a control approach that can handle nonlinear stochastic optimal control problems. However, despite the promise exhibited, RL has yet to see marked translation to industrial practice primarily due to its…

机器学习 · 计算机科学 2021-04-15 Elton Pan , Panagiotis Petsagkourakis , Max Mowbray , Dongda Zhang , Antonio del Rio-Chanona

This paper presents an open-source, lightweight, yet comprehensive software framework, named RPC, which integrates physics-based simulators, planning and control libraries, debugging tools, and a user-friendly operator interface. RPC…

机器人学 · 计算机科学 2024-09-17 Seung Hyeon Bang , Carlos Gonzalez , Gabriel Moore , Dong Ho Kang , Mingyo Seo , Luis Sentis

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

机器学习 · 计算机科学 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar

Recent work in Offline Reinforcement Learning (RL) has shown that a unified Transformer trained under a masked auto-encoding objective can effectively capture the relationships between different modalities (e.g., states, actions, rewards)…

机器学习 · 计算机科学 2025-02-07 Kehan Wen , Yutong Hu , Yao Mu , Lei Ke

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

系统与控制 · 电气工程与系统科学 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

机器人学 · 计算机科学 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Data-driven model predictive control (MPC) has demonstrated significant potential for improving robot control performance in the presence of model uncertainties. However, existing approaches often require extensive offline data collection…

机器人学 · 计算机科学 2025-10-10 Yu Mei , Xinyu Zhou , Shuyang Yu , Vaibhav Srivastava , Xiaobo Tan

In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand…

系统与控制 · 电气工程与系统科学 2021-06-08 A. Bahari Kordabad , W. Cai , S. Gros

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

机器学习 · 计算机科学 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

The fields of MPC and RL consider two successful control techniques for Markov decision processes. Both approaches are derived from similar fundamental principles, and both are widely used in practical applications, including robotics,…