English
Related papers

Related papers: MPC-based Deep Reinforcement Learning Method for S…

200 papers

The reinforcement learning (RL) and model predictive control (MPC) communities have developed vast ecosystems of theoretical approaches and computational tools for solving optimal control problems. Given their conceptual similarities but…

Machine Learning · Computer Science 2025-09-04 Nathan P. Lawrence , Thomas Banker , Ali Mesbah

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

The unaffordable computation load of nonlinear model predictive control (NMPC) has prevented it for being used in robots with high sampling rates for decades. This paper is concerned with the policy learning problem for nonlinear MPC with…

Robotics · Computer Science 2022-11-21 Rizhong Wang , Huiping Li , Bin Liang , Yang Shi , Demin Xu

A general control policy framework based on deep reinforcement learning (DRL) is introduced for closed-loop decision making in subsurface flow settings. Traditional closed-loop modeling workflows in this context involve the repeated…

Computational Physics · Physics 2023-02-15 Yusuf Nasir , Louis J. Durlofsky

Multi-rotor UAVs suffer from a restricted range and flight duration due to limited battery capacity. Autonomous landing on a 2D moving platform offers the possibility to replenish batteries and offload data, thus increasing the utility of…

Robotics · Computer Science 2024-05-17 Pascal Goldschmid , Aamir Ahmad

Learning-based controllers leverage nonlinear couplings and enhance transients but seldom offer guarantees under tight input constraints. Robust feedback like sliding-mode control (SMC) provides these guarantees but is conservative in…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Imran Sayyed , Nandan Kumar Sinha

In this paper, we present a Deep Reinforcement Learning (RL)-driven Adaptive Stochastic Nonlinear Model Predictive Control (SNMPC) to optimize uncertainty handling, constraints robustification, feasibility, and closed-loop performance. To…

Systems and Control · Electrical Eng. & Systems 2023-11-09 Baha Zarrouki , Chenyang Wang , Johannes Betz

This paper presents the development and implementation of a Model Predictive Control (MPC) framework for trajectory tracking in autonomous vehicles under diverse driving conditions. The proposed approach incorporates a modular architecture…

Robotics · Computer Science 2025-06-06 Nitish Kumar , Rajalakshmi Pachamuthu

Modeling and control of nonlinear dynamics are critical in robotics, especially in scenarios with unpredictable external influences and complex dynamics. Traditional cascaded modular control pipelines often yield suboptimal performance due…

Robotics · Computer Science 2025-04-30 Haonan He , Yuheng Qiu , Junyi Geng

Autonomous mobile robots are increasingly used in pedestrian-rich environments where safe navigation and appropriate human interaction are crucial. While Deep Reinforcement Learning (DRL) enables socially integrated robot behavior,…

Robotics · Computer Science 2025-07-10 Daniel Flögel , Marcos Gómez Villafañe , Joshua Ransiek , Sören Hohmann

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

Maritime transportation is the backbone of global trade, making ship inspection essential for ensuring maritime safety and environmental protection. Port State Control (PSC), conducted by national ports, enforces compliance with safety…

Artificial Intelligence · Computer Science 2025-05-27 Jiongchao Jin , Xiuju Fu , Xiaowei Gao , Tao Cheng , Ran Yan

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Landing UAVs on heaving marine platforms is challenging because relative vertical motion can generate large impact forces and cause rebound on touchdown. To address this, we develop an impact-aware Model Predictive Control (MPC) framework…

Robotics · Computer Science 2026-04-24 Jess Stephenson , Melissa Greeff

We consider the problem of designing an algorithm to allow a car to autonomously merge on to a highway from an on-ramp. Two broad classes of techniques have been proposed to solve motion planning problems in autonomous driving: Model…

Robotics · Computer Science 2021-09-29 Joseph Lubars , Harsh Gupta , Sandeep Chinchali , Liyun Li , Adnan Raja , R. Srikant , Xinzhou Wu

Fast feedback control and safety guarantees are essential in modern robotics. We present an approach that achieves both by combining novel robust model predictive control (MPC) with function approximation via (deep) neural networks (NNs).…

Robotics · Computer Science 2020-03-04 Julian Nubert , Johannes Köhler , Vincent Berenz , Frank Allgöwer , Sebastian Trimpe

This paper presents a novel model predictive control (MPC) approach for autonomous pick-and-place between moving platforms with a hook-equipped aerial manipulator. First, for accurate and rapid modeling of the complex dynamics, a digital…

Robotics · Computer Science 2026-05-05 Péter Antal , Andrea Carron , Melanie Zeilinger , Roland Tóth , Tamás Péni

This work introduces two lightweight model predictive control (MPC) approaches for attitude tracking with reaction wheels during spacecraft rendezvous synchronization. Both approaches are based on a novel attitude deviation formulation,…

Robotics · Computer Science 2026-03-20 Peter Stadler , Alexander Meinert , Niklas Baldauf , Alen Turnwald

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

Tracking controllers enable robotic systems to accurately follow planned reference trajectories. In particular, reinforcement learning (RL) has shown promise in the synthesis of controllers for systems with complex dynamics and modest…

Robotics · Computer Science 2025-05-05 Jake Welde , Nishanth Rao , Pratik Kunapuli , Dinesh Jayaraman , Vijay Kumar