English
Related papers

Related papers: MPC-based Deep Reinforcement Learning Method for S…

200 papers

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

Model Predictive Control (MPC) has become a popular framework in embedded control for high-performance autonomous systems. However, to achieve good control performance using MPC, an accurate dynamics model is key. To maintain real-time…

Robotics · Computer Science 2023-07-26 Tim Salzmann , Elia Kaufmann , Jon Arrizabalaga , Marco Pavone , Davide Scaramuzza , Markus Ryll

Reinforcement learning (RL) is a promising tool to solve robust optimal well control problems where the model parameters are highly uncertain, and the system is partially observable in practice. However, RL of robust control policies often…

Machine Learning · Computer Science 2022-07-14 Atish Dixit , Ahmed H. ElSheikh

This paper proposes a novel approach to controller design for MR-damped vehicle suspension system. This approach is predicated on the premise that the optimal control strategy can be learned through real-world or simulated experiments…

Systems and Control · Electrical Eng. & Systems 2023-09-06 AmirReza BabaAhmadi , Masoud ShariatPanahi , Moosa Ayati

In this paper, we propose a minimax model predictive control (MPC)-based energy management system that is robust with respect to uncertainties in renewable infeed and load. The MPC formulation includes a model of low-level droop control…

Optimization and Control · Mathematics 2021-07-07 Steffen Hofmann , Ajay Sampathirao , Christian A. Hans , Jörg Raisch , Alexander Heidt , Erich Bosch

Model Predictive Control (MPC) has established itself as the primary methodology for constrained control, enabling autonomy across diverse applications. While model fidelity is crucial in MPC, solving the corresponding optimization problem…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Lukas Schroth , Daniel Morton , Amon Lahr , Daniele Gammelli , Andrea Carron , Marco Pavone

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

This paper introduces a landing guidance strategy for reusable launch vehicles (RLVs) using a model predictive approach based on sequential convex programming (SCP). The proposed approach devises two distinct optimal control problems…

Systems and Control · Electrical Eng. & Systems 2025-08-14 Ki-Wook Jung , Sang-Don Lee , Cheol-Goo Jung , Chang-Hun Lee

This paper explores the synergies between integrated power and thermal management (iPTM) and battery charging in an electric vehicle (EV). A multi-objective model predictive control (MPC) framework is developed to optimize the fast charging…

Systems and Control · Electrical Eng. & Systems 2023-10-24 Qiuhao Hu , Mohammad Reza Amini , Ashley Wiese , Ilya Kolmanovsky , Jing Sun

We study city-scale control of electric-vehicle (EV) ride-hailing fleets where dispatch, repositioning, and charging decisions must respect charger and feeder limits under uncertain, spatially correlated demand and travel times. We…

Artificial Intelligence · Computer Science 2026-04-29 An Nguyen , Hoang Nguyen , Phuong Le , Hung Pham , Cuong Do , Laurent El Ghaoui

Recent reinforcement learning (RL) methods have achieved success in various domains. However, multi-agent RL (MARL) remains a challenge in terms of decentralization, partial observability and scalability to many agents. Meanwhile,…

Machine Learning · Computer Science 2024-02-26 Kai Cui , Sascha Hauck , Christian Fabian , Heinz Koeppl

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

Autonomous Underwater Vehicle (AUV) docking in dynamic and uncertain environments is a critical challenge for underwater robotics. Reinforcement learning is a promising method for developing robust controllers, but the disparity between…

Robotics · Computer Science 2025-06-24 Kevin Chang , Rakesh Vivekanandan , Noah Pragin , Sean Bullock , Geoffrey Hollinger

The integration of Model Predictive Control (MPC) and Reinforcement Learning (RL) has emerged as a promising paradigm for constrained decision-making and adaptive control. MPC offers structured optimization, explicit constraint handling,…

With the increasingly congested and contested space environment, safe and effective satellite operation has become increasingly challenging. As a result, there is growing interest in autonomous satellite capabilities, with common machine…

Robotics · Computer Science 2025-03-03 Henry Lei , Joshua Aurand , Zachary S. Lippay , Sean Phillips

In this project, we attempt to optimize a landing trajectory of a rocket. The goal is to minimize the total fuel consumption during the landing process using different techniques. Once the optimal and feasible trajectory is generated using…

Artificial Intelligence · Computer Science 2024-05-28 Junhao Yu , Jiarun Wei

This paper proposes a fully dynamic Deep Reinforcement Learning (DRL) method for rebalancing dockless bike-sharing systems, overcoming the limitations of periodic, system-wide interventions. We model the service through a graph-based…

Systems and Control · Electrical Eng. & Systems 2026-05-15 Edoardo Scarpel , Alberto Pettena , Matteo Cederle , Federico Chiariotti , Marco Fabris , Gian Antonio Susto

This paper introduces a full solution for decentralized routing in Low Earth Orbit satellite constellations based on continual Deep Reinforcement Learning (DRL). This requires addressing multiple challenges, including the partial knowledge…

Machine Learning · Computer Science 2024-05-22 Federico Lozano-Cuadra , Beatriz Soret , Israel Leyva-Mayorga , Petar Popovski

Ensuring safe navigation in human-populated environments is crucial for autonomous mobile robots. Although recent advances in machine learning offer promising methods to predict human trajectories in crowded areas, it remains unclear how…

Robotics · Computer Science 2024-03-11 Kanghyun Ryu , Negar Mehr

Model Predictive Control (MPC) is a powerful control strategy; however, its reliance on online optimization poses significant challenges for implementation on systems with limited computational resources. One possible approach to address…

Optimization and Control · Mathematics 2025-02-19 Hassan Jafari Ozoumchelooei , Mehdi Hosseinzadeh