English
Related papers

Related papers: Residual MPC: Blending Reinforcement Learning with…

200 papers

We propose a contact-explicit hierarchical architecture coupling Reinforcement Learning (RL) and Model Predictive Control (MPC), where a high-level RL agent provides gait and navigation commands to a low-level locomotion MPC. This offloads…

This paper proposes an online bipedal footstep planning strategy that combines model predictive control (MPC) and reinforcement learning (RL) to achieve agile and robust bipedal maneuvers. While MPC-based foot placement controllers have…

Robotics · Computer Science 2024-07-26 Seung Hyeon Bang , Carlos Arribalzaga Jové , Luis Sentis

Contact-rich micromanipulation in microfluidic flow is challenging because small disturbances can break pushing contact and induce large lateral drift. We study planar cell pushing with a magnetic rolling microrobot that tracks a…

Robotics · Computer Science 2026-03-06 Yanda Yang , Sambeeta Das

We propose an approach to design a Model Predictive Controller (MPC) for constrained Linear Time Invariant systems performing an iterative task. The system is subject to an additive disturbance, and the goal is to learn to satisfy state and…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Akhil Shetty , Kameshwar Poolla , Francesco Borrelli

The recent advancement in vehicular networking technology provides novel solutions for designing intelligent and sustainable vehicle motion controllers. This work addresses a car-following task, where the feedback linearisation method is…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Sheng Yu , Xiao Pan , Anastasis Georgiou , Boli Chen , Imad M. Jaimoukha , Simos A. Evangelou

Controller design faces a trade-off between robustness and performance, and the reliability of linear controllers has caused many practitioners to focus on the former. However, there is renewed interest in improving system performance to…

Optimization and Control · Mathematics 2012-08-07 Anil Aswani , Humberto Gonzalez , S. Shankar Sastry , Claire Tomlin

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Model Predictive Control (MPC) is a powerful control technique that handles constraints, takes the system's dynamics into account, and optimizes for a given cost function. In practice, however, it often requires an expert to craft and tune…

Robotics · Computer Science 2020-04-21 Napat Karnchanachari , Miguel I. Valls , David Hoeller , Marco Hutter

Reinforcement learning (RL) shows great potential in sequential decision-making. At present, mainstream RL algorithms are data-driven, which usually yield better asymptotic performance but much slower convergence compared with model-driven…

Machine Learning · Computer Science 2024-02-27 Yang Guan , Jingliang Duan , Shengbo Eben Li , Jie Li , Jianyu Chen , Bo Cheng

Conventional feedback control methods can solve various types of robot control problems very efficiently by capturing the structure with explicit models, such as rigid body equations of motion. However, many control problems in modern…

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC…

Systems and Control · Electrical Eng. & Systems 2023-01-05 Shambhuraj Sawant , Akhil S Anand , Dirk Reinhardt , Sebastien Gros

Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the…

Systems and Control · Electrical Eng. & Systems 2021-05-10 Khalid Alhazmi , Fahad Albalawi , S. Mani Sarathy

The fields of MPC and RL consider two successful control techniques for Markov decision processes. Both approaches are derived from similar fundamental principles, and both are widely used in practical applications, including robotics,…

Model Predictive Control (MPC) offers a versatile framework for constraint handling and multi-objective optimisation, yet practical application faces challenges regarding initial and recursive feasibility, robustness against model…

Optimization and Control · Mathematics 2026-02-27 Dario Dennstädt

Data-driven model predictive control (MPC) has demonstrated significant potential for improving robot control performance in the presence of model uncertainties. However, existing approaches often require extensive offline data collection…

Robotics · Computer Science 2025-10-10 Yu Mei , Xinyu Zhou , Shuyang Yu , Vaibhav Srivastava , Xiaobo Tan

In this work, we propose a novel learning-based model predictive control (MPC) framework for motion planning and control of urban self-driving. In this framework, instantaneous references and cost functions of online MPC are learned from…

Robotics · Computer Science 2024-02-29 Yubin Wang , Zengqi Peng , Yusen Xie , Yulin Li , Hakim Ghazzai , Jun Ma

Model Predictive Control (MPC) is a classic tool for optimal control of complex, real-world systems. Although it has been successfully applied to a wide range of challenging tasks in robotics, it is fundamentally limited by the prediction…

Robotics · Computer Science 2021-04-08 Nathan Hatch , Byron Boots

Tiny aerial robots hold great promise for applications such as environmental monitoring and search-and-rescue, yet face significant control challenges due to limited onboard computing power and nonlinear dynamics. Model Predictive Control…

Robotics · Computer Science 2025-10-16 Babak Akbari , Justin Frank , Melissa Greeff

Model Predictive Control (MPC) has become a popular framework in embedded control for high-performance autonomous systems. However, to achieve good control performance using MPC, an accurate dynamics model is key. To maintain real-time…

Robotics · Computer Science 2023-07-26 Tim Salzmann , Elia Kaufmann , Jon Arrizabalaga , Marco Pavone , Davide Scaramuzza , Markus Ryll