English
Related papers

Related papers: Benchmarking Model Predictive Control and Reinforc…

200 papers

Recent advances in quadrupedal locomotion have focused on improving stability and performance across diverse environments. However, existing methods often lack adequate safety analysis and struggle to adapt to varying payloads and complex…

Robotics · Computer Science 2024-11-07 Ananya Trivedi , Sarvesh Prajapati , Mark Zolotas , Michael Everett , Taskin Padir

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

Model Predictive Control (MPC) faces computational demands and performance degradation from model inaccuracies. We propose two architectures combining Neural Network-approximated MPC (NNMPC) with Reinforcement Learning (RL). The first, Warm…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Xiaolong Jia , Nikhil Bajaj

Control of legged robots is a challenging problem that has been investigated by different approaches, such as model-based control and learning algorithms. This work proposes a novel Imitating and Finetuning Model Predictive Control (IFM)…

Robotics · Computer Science 2026-05-28 Donghoon Youm , Hyunyoung Jung , Hyeongjun Kim , Jemin Hwangbo , Hae-Won Park , Sehoon Ha

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Model predictive control (MPC) has shown great success for controlling complex systems such as legged robots. However, when closing the loop, the performance and feasibility of the finite horizon optimal control problem (OCP) solved at each…

As legged robots are deployed in industrial and autonomous construction tasks requiring collaborative manipulation, they must handle object manipulation while maintaining stable locomotion. The challenge intensifies in real-world…

Robotics · Computer Science 2024-10-16 Mohsen Sombolestan , Quan Nguyen

Perceptive locomotion for legged robots requires anticipating and adapting to complex, dynamic environments. Model Predictive Control (MPC) serves as a strong baseline, providing interpretable motion planning with constraint enforcement,…

Robotics · Computer Science 2026-03-17 Aditya Shirwatkar , Satyam Gupta , Shishir Kolathaya

We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Filippo Airaldi , Bart De Schutter , Azita Dabiri

An important function of autonomous microrobots is the ability to perform robust movement over terrain. This paper explores an edge ML approach to microrobot locomotion, allowing for on-device, lower latency control under compute, memory,…

Robotics · Computer Science 2026-01-01 Yichen Liu , Kesava Viswanadha , Zhongyu Li , Nelson Lojo , Kristofer S. J. Pister

Legged robots, particularly quadrupeds, excel at navigating rough terrains, yet their performance under vertical ground perturbations, such as those from oscillating surfaces, remains underexplored. This study introduces a novel approach to…

We propose a hybrid reinforcement learning (RL) and model predictive control (MPC) framework for mixed-integer optimal control, where discrete variables enter the cost and dynamics but not the constraints. Existing hierarchical approaches…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Joschua Wüthrich , Romir Damle , Giona Fieni , Melanie N. Zeilinger , Christopher H. Onder , Andrea Carron

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

Reinforcement Learning (RL) and Machine Learning Integrated Model Predictive Control (ML-MPC) are promising approaches for optimizing hydrogen-diesel dual-fuel engine control, as they can effectively control multiple-input multiple-output…

Machine Learning · Computer Science 2025-05-07 Julian Bedei , Murray McBain , Alexander Winkler , Charles Robert Koch , Jakob Andert , David Gordon

A comprehensive approach addressing identification and control for learningbased Model Predictive Control (MPC) for linear systems is presented. The design technique yields a data-driven MPC law, based on a dataset collected from the…

Systems and Control · Computer Science 2018-10-31 Enrico Terzi , Lorenzo Fagiano , Marcello Farina , Riccardo Scattolini

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

Robotics · Computer Science 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath

We consider the problem of designing an algorithm to allow a car to autonomously merge on to a highway from an on-ramp. Two broad classes of techniques have been proposed to solve motion planning problems in autonomous driving: Model…

Robotics · Computer Science 2021-09-29 Joseph Lubars , Harsh Gupta , Sandeep Chinchali , Liyun Li , Adnan Raja , R. Srikant , Xinzhou Wu

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

State-of-the-art model-based Reinforcement Learning (RL) approaches either use gradient-free, population-based methods for planning, learned policy networks, or a combination of policy networks and planning. Hybrid approaches that combine…

Machine Learning · Computer Science 2026-05-25 Jonathan Spieler , Sven Behnke