English
Related papers

Related papers: Parameter-Robust MPPI for Safe Online Learning of …

200 papers

Model-based control is a crucial component of robotic navigation. However, it often struggles with entrapment in local minima due to its inherent nature as a finite, myopic optimization procedure. Previous studies have addressed this issue…

Robotics · Computer Science 2024-11-12 Takahiro Fuke , Masafumi Endo , Kohei Honda , Genya Ishigami

This paper addresses the problem of model-free reinforcement learning for Robust Markov Decision Process (RMDP) with large state spaces. The goal of the RMDP framework is to find a policy that is robust against the parameter uncertainties…

Machine Learning · Computer Science 2021-02-15 Kishan Panaganti , Dileep Kalathil

Chance-constrained Model Predictive Path Integral (MPPI) control is increasingly adopted for navigation in dynamic environments to explicitly bound collision risk. However, these probabilistic guarantees implicitly assume that upstream…

Robotics · Computer Science 2026-05-28 Benjamin Serfling , Konrad Doll , Kati Radkhah-Lens

Robust reinforcement learning aims to produce policies that have strong guarantees even in the face of environments/transition models whose parameters have strong uncertainty. Existing work uses value-based methods and the usual primitive…

Artificial Intelligence · Computer Science 2018-02-12 Daniel J. Mankowitz , Timothy A. Mann , Pierre-Luc Bacon , Doina Precup , Shie Mannor

The recent increase in data availability and reliability has led to a surge in the development of learning-based model predictive control (MPC) frameworks for robot systems. Despite attaining substantial performance improvements over their…

Robotics · Computer Science 2023-08-02 Kong Yao Chee , Thales C. Silva , M. Ani Hsieh , George J. Pappas

Optimal and safety-critical control are fundamental problems for stochastic systems, and are widely considered in real-world scenarios such as robotic manipulation and autonomous driving. In this paper, we consider the problem of…

Systems and Control · Electrical Eng. & Systems 2024-05-10 Zhuoyuan Wang , Reece Keller , Xiyu Deng , Kenta Hoshino , Takashi Tanaka , Yorie Nakahira

Dynamic locomotion in rough terrain requires accurate foot placement, collision avoidance, and planning of the underactuated dynamics of the system. Reliably optimizing for such motions and interactions in the presence of imperfect and…

Robotics · Computer Science 2022-08-18 Ruben Grandia , Fabian Jenelten , Shaohui Yang , Farbod Farshidian , Marco Hutter

This paper presents a novel control approach for autonomous systems operating under uncertainty. We combine Model Predictive Path Integral (MPPI) control with Covariance Steering (CS) theory to obtain a robust controller for general…

Robotics · Computer Science 2022-09-27 Ji Yin , Zhiyuan Zhang , Evangelos Theodorou , Panagiotis Tsiotras

We propose a supervised learning framework for computing solutions of multi-parametric Mixed Integer Linear Programs (MILPs) that arise in Model Predictive Control. Our approach also quantifies sub-optimality for the computed solutions.…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Luigi Russo , Siddharth H. Nair , Luigi Glielmo , Francesco Borrelli

Safe motion planning in uncertain, time-varying environments is challenging because the safe region can change unpredictably across planning steps, often causing a loss of recursive feasibility. In this work, we present a Probabilistic…

Systems and Control · Electrical Eng. & Systems 2026-05-20 Hyeontae Sung , Hyeongchan Ham , Junyoung Park , Kai Ren , Heejin Ahn

Model Predictive Control (MPC) is a powerful control strategy; however, its reliance on online optimization poses significant challenges for implementation on systems with limited computational resources. One possible approach to address…

Optimization and Control · Mathematics 2025-02-19 Hassan Jafari Ozoumchelooei , Mehdi Hosseinzadeh

Model predictive control is a powerful tool to generate complex motions for robots. However, it often requires solving non-convex problems online to produce rich behaviors, which is computationally expensive and not always practical in real…

Robotics · Computer Science 2022-09-21 Avadesh Meduri , Huaijiang Zhu , Armand Jordana , Ludovic Righetti

Model predictive path integral (MPPI) is a sampling-based method for solving complex model predictive control (MPC) problems, but its real-time implementation faces two key challenges: the computational cost and sample requirements grow…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Viet-Anh Le , Renukanandan Tumu , Rahul Mangharam

Although risk awareness is fundamental to an online operating agent, it has received less attention in the challenging continuous domain and under partial observability. This paper presents a novel formulation and solution for risk-averse…

Artificial Intelligence · Computer Science 2023-02-22 Andrey Zhitnikov , Vadim Indelman

This work explores the nature of augmented importance sampling in safety-constrained model predictive control problems. When operating in a constrained environment, sampling based model predictive control and motion planning typically…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Manan Gandhi , Hassan Almubarak , Yuichiro Aoyama , Evangelos Theodorou

We represent a vehicle dynamics model for autonomous driving near the limits of handling via a multi-layer neural network. Online adaptation is desirable in order to address unseen environments. However, the model needs to adapt to new…

Robotics · Computer Science 2024-09-24 Yuki Tsuchiya , Thomas Balch , Paul Drews , Guy Rosman

Safety-critical environments are inherently dynamic. Distribution shifts, emerging vulnerabilities, and evolving requirements demand continuous updates to machine learning models. Yet even benign parameter updates can have unintended…

Machine Learning · Computer Science 2026-03-19 Leo Elmecker-Plakolm , Pierre Fasterling , Philip Sosnin , Calvin Tsay , Matthew Wicker

The interest in Physical Human-Robot Interaction (pHRI) has significantly increased over the last two decades thanks to the availability of collaborative robots that guarantee user safety during force exchanges. For this reason, stability…

Robotics · Computer Science 2025-12-02 Davide Tebaldi , Dario Onfiani , Luigi Biagiotti

The Robust Regularized Markov Decision Process (RRMDP) is proposed to learn policies robust to dynamics shifts by adding regularization to the transition dynamics in the value function. Existing methods mostly use unstructured…

Machine Learning · Computer Science 2025-11-03 Cheng Tang , Zhishuai Liu , Pan Xu

In this paper, we present a new trajectory optimization algorithm for stochastic linear systems which combines Model Predictive Path Integral (MPPI) control with Constrained Covariance Steering (CSS) to achieve high performance with safety…

Optimization and Control · Mathematics 2022-04-21 Isin M. Balci , Efstathios Bakolas , Bogdan Vlahov , Evangelos Theodorou