English
Related papers

Related papers: Sample Efficient Path Integral Control under Uncer…

200 papers

Current motion planning approaches for autonomous mobile robots often assume that the low level controller of the system is able to track the planned motion with very high accuracy. In practice, however, tracking error can be affected by…

Robotics · Computer Science 2023-08-03 Jacob Higgins , Nicholas Mohammad , Nicola Bezzo

Stochastic model predictive control (SMPC) has been a promising solution to complex control problems under uncertain disturbances. However, traditional SMPC approaches either require exact knowledge of probabilistic distributions, or rely…

Optimization and Control · Mathematics 2020-01-03 Chao Shang , Fengqi You

Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Samuel Balula , Efe C. Balta , Dominic Liao-McPherson , Alisa Rupenyan , John Lygeros

This paper presents a novel control approach for autonomous systems operating under uncertainty. We combine Model Predictive Path Integral (MPPI) control with Covariance Steering (CS) theory to obtain a robust controller for general…

Robotics · Computer Science 2022-09-27 Ji Yin , Zhiyuan Zhang , Evangelos Theodorou , Panagiotis Tsiotras

The paper presents a data-driven predictive control framework based on an implicit input-output mapping derived directly from the signal matrix of collected data. This signal matrix model is derived by maximum likelihood estimation with…

Systems and Control · Electrical Eng. & Systems 2021-11-10 Mingzhou Yin , Andrea Iannelli , Roy S. Smith

Model Predictive Path Integral (MPPI) control has emerged as a powerful sampling-based optimal control method for complex, nonlinear, and high-dimensional systems. However, directly applying MPPI to legged robotic systems presents several…

Systems and Control · Electrical Eng. & Systems 2026-01-06 Chuyuan Tao , Fanxin Wang , Haolong Jiang , Jia He , Yiyang Chen , Qinglei Bu

A data-driven computational heuristic is proposed to control MIMO systems without prior knowledge of their dynamics. The heuristic is illustrated on a two-input two-output balance system. It integrates a self-adjusting nonlinear threshold…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Ning Wang , Mohammed Abouheaf , Wail Gueaieb

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the…

Robotics · Computer Science 2025-10-28 Amirreza Razmjoo , Sylvain Calinon , Michael Gienger , Fan Zhang

Model-free learning-based control methods have seen great success recently. However, such methods typically suffer from poor sample complexity and limited convergence guarantees. This is in sharp contrast to classical model-based control,…

Optimization and Control · Mathematics 2020-06-16 Guannan Qu , Chenkai Yu , Steven Low , Adam Wierman

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

Motion planning under differential constraints is a classic problem in robotics. To date, the state of the art is represented by sampling-based techniques, with the Rapidly-exploring Random Tree algorithm as a leading example. Yet, the…

Robotics · Computer Science 2015-03-03 Edward Schmerling , Lucas Janson , Marco Pavone

Decision and control are core functionalities of high-level automated vehicles. Current mainstream methods, such as functionality decomposition and end-to-end reinforcement learning (RL), either suffer high time complexity or poor…

Machine Learning · Computer Science 2021-05-12 Yang Guan , Yangang Ren , Qi Sun , Shengbo Eben Li , Haitong Ma , Jingliang Duan , Yifan Dai , Bo Cheng

This article investigates the core mechanisms of indirect data-driven control for unknown systems, focusing on the application of policy iteration (PI) within the context of the linear quadratic regulator (LQR) optimal control problem.…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Bowen Song , Andrea Iannelli

We propose a novel data-driven stochastic model predictive control framework for uncertain linear systems with noisy output measurements. Our approach leverages multi-step predictors to efficiently propagate uncertainty, ensuring chance…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Haldun Balim , Andrea Carron , Melanie N. Zeilinger , Johannes Köhler

We consider piecewise-deterministic optimal control problems in which the environment randomly switches among several deterministic modes, and the goal is to optimize the expected cost up to the termination while taking the likelihood of…

Optimization and Control · Mathematics 2015-12-31 Zhengdi Shen , Alexander Vladimirsky

We propose a physics-informed neural network policy iteration (PINN-PI) framework for solving stochastic optimal control problems governed by second-order Hamilton--Jacobi--Bellman (HJB) equations. At each iteration, a neural network is…

Machine Learning · Computer Science 2025-08-05 Yeongjong Kim , Yeoneung Kim , Minseok Kim , Namkyeong Cho

In this note we consider the problem of synthesizing optimal control policies for a system from noisy datasets. We present a novel algorithm that takes as input the available dataset and, based on these inputs, computes an optimal policy…

Optimization and Control · Mathematics 2020-03-02 Davide Gagliardi , Giovanni Russo

This paper presents a novel approach to improve the Model Predictive Path Integral (MPPI) control by using a transformer to initialize the mean control sequence. Traditional MPPI methods often struggle with sample efficiency and…

Robotics · Computer Science 2024-12-24 Shrenik Zinage , Vrushabh Zinage , Efstathios Bakolas

Model predictive path integral (MPPI) control has recently received a lot of attention, especially in the robotics and reinforcement learning communities. This letter aims to make the MPPI control framework more accessible to the optimal…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Hannes Homburger , Florian Messerer , Moritz Diehl , Johannes Reuter

We consider deterministic infinite horizon optimal control problems with nonnegative stage costs. We draw inspiration from learning model predictive control scheme designed for continuous dynamics and iterative tasks, and propose a rollout…

Optimization and Control · Mathematics 2021-09-30 Yuchao Li , Karl H. Johansson , Jonas Mårtensson , Dimitri P. Bertsekas