English
Related papers

Related papers: Deep Value Model Predictive Control

200 papers

This work investigates the challenge of ensuring safety guarantees in the presence of uncontrollable agents, whose behaviors are stochastic and depend on both their own and the system's states. We present a neural model predictive control…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shuqi Wang , Mingyang Feng , Yu Chen , Yue Gao , Xiang Yin

We establish a collection of closed-loop guarantees and propose a scalable optimization algorithm for distributionally robust model predictive control (DRMPC) applied to linear systems, convex constraints, and quadratic costs. Via standard…

Optimization and Control · Mathematics 2024-11-13 Robert D. McAllister , Peyman Mohajerin Esfahani

Model predictive control is a powerful tool to generate complex motions for robots. However, it often requires solving non-convex problems online to produce rich behaviors, which is computationally expensive and not always practical in real…

Robotics · Computer Science 2022-09-21 Avadesh Meduri , Huaijiang Zhu , Armand Jordana , Ludovic Righetti

In most classical Autonomous Vehicle (AV) stacks, the prediction and planning layers are separated, limiting the planner to react to predictions that are not informed by the planned trajectory of the AV. This work presents a module that…

Robotics · Computer Science 2022-04-06 Jose L. Vazquez , Alexander Liniger , Wilko Schwarting , Daniela Rus , Luc Van Gool

Uncertainty quantification is one of the central challenges for machine learning in real-world applications. In reinforcement learning, an agent confronts two kinds of uncertainty, called epistemic uncertainty and aleatoric uncertainty.…

Machine Learning · Computer Science 2023-07-06 Takuya Kanazawa , Haiyan Wang , Chetan Gupta

Learning-based control aims to construct models of a system to use for planning or trajectory optimization, e.g. in model-based reinforcement learning. In order to obtain guarantees of safety in this context, uncertainty must be accurately…

Robotics · Computer Science 2020-06-08 David D. Fan , Ali-akbar Agha-mohammadi , Evangelos A. Theodorou

Model predictive control (MPC) is an effective method for control of constrained systems but is susceptible to the external disturbances and modeling error often encountered in real-world applications. To address these issues, techniques…

Systems and Control · Electrical Eng. & Systems 2020-12-24 Savva Morozov , Parker C. Lusk , Brett T. Lopez , Jonathan P. How

The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy…

Machine Learning · Computer Science 2020-12-18 Katharina Bieker , Sebastian Peitz , Steven L. Brunton , J. Nathan Kutz , Michael Dellnitz

In this paper we describe a new conceptual framework that connects approximate Dynamic Programming (DP), Model Predictive Control (MPC), and Reinforcement Learning (RL). This framework centers around two algorithms, which are designed…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Dimitri P. Bertsekas

We consider the problem of simultaneous control and parameter estimation when the model is available only as a differentiable physics simulator. We propose a receding-horizon control framework in which a model predictive control (MPC)…

Optimization and Control · Mathematics 2026-04-07 Alan Williams , Alp Sunol

Reinforcement learning algorithms are known to be sample inefficient, and often performance on one task can be substantially improved by leveraging information (e.g., via pre-training) on other related tasks. In this work, we propose a…

Machine Learning · Computer Science 2019-10-15 Jonathan Lebensold , William Hamilton , Borja Balle , Doina Precup

We propose to combine model predictive control with deep learning for the task of accurate human motion tracking with a robot. We design the MPC to allow switching between the learned and a conservative prediction. We also explored online…

Actor-critic methods have been central to many of the recent advances in deep reinforcement learning. The most common approach is to use symmetric architectures, whereby both actor and critic have the same network topology and number of…

Machine Learning · Computer Science 2025-08-15 Olya Mastikhina , Dhruv Sreenivas , Pablo Samuel Castro

This paper proposes a Model Predictive Control (MPC) algorithm for target tracking amongst static and dynamic obstacles. Our main contribution lies in improving the computational tractability and reliability of the underlying non-convex…

Robotics · Computer Science 2021-12-24 Houman Masnavi , Vivek Adajania , Karl Kruusamae , Arun Kumar Singh

Input constrained Model predictive control (MPC) includes an optimization problem which should iteratively be solved at each time-instance. The well-known drawback of model predictive control is the computational cost of the optimization…

Optimization and Control · Mathematics 2019-04-17 Saman Cyrus , Ali Khaki Sedigh

A new distributed MPC algorithm for the regulation of dynamically coupled subsystems is presented in this paper. The current control action is computed via two robust controllers working in a nested fashion. The inner controller builds a…

Systems and Control · Computer Science 2017-03-29 Bernardo Hernandez , Paul Trodden

Model predictive control (MPC) has been applied to many platforms in robotics and autonomous systems for its capability to predict a system's future behavior while incorporating constraints that a system may have. To enhance the performance…

Robotics · Computer Science 2024-07-08 Ran Tao , Sheng Cheng , Xiaofeng Wang , Shenlong Wang , Naira Hovakimyan

Stock trading strategies play a critical role in investment. However, it is challenging to design a profitable strategy in a complex and dynamic stock market. In this paper, we propose an ensemble strategy that employs deep reinforcement…

Trading and Market Microstructure · Quantitative Finance 2025-11-18 Hongyang Yang , Xiao-Yang Liu , Shan Zhong , Anwar Walid

This paper presents a distributed model predictive control (DMPC) algorithm for heterogeneous vehicle platoons with unidirectional topologies and a priori unknown desired set point. The vehicles (or nodes) in a platoon are dynamically…

Optimization and Control · Mathematics 2018-03-19 Yang Zheng , Shengbo Eben Li , Keqiang Li , Francesco Borrelli , J. Karl Hedrick

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots