English
Related papers

Related papers: Safe and Near-Optimal Policy Learning for Model Pr…

200 papers

We present a decentralized minimum-time trajectory optimization scheme based on learning model predictive control for multi-agent systems with nonlinear decoupled dynamics and coupled state constraints. By performing the same task…

Systems and Control · Electrical Eng. & Systems 2020-12-21 Edward L. Zhu , Yvonne R. Stürz , Ugo Rosolia , Francesco Borrelli

Recent work in Offline Reinforcement Learning (RL) has shown that a unified Transformer trained under a masked auto-encoding objective can effectively capture the relationships between different modalities (e.g., states, actions, rewards)…

Machine Learning · Computer Science 2025-02-07 Kehan Wen , Yutong Hu , Yao Mu , Lei Ke

We study the multi-agent safe control problem where agents should avoid collisions to static obstacles and collisions with each other while reaching their goals. Our core idea is to learn the multi-agent control policy jointly with learning…

Multiagent Systems · Computer Science 2021-04-20 Zengyi Qin , Kaiqing Zhang , Yuxiao Chen , Jingkai Chen , Chuchu Fan

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

This paper considers the problem of data generation for MPC policy approximation. Learning an approximate MPC policy from expert demonstrations requires a large data set consisting of optimal state-action pairs, sampled across the feasible…

Systems and Control · Electrical Eng. & Systems 2023-06-22 Dinesh Krishnamoorthy

Neural networks have been increasingly employed in Model Predictive Controller (MPC) to control nonlinear dynamic systems. However, MPC still poses a problem that an achievable update rate is insufficient to cope with model uncertainty and…

Robotics · Computer Science 2022-07-15 Taekyung Kim , Hojin Lee , Seongil Hong , Wonsuk Lee

The recent advancement in vehicular networking technology provides novel solutions for designing intelligent and sustainable vehicle motion controllers. This work addresses a car-following task, where the feedback linearisation method is…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Sheng Yu , Xiao Pan , Anastasis Georgiou , Boli Chen , Imad M. Jaimoukha , Simos A. Evangelou

The effectiveness of many optimal network control algorithms (e.g., BackPressure) relies on the premise that all of the nodes are fully controllable. However, these algorithms may yield poor performance in a partially-controllable network…

Networking and Internet Architecture · Computer Science 2019-01-08 Qingkai Liang , Eytan Modiano

Model-based reinforcement learning algorithms that combine model-based planning and learned value/policy prior have gained significant recognition for their high data efficiency and superior performance in continuous control. However, we…

Machine Learning · Computer Science 2025-02-07 Haotian Lin , Pengcheng Wang , Jeff Schneider , Guanya Shi

We introduce a methodology for efficiently computing a lower bound to empowerment, allowing it to be used as an unsupervised cost function for policy learning in real-time control. Empowerment, being the channel capacity between actions and…

We present a methodology to deploy the stochastic policy gradient method, using actor-critic techniques, when the optimal policy is approximated using a parametric optimization problem, allowing one to enforce safety via hard constraints.…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Sebastien Gros , Mario Zanon

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

This paper proposes an off-line algorithm, called Recurrent Model Predictive Control (RMPC), to solve general nonlinear finite-horizon optimal control problems. Unlike traditional Model Predictive Control (MPC) algorithms, it can make full…

Systems and Control · Electrical Eng. & Systems 2021-02-24 Zhengyu Liu , Jingliang Duan , Wenxuan Wang , Shengbo Eben Li , Yuming Yin , Ziyu Lin , Qi Sun , Bo Cheng

We present a new algorithm for model predictive control of non-linear systems with respect to multiple, conflicting objectives. The idea is to provide a possibility to change the objective in real-time, e.g.~as a reaction to changes in the…

Optimization and Control · Mathematics 2018-08-02 Sebastian Peitz , Kai Schäfer , Sina Ober-Blöbaum , Julian Eckstein , Ulrich Köhler , Michael Dellnitz

While it has been repeatedly shown that learning-based controllers can provide superior performance, they often lack of safety guarantees. This paper aims at addressing this problem by introducing a model predictive safety certification…

Systems and Control · Computer Science 2019-04-09 Kim P. Wabersich , Melanie N. Zeilinger

While MPC enables nonlinear feedback control by solving an optimal control problem at each timestep, the computational burden tends to be significantly large, making it difficult to optimize a policy within the control period. To address…

Robotics · Computer Science 2024-10-10 Mitsuki Morita , Satoshi Yamamori , Satoshi Yagi , Norikazu Sugimoto , Jun Morimoto

In this paper, a learning based Model Predictive Control (MPC) using a low dimensional residual model is proposed for autonomous driving. One of the critical challenge in autonomous driving is the complexity of vehicle dynamics, which…

Robotics · Computer Science 2024-12-06 Yaoyu Li , Chaosheng Huang , Dongsheng Yang , Wenbo Liu , Jun Li

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

We present differentiable predictive control (DPC) as a deep learning-based alternative to the explicit model predictive control (MPC) for unknown nonlinear systems. In the DPC framework, a neural state-space model is learned from…

Systems and Control · Electrical Eng. & Systems 2021-07-27 Jan Drgona , Karol Kis , Aaron Tuor , Draguna Vrabie , Martin Klauco