English
Related papers

Related papers: Evaluating model-based planning and planner amorti…

200 papers

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

Driving vehicles in complex scenarios under harsh conditions is the biggest challenge for autonomous vehicles (AVs). To address this issue, we propose hierarchical motion planning and robust control strategy using the front-active steering…

Robotics · Computer Science 2024-02-08 Hung Duy Nguyen , Minh Nhat Vu , Nguyen Ngoc Nam , Kyoungseok Han

We compare the model-free reinforcement learning with the model-based approaches through the lens of the expressive power of neural networks for policies, $Q$-functions, and dynamics. We show, theoretically and empirically, that even for…

Machine Learning · Computer Science 2020-09-08 Kefan Dong , Yuping Luo , Tengyu Ma

Model-based reinforcement learning could enable sample-efficient learning by quickly acquiring rich knowledge about the world and using it to improve behaviour without additional data. Learned dynamics models can be directly used for…

Machine Learning · Computer Science 2019-10-15 Rinu Boney , Juho Kannala , Alexander Ilin

Model predictive control (MPC) is a popular approach for trajectory optimization in practical robotics applications. MPC policies can optimize trajectory parameters under kinodynamic and safety constraints and provide guarantees on safety,…

Robotics · Computer Science 2023-06-08 Returaj Burnwal , Anirban Santara , Nirav P. Bhatt , Balaraman Ravindran , Gaurav Aggarwal

A promising way to improve the sample efficiency of reinforcement learning is model-based methods, in which many explorations and evaluations can happen in the learned models to save real-world samples. However, when the learned model has a…

Machine Learning · Computer Science 2022-09-14 Haoxin Lin , Yihao Sun , Jiaji Zhang , Yang Yu

We study learning based controllers as a replacement for model predictive controllers (MPC) for the control of autonomous vehicles. We concentrate for the experiments on the simple yet representative bicycle model. We compare training by…

Robotics · Computer Science 2021-08-02 Maria Luiza Costa Vianna , Eric Goubault , Sylvie Putot

Dyna-style model-based reinforcement learning contains two phases: model rollouts to generate sample for policy learning and real environment exploration using current policy for dynamics model learning. However, due to the complex…

Machine Learning · Computer Science 2024-01-02 Xiyao Wang , Ruijie Zheng , Yanchao Sun , Ruonan Jia , Wichayaporn Wongkamjan , Huazhe Xu , Furong Huang

Recent advancements in prompting techniques for Large Language Models (LLMs) have improved their reasoning, planning, and action abilities. This paper examines these prompting techniques through the lens of model predictive control (MPC).…

Artificial Intelligence · Computer Science 2025-02-26 Gabriel Maher

Model predictive control (MPC) is a popular strategy for urban traffic management that is able to incorporate physical and user defined constraints. However, the current MPC methods rely on finite horizon predictions that are unable to…

Systems and Control · Computer Science 2016-02-03 Sadra Sadraddini , Calin Belta

We study the problem of learning safe control policies that are also effective; i.e., maximizing the probability of satisfying a linear temporal logic (LTL) specification of a task, and the discounted reward capturing the (classic) control…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

Artificial Intelligence · Computer Science 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

The recent advancement in vehicular networking technology provides novel solutions for designing intelligent and sustainable vehicle motion controllers. This work addresses a car-following task, where the feedback linearisation method is…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Sheng Yu , Xiao Pan , Anastasis Georgiou , Boli Chen , Imad M. Jaimoukha , Simos A. Evangelou

Model-based optimization approaches for monitoring and control, such as model predictive control and optimal state and parameter estimation, have been used for decades in many engineering applications. Models describing the dynamics,…

Systems and Control · Electrical Eng. & Systems 2022-03-31 Johannes Pohlodek , Bruno Morabito , Christian Schlauch , Pablo Zometa , Rolf Findeisen

This paper develops a methodology for adaptive data-driven Model Predictive Control (MPC) using Koopman operators. While MPC is ubiquitous in various fields of engineering, the controller performance can deteriorate if the modeling error…

Optimization and Control · Mathematics 2024-12-05 Daisuke Uchida , Karthik Duraisamy

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Model predictive control is a prominent approach to construct a feedback control loop for dynamical systems. Due to real-time constraints, the major challenge in MPC is to solve model-based optimal control problems in a very short amount of…

Optimization and Control · Mathematics 2020-12-15 Sina Ober-Blöbaum , Sebastian Peitz

A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Anilkumar Parsi , Andrea Iannelli , Roy S. Smith

A Learning Model Predictive Controller (LMPC) for linear system in presented. The proposed controller is an extension of the LMPC [1] and it aims to decrease the computational burden. The control scheme is reference-free and is able to…

Optimization and Control · Mathematics 2019-10-31 Ugo Rosolia , Francesco Borrelli

Model predictive control (MPC) is pervasive in research and industry. However, designing the cost function and the constraints of the MPC to maximize closed-loop performance remains an open problem. To achieve optimal tuning, we propose a…

Optimization and Control · Mathematics 2024-12-02 Riccardo Zuliani , Efe C. Balta , John Lygeros