English
Related papers

Related papers: Computationally efficient Gauss-Newton reinforceme…

200 papers

Model Predictive Control (MPC) is a powerful control technique that handles constraints, takes the system's dynamics into account, and optimizes for a given cost function. In practice, however, it often requires an expert to craft and tune…

Robotics · Computer Science 2020-04-21 Napat Karnchanachari , Miguel I. Valls , David Hoeller , Marco Hutter

Model Predictive Control (MPC) is an optimal control algorithm with strong stability and robustness guarantees. Despite its popularity in robotics and industrial applications, the main challenge in deploying MPC is its high computation…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Camilo Gonzalez , Houshyar Asadi , Lars Kooijman , Chee Peng Lim

Policy gradient algorithms are widely used in reinforcement learning and belong to the class of approximate dynamic programming methods. This paper studies two key policy gradient algorithms, the Natural Policy Gradient and the Gauss-Newton…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Bowen Song , Sebastien Gros , Andrea Iannelli

Autonomous learning has been a promising direction in control and robotics for more than a decade since data-driven learning allows to reduce the amount of engineering knowledge, which is otherwise required. However, autonomous…

Machine Learning · Statistics 2017-10-12 Marc Peter Deisenroth , Dieter Fox , Carl Edward Rasmussen

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

The ability of Gaussian processes (GPs) to predict the behavior of dynamical systems as a more sample-efficient alternative to parametric models seems promising for real-world robotics research. However, the computational complexity of GPs…

Robotics · Computer Science 2022-03-01 Abdolreza Taheri , Joni Pajarinen , Reza Ghabcheloo

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

In this paper, we present a learning-based nonlinear model predictive controller (NMPC) using an original reinforcement learning (RL) method to learn the optimal weights of the NMPC scheme, for which two methods are proposed. Firstly, the…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Amine Salaje , Thomas Chevet , Nicolas Langlois

Data availability has dramatically increased in recent years, driving model-based control methods to exploit learning techniques for improving the system description, and thus control performance. Two key factors that hinder the practical…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Elena Arcari , Andrea Carron , Melanie N. Zeilinger

We introduce \textit{Policy Guided Monte Carlo} (PGMC), a computational framework using reinforcement learning to improve Markov chain Monte Carlo (MCMC) sampling. The methodology is generally applicable, unbiased and opens up a new path to…

Computational Physics · Physics 2018-12-12 Troels Arnfred Bojesen

In this paper, we present a robust adaptive model predictive control (MPC) scheme for linear systems subject to parametric uncertainty and additive disturbances. The proposed approach provides a computationally efficient formulation with…

Systems and Control · Electrical Eng. & Systems 2020-03-12 Johannes Köhler , Elisa Andina , Raffaele Soloperto , Matthias A. Müller , Frank Allgöwer

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

This paper proposes a novel robust reinforcement learning framework for discrete-time linear systems with model mismatch that may arise from the sim-to-real gap. A key strategy is to invoke advanced techniques from control theory. Using the…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Leilei Cui , Tamer Başar , Zhong-Ping Jiang

Model Predictive Control (MPC) of an unknown system that is modelled by Gaussian Process (GP) techniques is studied in this paper. Using GP, the variances computed during the modelling and inference processes allow us to take model…

Systems and Control · Computer Science 2016-12-06 Gang Cao , Edmund M-K Lai , Fakhrul Alam

This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure…

Machine Learning · Computer Science 2023-06-13 Anuradha M. Annaswamy , Anubhav Guha , Yingnan Cui , Sunbochen Tang , Peter A. Fisher , Joseph E. Gaudio

We propose an iterative approach for designing Robust Learning Model Predictive Control (LMPC) policies for a class of nonlinear systems with additive, unmodelled dynamics. The nominal dynamics are assumed to be difference flat, i.e., the…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Siddharth H. Nair , Francesco Borrelli

Long-horizon finite-control-set model predictive control (FCS-MPC) can improve transient regulation and flying-capacitor balancing in flying-capacitor three-level boost converters (FC-TLBCs). However, searching over switching sequences…

Optimization and Control · Mathematics 2026-04-14 Jinjian Sheng , Kazumune Hashimoto , Shuang Zhao , Mahdieh S. Sadabadi

In the realm of control systems, model predictive control (MPC) has exhibited remarkable potential; however, its reliance on accurate models and substantial computational resources has hindered its broader application, especially within…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Amin Vahidi-Moghaddam , Kaian Chen , Kaixiang Zhang , Zhaojian Li , Yan Wang , Kai Wu

Reinforcement learning (RL) has demonstrated its ability to solve high dimensional tasks by leveraging non-linear function approximators. However, these successes are mostly achieved by 'black-box' policies in simulated domains. When…

Machine Learning · Computer Science 2021-11-19 Riad Akrour , Davide Tateo , Jan Peters

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli