English
Related papers

Related papers: MPC-based Reinforcement Learning for Economic Prob…

200 papers

Planning plays an important role in the broad class of decision theory. Planning has drawn much attention in recent work in the robotics and sequential decision making areas. Recently, Reinforcement Learning (RL), as an agent-environment…

Artificial Intelligence · Computer Science 2016-08-18 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Policy gradient methods are powerful reinforcement learning algorithms and have been demonstrated to solve many complex tasks. However, these methods are also data-inefficient, afflicted with high variance gradient estimates, and frequently…

Machine Learning · Computer Science 2019-05-15 Andreas Doerr , Michael Volpp , Marc Toussaint , Sebastian Trimpe , Christian Daniel

With the rapid growth in renewable energy and battery storage technologies, there exists significant opportunity to improve energy efficiency and reduce costs through optimization. However, optimization algorithms must take into account the…

Optimization and Control · Mathematics 2019-02-19 Chaitanya Poolla , Abraham K. Ishihara , Rodolfo Milito

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Model mismatch and process noise are two frequently occurring phenomena that can drastically affect the performance of model predictive control (MPC) in practical applications. We propose a principled way to tune the cost function and the…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Riccardo Zuliani , Efe C. Balta , John Lygeros

In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelling the hybrid control design problem as a single Markov…

Systems and Control · Electrical Eng. & Systems 2020-09-03 Meet Gandhi , Atreyee Kundu , Shalabh Bhatnagar

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

We propose a gradient-free deep reinforcement learning algorithm to solve high-dimensional, finite-horizon stochastic control problems. Although the recently developed deep reinforcement learning framework has achieved great success in…

Optimization and Control · Mathematics 2025-02-03 Liyao Lyu , Jingrun Chen

This paper proposes a framework for safe reinforcement learning that can handle stochastic nonlinear dynamical systems. We focus on the setting where the nominal dynamics are known, and are subject to additive stochastic disturbances with…

Systems and Control · Electrical Eng. & Systems 2020-01-27 Shuo Li , Osbert Bastani

We study the optimal control of battery energy storage under a general "pay-for-performance" setup such as providing frequency regulation and renewable integration. In these settings, batteries need to carefully balance the trade-off…

Optimization and Control · Mathematics 2018-07-31 Yuanyuan Shi , Bolun Xu , Yushi Tan , Daniel Kirschen , Baosen Zhang

We investigate interactive trajectory planning subject to uncertainty in the decisions of surrounding agents. To control the ego-agent, we aim to first learn the decision distribution and solve a Stochastic Model Predictive Control (SMPC)…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Erik Börve , Nikolce Murgovski , Morteza Haghir Chehreghani , Leo Laine

Model predictive control (MPC) is widely used in process control due to its interpretability and ability to handle constraints. As a parametric policy in reinforcement learning (RL), MPC offers strong initial performance and low data…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Dean Brandner , Sebastien Gros , Sergio Lucia

In this work, we provide theoretical guarantees for reward decomposition in deterministic MDPs. Reward decomposition is a special case of Hierarchical Reinforcement Learning, that allows one to learn many policies in parallel and combine…

Machine Learning · Computer Science 2018-03-14 Tom Zahavy , Avinatan Hasidim , Haim Kaplan , Yishay Mansour

We propose an approach to design a Model Predictive Controller (MPC) for constrained Linear Time Invariant systems performing an iterative task. The system is subject to an additive disturbance, and the goal is to learn to satisfy state and…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Akhil Shetty , Kameshwar Poolla , Francesco Borrelli

Modern power systems are characterized by low inertia and fast voltage dynamics due to the increase of sources connecting via power electronics and the removal of large traditional thermal generators. Power electronics are commonly equipped…

Systems and Control · Electrical Eng. & Systems 2023-04-27 Pol Jané-Soneira , Ionela Prodan , Albertus Johannes Malan , Sören Hohmann

Tight performance specifications in combination with operational constraints make model predictive control (MPC) the method of choice in various industries. As the performance of an MPC controller depends on a sufficiently accurate…

Systems and Control · Electrical Eng. & Systems 2020-06-09 Kim P. Wabersich , Melanie N. Zeilinger

The optimal control of a water reservoir systems represents a challenging problem, due to uncertain hydrologic inputs and the need to adapt to changing environment and varying control objectives. In this work, we propose a real-time…

Systems and Control · Electrical Eng. & Systems 2021-03-26 Pauline Kergus , Simone Formentin , Matteo Giuliani , Andrea Castelletti

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-known planning problem…

Machine Learning · Computer Science 2023-07-24 Marwan Mousa , Damien van de Berg , Niki Kotecha , Ehecatl Antonio del Rio-Chanona , Max Mowbray

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of…