English
Related papers

Related papers: Should we use model-free or model-based control? A…

200 papers

Battery energy storage systems are providing increasing level of benefits to power grid operations by decreasing the resource uncertainty and supporting frequency regulation. Thus, it is crucial to obtain the optimal policy for battery to…

Optimization and Control · Mathematics 2022-06-06 Kyung-bin Kwon , Hao Zhu

The reinforcement learning (RL) and model predictive control (MPC) communities have developed vast ecosystems of theoretical approaches and computational tools for solving optimal control problems. Given their conceptual similarities but…

Machine Learning · Computer Science 2025-09-04 Nathan P. Lawrence , Thomas Banker , Ali Mesbah

This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC…

Systems and Control · Electrical Eng. & Systems 2023-01-05 Shambhuraj Sawant , Akhil S Anand , Dirk Reinhardt , Sebastien Gros

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with…

Systems and Control · Computer Science 2018-02-23 Sanket Kamthe , Marc Peter Deisenroth

Model predictive control (MPC) provides a useful means for controlling systems with constraints, but suffers from the computational burden of repeatedly solving an optimization problem in real time. Offline (explicit) solutions for MPC…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Daniel Tabas , Baosen Zhang

Residential prosumers with PV-battery systems increasingly manage their electricity exchange with the power grid to minimize costs. This study investigates the performance of Model Predictive Control (MPC) and Rule-Based Control (RBC) under…

Optimization and Control · Mathematics 2025-10-30 Janik Pinter , Maximilian Beichter , Ralf Mikut , Frederik Zahn , Veit Hagenmeyer

Reinforcement Learning (RL) and Machine Learning Integrated Model Predictive Control (ML-MPC) are promising approaches for optimizing hydrogen-diesel dual-fuel engine control, as they can effectively control multiple-input multiple-output…

Machine Learning · Computer Science 2025-05-07 Julian Bedei , Murray McBain , Alexander Winkler , Charles Robert Koch , Jakob Andert , David Gordon

District cooling energy plants (DCEPs) consisting of chillers, cooling towers, and thermal energy storage (TES) systems consume a considerable amount of electricity. Optimizing the scheduling of the TES and chillers to take advantage of…

Systems and Control · Electrical Eng. & Systems 2022-03-16 Zhong Guo , Austin R. Coffman , Prabir Barooah

There is a widespread intuition that model-based control methods should be able to surpass the data efficiency of model-free approaches. In this paper we attempt to evaluate this intuition on various challenging locomotion tasks. We take a…

Electric motors are crucial in many applications, but traditional control methods struggle with nonlinearities, parameter uncertainties, and external disturbances. Reinforcement Learning (RL) offers a promising solution as a data-driven…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Danial Kazemikia

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

The high emission and low energy efficiency caused by internal combustion engines (ICE) have become unacceptable under environmental regulations and the energy crisis. As a promising alternative solution, multi-power source electric…

Machine Learning · Computer Science 2022-11-09 Jincheng Hu , Yang Lin , Liang Chu , Zhuoran Hou , Jihan Li , Jingjing Jiang , Yuanjian Zhang

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Initial DR studies mainly adopt model predictive control and thus require accurate models of the control problem (e.g., a customer behavior model), which are to a large extent uncertain for the EV scenario. Hence, model-free approaches,…

Machine Learning · Computer Science 2018-11-30 Nasrin Sadeghianpourhamami , Johannes Deleu , Chris Develder

We present foundations for using Model Predictive Control (MPC) as a differentiable policy class for reinforcement learning in continuous state and action spaces. This provides one way of leveraging and combining the advantages of…

Machine Learning · Computer Science 2019-10-15 Brandon Amos , Ivan Dario Jimenez Rodriguez , Jacob Sacks , Byron Boots , J. Zico Kolter

Tight performance specifications in combination with operational constraints make model predictive control (MPC) the method of choice in various industries. As the performance of an MPC controller depends on a sufficiently accurate…

Systems and Control · Electrical Eng. & Systems 2020-06-09 Kim P. Wabersich , Melanie N. Zeilinger

Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF).…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Kerim Dzhumageldyev , Filippo Airaldi , Azita Dabiri

The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning…

Robotics · Computer Science 2022-07-21 Jaeuk Shin , Astghik Hakobyan , Mingyu Park , Yeoneung Kim , Gihun Kim , Insoon Yang

Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Yanrong Li , Juan Du , Wei Jiang

Model predictive control (MPC) is a popular control engineering practice, but requires a sound knowledge of the model. Model-free predictive control (MFPC), a burning issue today, also related to reinforcement learning (RL) in AI, is…

Systems and Control · Electrical Eng. & Systems 2025-04-23 Cédric Join , Emmanuel Delaleau , Michel Fliess