English
Related papers

Related papers: Should we use model-free or model-based control? A…

200 papers

Battery swapping stations (BSS) offer a fast and scalable alternative to conventional electric vehicle (EV) charging, gaining growing policy support worldwide. However, existing BSS control strategies typically rely on heuristics or…

Optimization and Control · Mathematics 2025-11-21 Ruochen Li , Zhichao Chen , Zhaoting Zhang , Renjie Guo , Zhankun Sun , Jiwei Yao , Jiaze Ma

Model predictive control (MPC) is widely used in industries but implementing it poses challenges due to hardware or time constraints. A promising solution is to approximate the MPC policy using function approximators like neural networks.…

Optimization and Control · Mathematics 2026-05-08 Chenchen Zhou , Yi Cao , Shuang-hua Yang

For the application of MPC design in on-line regulation or tracking control problems, several studies have attempted to develop an accurate model, and realize adequate uncertainty description of linear or non-linear plants of the processes.…

Optimization and Control · Mathematics 2019-04-03 Yuanqiang Zhou , Dewei Li , Yugeng Xi , Zhongxue Gan

Reinforcement Learning is divided in two main paradigms: model-free and model-based. Each of these two paradigms has strengths and limitations, and has been successfully applied to real world domains that are appropriate to its…

Machine Learning · Computer Science 2017-10-19 Somil Bansal , Roberto Calandra , Kurtland Chua , Sergey Levine , Claire Tomlin

Model Predictive Control (MPC) has established itself as the primary methodology for constrained control, enabling autonomy across diverse applications. While model fidelity is crucial in MPC, solving the corresponding optimization problem…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Lukas Schroth , Daniel Morton , Amon Lahr , Daniele Gammelli , Andrea Carron , Marco Pavone

Reinforcement Learning (RL) is a powerful tool to perform data-driven optimal control without relying on a model of the system. However, RL struggles to provide hard guarantees on the behavior of the resulting control scheme. In contrast,…

Systems and Control · Computer Science 2020-09-18 Sébastien Gros , Mario Zanon

Model predictive control (MPC) is a powerful control method that allows to directly include state and input constraints into the controller design. However, errors in the model, e.g., caused by unknown disturbances, can lead to constraint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Felix Brändle , Frank Allgöwer

A continuous rise in the penetration of renewable energy sources, along with the use of the single imbalance pricing, provides a new opportunity for balance responsible parties to reduce their cost through energy arbitrage in the imbalance…

Systems and Control · Electrical Eng. & Systems 2024-05-01 Seyed Soroush Karimi Madahi , Gargya Gokhale , Marie-Sophie Verwee , Bert Claessens , Chris Develder

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

We propose a hybrid reinforcement learning (RL) and model predictive control (MPC) framework for mixed-integer optimal control, where discrete variables enter the cost and dynamics but not the constraints. Existing hierarchical approaches…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Joschua Wüthrich , Romir Damle , Giona Fieni , Melanie N. Zeilinger , Christopher H. Onder , Andrea Carron

Several Radio Resource Management (RRM) use cases can be framed as sequential decision planning problems, where an agent (the base station, typically) makes decisions that influence the network utility and state. While Reinforcement…

Networking and Internet Architecture · Computer Science 2024-05-31 Lorenzo Maggi , Matthew Andrews , Ryo Koblitz

Offline learning is a key part of making reinforcement learning (RL) useable in real systems. Offline RL looks at scenarios where there is data from a system's operation, but no direct access to the system when learning a policy. Recent…

Machine Learning · Computer Science 2021-03-18 Arthur Argenson , Gabriel Dulac-Arnold

Decarbonisation is driving dramatic growth in renewable power generation. This increases uncertainty in the load to be served by power plants and makes their efficient scheduling, known as the unit commitment (UC) problem, more difficult.…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Cormac O'Malley , Patrick de Mars , Luis Badesa , Goran Strbac

Model-based Reinforcement Learning (MBRL) has shown many desirable properties for intelligent control tasks. However, satisfying safety and stability constraints during training and rollout remains an open question. We propose a new…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Harry Zhang

Event-triggered model predictive control (eMPC) is a popular optimal control method with an aim to alleviate the computation and/or communication burden of MPC. However, it generally requires priori knowledge of the closed-loop system…

Robotics · Computer Science 2022-08-23 Fengying Dang , Dong Chen , Jun Chen , Zhaojian Li

We study the problem of learning safe control policies that are also effective; i.e., maximizing the probability of satisfying a linear temporal logic (LTL) specification of a task, and the discounted reward capturing the (classic) control…

Robotics · Computer Science 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic

In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this…

Systems and Control · Electrical Eng. & Systems 2021-10-04 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

This paper states that Model-Free Control (MFC), which must not be confused with Model-Free Reinforcement Learning, is a new tool for Machine Learning (ML). MFC is easy to implement and should be substituted in control engineering to ML via…

Systems and Control · Electrical Eng. & Systems 2020-12-11 Michel Fliess , Cédric Join

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of…

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen