English
Related papers

Related papers: Leveraging Reinforcement Learning and Koopman Theo…

200 papers

In the development of model predictive controllers for PDE-constrained problems, the use of reduced order models is essential to enable real-time applicability. Besides local linearization approaches, Proper Orthogonal Decomposition (POD)…

Optimization and Control · Mathematics 2020-12-15 Sebastian Peitz , Stefan Klus

This work focuses on developing a data-driven framework using Koopman operator theory for system identification and linearization of nonlinear systems for control. Our proposed method presents a deep learning framework with recursive…

Systems and Control · Electrical Eng. & Systems 2023-09-11 Madhur Tiwari , George Nehma , Bethany Lusch

This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics. To improve the computational efficiency of classic MPPI while preserving control performance, we replace…

Robotics · Computer Science 2026-03-06 Wenjian Hao , Yuxuan Fang , Zehui Lu , Shaoshuai Mou

Data-driven model predictive control based on Willems' fundamental lemma has proven effective for linear systems, but extending stability guarantees to nonlinear systems remains an open challenge. In this paper, we establish conditions…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Amin Taghieh , SangWoo Park

We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN…

Machine Learning · Computer Science 2020-10-16 Yiqiang Han , Wenjian Hao , Umesh Vaidya

In recent years, the success of the Koopman operator in dynamical systems analysis has also fueled the development of Koopman operator-based control frameworks. In order to preserve the relatively low data requirements for an approximation…

Optimization and Control · Mathematics 2020-10-15 Sebastian Peitz , Samuel E. Otto , Clarence W. Rowley

Greenhouse climate control is concerned with maximizing performance in terms of crop yield and resource efficiency. One promising approach is model predictive control (MPC), which leverages a model of the system to optimize the control…

Systems and Control · Electrical Eng. & Systems 2025-01-06 Samuel Mallick , Filippo Airaldi , Azita Dabiri , Congcong Sun , Bart De Schutter

In vehicle trajectory tracking tasks, the simplest approach is the Pure Pursuit (PP) Control. However, this single-point preview tracking strategy fails to consider vehicle model constraints, compromising driving safety. Model Predictive…

Robotics · Computer Science 2025-08-06 Yonghao Fu , Cheng Hu , Haokun Xiong , Zhanpeng Bao , Wenyuan Du , Edoardo Ghignone , Michele Magno , Lei Xie , Hongye Su

Reinforcement learning (RL) and model predictive control (MPC) each offer distinct advantages and limitations when applied to control problems in power and energy systems. Despite various studies on these methods, benchmarks remain lacking…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Mohamad Fares El Hajj Chehade , Young-ho Cho , Sandeep Chinchali , Hao Zhu

Online optimal control of quadruped robots would enable them to adapt to varying inputs and changing conditions in real time. A common way of achieving this is linear model predictive control (LMPC), where a quadratic programming (QP)…

Robotics · Computer Science 2025-08-13 Chun-Ming Yang , Pranav A. Bhounsule

In this work, we propose a meta-learning-based Koopman modeling and predictive control approach for nonlinear systems with parametric uncertainties. An adaptive deep meta-learning-based modeling approach, called Meta Adaptive Koopman…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Minghao Han , Kiwan Wong , Adrian Wing-Keung Law , Xunyuan Yin

Accurate modeling and control of autonomous vehicles remain a fundamental challenge due to the nonlinear and coupled nature of vehicle dynamics. While Koopman operator theory offers a framework for deploying powerful linear control…

Systems and Control · Electrical Eng. & Systems 2025-07-18 Mohammad Abtahi , Farhang Motallebi Araghi , Navid Mojahed , Shima Nazari

Soft robots, compared to regular rigid robots, as their multiple segments with soft materials bring flexibility and compliance, have the advantages of safe interaction and dexterous operation in the environment. However, due to its…

Robotics · Computer Science 2025-05-02 Lei Lv , Lei Liu , Lei Bao , Fuchun Sun , Jiahong Dong , Jianwei Zhang , Xuemei Shan , Kai Sun , Hao Huang , Yu Luo

Reinforcement Learning (RL) has proven a stunning ability to learn optimal policies from data without any prior knowledge on the process. The main drawback of RL is that it is typically very difficult to guarantee stability and safety. On…

Systems and Control · Electrical Eng. & Systems 2020-05-12 Mario Zanon , Vyacheslav Kungurtsev , Sébastien Gros

Autonomous driving technologies have received notable attention in the past decades. In autonomous driving systems, identifying a precise dynamical model for motion control is nontrivial due to the strong nonlinearity and uncertainty in…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Yongqian Xiao , Xinglong Zhang , Xin Xu , Xueqing Liu , Jiahang Liu

In this paper we propose a new approach to complement reinforcement learning (RL) with model-based control (in particular, Model Predictive Control - MPC). We introduce an algorithm, the MPC augmented RL (MPRL) that combines RL and MPC in a…

Artificial Intelligence · Computer Science 2020-02-27 Meghana Rathi , Pietro Ferraro , Giovanni Russo

This study conducts a comparative analysis of Model Predictive Control (MPC) and Proximal Policy Optimization (PPO), a Deep Reinforcement Learning (DRL) algorithm, applied to a 1-Degree of Freedom (DOF) Quanser Aero 2 system. Classical…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Georg Schäfer , Jakob Rehrl , Stefan Huber , Simon Hirlaender

Reinforcement Learning (RL) and Machine Learning Integrated Model Predictive Control (ML-MPC) are promising approaches for optimizing hydrogen-diesel dual-fuel engine control, as they can effectively control multiple-input multiple-output…

Machine Learning · Computer Science 2025-05-07 Julian Bedei , Murray McBain , Alexander Winkler , Charles Robert Koch , Jakob Andert , David Gordon

Model Predictive Control (MPC) faces computational demands and performance degradation from model inaccuracies. We propose two architectures combining Neural Network-approximated MPC (NNMPC) with Reinforcement Learning (RL). The first, Warm…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Xiaolong Jia , Nikhil Bajaj

This paper presents a study of the Koopman operator theory and its application to optimal control of a multi-robot system. The Koopman operator, while operating on a set of observation functions of the state vector of a nonlinear system,…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Gang Tao , Qianhong Zhao