English
Related papers

Related papers: Sample-Efficient Online Control Policy Learning wi…

200 papers

This paper investigates the generalisability of Koopman-based representations for chaotic dynamical systems, focusing on their transferability across prediction and control tasks. Using the Lorenz system as a testbed, we propose a…

Machine Learning · Computer Science 2025-08-27 Kyriakos Hjikakou , Juan Diego Cardenas Cartagena , Matthia Sabatelli

Koopman operator theory yields powerful tools for modeling, analysis, and control of nonlinear dynamical systems. Prominently, linear time-invariant (LTI) Koopman representations have been proposed to enable the application of linear…

Optimization and Control · Mathematics 2026-05-29 Johannes Heeg , Karl Worthmann

Controlling soft continuum manipulator arms is difficult due to their infinite degrees of freedom, nonlinear material properties, and large deflections under loading. This paper presents a data-driven approach to identifying soft…

Robotics · Computer Science 2020-02-05 Daniel Bruder , Xun Fu , R. Brent Gillespie , C. David Remy , Ram Vasudevan

We propose Kernel Predictive Control (KPC), a learning-based predictive control strategy that enjoys deterministic guarantees of safety. Noise-corrupted samples of the unknown system dynamics are used to learn several models through the…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Emilio T. Maddalena , Paul Scharnhorst , Yuning Jiang , Colin N. Jones

We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN…

Machine Learning · Computer Science 2020-10-16 Yiqiang Han , Wenjian Hao , Umesh Vaidya

In this work, we propose a novel flow field-based motion planning method that drives a robot from any initial state to a desired reference trajectory such that it converges to the trajectory's end point. Despite demonstrated efficacy in…

Robotics · Computer Science 2025-11-13 Alice Kate Li , Thales C Silva , Victoria Edwards , Vijay Kumar , M. Ani Hsieh

Accurate modeling and control of autonomous vehicles remain a fundamental challenge due to the nonlinear and coupled nature of vehicle dynamics. While Koopman operator theory offers a framework for deploying powerful linear control…

Systems and Control · Electrical Eng. & Systems 2025-07-18 Mohammad Abtahi , Farhang Motallebi Araghi , Navid Mojahed , Shima Nazari

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

Reinforcement learning (RL) tackles sequential decision-making problems by creating agents that interacts with their environment. However, existing algorithms often view these problem as static, focusing on point estimates for model…

Machine Learning · Statistics 2024-03-21 Frank Shih , Faming Liang

The accurate modeling of dynamics in interactive environments is critical for successful long-range prediction. Such a capability could advance Reinforcement Learning (RL) and Planning algorithms, but achieving it is challenging.…

Machine Learning · Computer Science 2024-05-14 Arnab Kumar Mondal , Siba Smarak Panigrahi , Sai Rajeswar , Kaleem Siddiqi , Siamak Ravanbakhsh

The paper presents a framework for online learning of the Koopman operator using streaming data. Many complex systems for which data-driven modeling and control are sought provide streaming sensor data, the abundance of which can present…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Kartik Loya , Phanindra Tallapragada

Autonomous learning has been a promising direction in control and robotics for more than a decade since data-driven learning allows to reduce the amount of engineering knowledge, which is otherwise required. However, autonomous…

Machine Learning · Statistics 2017-10-12 Marc Peter Deisenroth , Dieter Fox , Carl Edward Rasmussen

Time-dependent structural reliability analysis of nonlinear dynamical systems is non-trivial; subsequently, scope of most of the structural reliability analysis methods is limited to time-independent reliability analysis only. In this work,…

Machine Learning · Statistics 2024-09-21 Navaneeth N. , Souvik Chakraborty

This paper is a study of reinforcement learning (RL) as an optimal-control strategy for control of nonlinear valves. It is evaluated against the PID (proportional-integral-derivative) strategy, using a unified framework. RL is an autonomous…

Machine Learning · Computer Science 2021-02-05 Rajesh Siraskar

We present flow Q-learning (FQL), a simple and performant offline reinforcement learning (RL) method that leverages an expressive flow-matching policy to model arbitrarily complex action distributions in data. Training a flow policy with RL…

Machine Learning · Computer Science 2025-05-27 Seohong Park , Qiyang Li , Sergey Levine

With the advantages of high modeling accuracy and large bandwidth, recurrent neural network (RNN) based inversion model control has been proposed for output tracking. However, some issues still need to be addressed when using the RNN-based…

Systems and Control · Electrical Eng. & Systems 2020-01-03 Shengwen Xie , Juan Ren

This study introduces a data-driven twin modeling framework based on modern Koopman operator theory, offering a significant advancement over classical modal decomposition by accurately capturing nonlinear dynamics with reduced complexity…

Numerical Analysis · Mathematics 2025-08-06 D. A. Bistrian

Koopman operators are of infinite dimension and capture the characteristics of nonlinear dynamics in a lifted global linear manner. The finite data-driven approximation of Koopman operators results in a class of linear predictors, useful…

Systems and Control · Electrical Eng. & Systems 2022-03-22 Xinglong Zhang , Wei Pan , Riccardo Scattolini , Shuyou Yu , Xin Xu

This letter introduces a machine-learning approach to learning the semantic dynamics of correlated systems with different control rules and dynamics. By leveraging the Koopman operator in an autoencoder (AE) framework, the system's state…

Robotics · Computer Science 2025-12-08 Abanoub M. Girgis , Hyowoon Seo , Mehdi Bennis

This paper presents a novel Koopman composition operator representation framework for control systems in reproducing kernel Hilbert spaces (RKHSs) that is free of explicit dictionary or input parametrizations. By establishing fundamental…

Systems and Control · Electrical Eng. & Systems 2025-09-03 Petar Bevanda , Bas Driessen , Lucian Cristian Iacob , Stefan Sosnowski , Roland Tóth , Sandra Hirche