English
Related papers

Related papers: Sample-Efficient Online Control Policy Learning wi…

200 papers

The Koopman operator theory is an increasingly popular formalism of dynamical systems theory which enables analysis and prediction of the nonlinear dynamics from measurement data. Building on the recent development of the Koopman model…

Fluid Dynamics · Physics 2018-06-08 Hassan Arbabi , Milan Korda , Igor Mezic

The Koopman operator provides a powerful framework for representing the dynamics of general nonlinear dynamical systems. However, existing data-driven approaches to learning the Koopman operator rely on batch data. In this work, we present…

Machine Learning · Statistics 2026-04-16 Boya Hou , Sina Sanjari , Nathan Dahlin , Alec Koppel , Subhonmesh Bose

A Learning Model Predictive Controller (LMPC) for linear system in presented. The proposed controller is an extension of the LMPC [1] and it aims to decrease the computational burden. The control scheme is reference-free and is able to…

Optimization and Control · Mathematics 2019-10-31 Ugo Rosolia , Francesco Borrelli

Achieving rapid and time-deterministic stabilization for complex systems characterized by strong nonlinearities and parametric uncertainties presents a significant challenge. Traditional model-based control relies on precise system models,…

Systems and Control · Electrical Eng. & Systems 2025-07-04 Yue Wu

We propose a generalization of modern representation learning objectives by reframing them as recursive divergence alignment processes over localized conditional distributions While recent frameworks like Information Contrastive Learning…

Machine Learning · Computer Science 2025-05-02 Anthony D Martin

The robotic assembly represents a group of benchmark problems for reinforcement learning and variable compliance control that features sophisticated contact manipulation. One of the key challenges in applying reinforcement learning to…

Robotics · Computer Science 2019-05-14 Tianyu Ren , Yunfei Dong , Dan Wu , Ken Chen

Among various branches of offline reinforcement learning (RL) methods, goal-conditioned supervised learning (GCSL) has gained increasing popularity as it formulates the offline RL problem as a sequential modeling task, therefore bypassing…

Machine Learning · Computer Science 2024-12-17 Guan Wang , Haoyi Niu , Jianxiong Li , Li Jiang , Jianming Hu , Xianyuan Zhan

With the advancement of sensing and communication in power networks, high-frequency real-time data from a power network can be used as a resource to develop better monitoring capabilities. In this work, a systematic approach based on…

Systems and Control · Electrical Eng. & Systems 2020-03-12 Subhrajit Sinha , Sai Pushpak Nandanoori , Enoch Yeung

The Bellman equation and its continuous form, the Hamilton-Jacobi-Bellman equation, are ubiquitous in reinforcement learning and control theory. However, these equations become intractable for high-dimensional or nonlinear systems. This…

Artificial Intelligence · Computer Science 2026-05-04 Preston Rozwood , Edward Mehrez , Ludger Paehler , Wen Sun , Steven L. Brunton

We propose a fully data-driven, Koopman-based framework for statistically robust control of discrete-time nonlinear systems with linear embeddings. Establishing a connection between the Koopman operator and contraction theory, it offers…

Robotics · Computer Science 2026-03-24 Koki Hirano , Hiroyasu Tsukamoto

Traditional dynamic models of continuum robots are in general computationally expensive and not suitable for real-time control. Recent approaches using learning-based methods to approximate the dynamic model of continuum robots for control…

Robotics · Computer Science 2022-05-16 Xinran Wang , Nicolas Rojas

This paper presents an efficient model predictive path integral (MPPI) control framework for systems with complex nonlinear dynamics. To improve the computational efficiency of classic MPPI while preserving control performance, we replace…

Robotics · Computer Science 2026-03-06 Wenjian Hao , Yuxuan Fang , Zehui Lu , Shaoshuai Mou

Forecasting driving behavior or other sensor measurements is an essential component of autonomous driving systems. Often real-world multivariate time series data is hard to model because the underlying dynamics are nonlinear and the…

Machine Learning · Computer Science 2021-11-17 Giao Nguyen-Quynh , Philipp Becker , Chen Qiu , Maja Rudolph , Gerhard Neumann

Most of the existing works for reinforcement learning (RL) with general function approximation (FA) focus on understanding the statistical complexity or regret bounds. However, the computation complexity of such approaches is far from being…

Machine Learning · Computer Science 2023-04-19 Dingwen Kong , Ruslan Salakhutdinov , Ruosong Wang , Lin F. Yang

This paper introduces a solution to the problem of selecting dynamically (online) the ``optimal'' p-norm to combat outliers in linear adaptive filtering without any knowledge on the probability density function of the outliers. The proposed…

Machine Learning · Computer Science 2022-10-24 Yuki Akiyama , Minh Vu , Konstantinos Slavakis

Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online RL by leveraging abundant non-curated data that is…

Machine Learning · Computer Science 2025-05-20 Yi Zhao , Aidan Scannell , Wenshuai Zhao , Yuxin Hou , Tianyu Cui , Le Chen , Dieter Büchler , Arno Solin , Juho Kannala , Joni Pajarinen

Sample efficiency is critical when applying learning-based methods to robotic manipulation due to the high cost of collecting expert demonstrations and the challenges of on-robot policy learning through online Reinforcement Learning (RL).…

Machine Learning · Computer Science 2024-06-21 Arsh Tangri , Ondrej Biza , Dian Wang , David Klee , Owen Howell , Robert Platt

Due to its training stability and strong expression, the diffusion model has attracted considerable attention in offline reinforcement learning. However, several challenges have also come with it: 1) The demand for a large number of…

Machine Learning · Computer Science 2024-01-25 Yuhui Chen , Haoran Li , Dongbin Zhao

In this work, we propose a meta-learning-based Koopman modeling and predictive control approach for nonlinear systems with parametric uncertainties. An adaptive deep meta-learning-based modeling approach, called Meta Adaptive Koopman…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Minghao Han , Kiwan Wong , Adrian Wing-Keung Law , Xunyuan Yin

Controlling nonlinear dynamical systems remains a central challenge in a wide range of applications, particularly when accurate first-principle models are unavailable. Data-driven approaches offer a promising alternative by designing…

Systems and Control · Electrical Eng. & Systems 2025-12-23 Robin Strässer , Karl Worthmann , Igor Mezić , Julian Berberich , Manuel Schaller , Frank Allgöwer