English
Related papers

Related papers: DeepKoopFormer: A Koopman Enhanced Transformer Bas…

200 papers

The accurate modeling of dynamics in interactive environments is critical for successful long-range prediction. Such a capability could advance Reinforcement Learning (RL) and Planning algorithms, but achieving it is challenging.…

Machine Learning · Computer Science 2024-05-14 Arnab Kumar Mondal , Siba Smarak Panigrahi , Sai Rajeswar , Kaleem Siddiqi , Siamak Ravanbakhsh

In this work, we explore finite-dimensional linear representations of nonlinear dynamical systems by restricting the Koopman operator to an invariant subspace. The Koopman operator is an infinite-dimensional linear operator that evolves…

Dynamical Systems · Mathematics 2016-04-27 Steven L. Brunton , Bingni W. Brunton , Joshua L. Proctor , J. Nathan Kutz

This paper presents a distributed Koopman operator learning framework for modeling unknown nonlinear dynamics using sequential observations from multiple agents. Each agent estimates a local Koopman approximation based on lifted data and…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Ali Azarbahram , Shenyu Liu , Gian Paolo Incremona

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

Analyzing the long-term behavior of high-dimensional nonlinear dynamical systems remains a significant challenge. While the Koopman operator framework provides a powerful global linearization tool, current methods for approximating its…

Machine Learning · Computer Science 2025-05-28 Yuanchao Xu , Kaidi Shao , Nikos Logothetis , Zhongwei Shen

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorporating planning…

Computers and Society · Computer Science 2026-05-13 Raffael Theiler , Leandro Von Krannichfeldt , Giovanni Sansavini , Michael F. Howland , Olga Fink

Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong…

Machine Learning · Computer Science 2024-02-20 Yuqi Jiang , Yan Li , Yize Chen

Long-term time series forecasting (LTSF) represents a critical frontier in time series analysis, characterized by extensive input sequences, as opposed to the shorter spans typical of traditional approaches. While longer sequences…

Machine Learning · Computer Science 2024-10-17 Jinliang Deng , Feiyang Ye , Du Yin , Xuan Song , Ivor W. Tsang , Hui Xiong

This paper presents a generalizable methodology for data-driven identification of nonlinear dynamics that bounds the model error in terms of the prediction horizon and the magnitude of the derivatives of the system states. Using…

Machine Learning · Statistics 2021-05-03 Giorgos Mamakoukas , Maria L. Castano , Xiaobo Tan , Todd D. Murphey

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Ming Lin , Xiuyu Sun , Zhiyu Tan , Rong Jin

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

We present a novel data-driven approach for learning linear representations of a class of stable nonlinear systems using Koopman eigenfunctions. By learning the conjugacy map between a nonlinear system and its Jacobian linearization through…

Machine Learning · Computer Science 2022-05-31 Petar Bevanda , Johannes Kirmayr , Stefan Sosnowski , Sandra Hirche

The Koopman operator is a linear but infinite dimensional operator that governs the evolution of scalar observables defined on the state space of an autonomous dynamical system, and is a powerful tool for the analysis and decomposition of…

Dynamical Systems · Mathematics 2015-07-28 Matthew O. Williams , Ioannis G. Kevrekidis , Clarence W. Rowley

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

The Koopman representation is an infinite dimensional linear representation of linear or nonlinear dynamical systems. It represents the dynamics of output maps (aka observables), which are functions on the state space whose evaluation is…

Systems and Control · Electrical Eng. & Systems 2022-05-18 Bassam Bamieh

Recently, Koopman operator theory has become a powerful tool for developing linear representations of non-linear dynamical systems. However, existing data-driven applications of Koopman operator theory, including both traditional and deep…

Machine Learning · Computer Science 2023-05-17 King Fai Yeh , Paris Flood , William Redman , Pietro Liò

Koopman spectral analysis has attracted attention for nonlinear dynamical systems since we can analyze nonlinear dynamics with a linear regime by embedding data into a Koopman space by a nonlinear function. For the analysis, we need to find…

Machine Learning · Statistics 2021-02-10 Tomoharu Iwata , Yoshinobu Kawahara

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate variations and…

Machine Learning · Computer Science 2024-10-08 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Li Zhang , Jianmin Wang , Mingsheng Long

The Koopman operator provides a powerful framework for modeling dynamical systems and has attracted growing interest from the machine learning community. However, its infinite-dimensional nature makes identifying suitable finite-dimensional…

Machine Learning · Computer Science 2026-02-05 Xiaoyuan Cheng , Wenxuan Yuan , Yiming Yang , Yuanzhao Zhang , Sibo Cheng , Yi He , Zhuo Sun

Transfer operators offer linear representations and global, physically meaningful features of nonlinear dynamical systems. Discovering transfer operators, such as the Koopman operator, require careful crafted dictionaries of observables,…

Robotics · Computer Science 2023-08-15 Tahiya Salam , Alice Kate Li , M. Ani Hsieh