English
Related papers

Related papers: Representing Neural Network Layers as Linear Opera…

200 papers

Dynamic mode decomposition (DMD) is a data-driven technique used for capturing the dynamics of complex systems. DMD has been connected to spectral analysis of the Koopman operator, and essentially extracts spatial-temporal modes of the…

Optimization and Control · Mathematics 2017-09-12 Byron Heersink , Michael A. Warren , Heiko Hoffmann

Koopman operator theory offers a rigorous treatment of dynamics and has been emerging as an alternative modeling and learning-based control method across various robotics sub-domains. Due to its ability to represent nonlinear dynamics as a…

Koopman spectral theory has provided a new perspective in the field of dynamical systems in recent years. Modern dynamical systems are becoming increasingly non-linear and complex, and there is a need for a framework to model these systems…

Machine Learning · Computer Science 2021-09-07 Alexander Krolicki , Pierre-Yves Lavertu

We present an approach to construct approximate Koopman-type decompositions for dynamical systems depending on static or time-varying parameters. Our method simultaneously constructs an invariant subspace and a parametric family of…

Optimization and Control · Mathematics 2024-11-12 Yue Guo , Milan Korda , Ioannis G. Kevrekidis , Qianxiao Li

This paper explores a simple question: can we model the internal transformations of a neural network using dynamical systems theory? We introduce Koopman autoencoders to capture how neural representations evolve through network layers,…

Machine Learning · Computer Science 2025-05-20 Nishant Suresh Aswani , Saif Eddin Jabari

Koopman operator theory has emerged as a leading data-driven approach that relies on a judicious choice of observable functions to realize global linear representations of nonlinear systems in the lifted observable space. However,…

Robotics · Computer Science 2026-01-06 Aditya Singh , Rajpal Singh , Jishnu Keshavan

This work explores the relationship between state space methods and Koopman operator-based methods for predicting the time-evolution of nonlinear dynamical systems. We demonstrate that extended dynamic mode decomposition with dictionary…

Chaotic Dynamics · Physics 2025-03-17 Jake Buzhardt , C. Ricardo Constante-Amores , Michael D. Graham

In this paper, we propose a novel algorithm for learning the Koopman operator of a dynamical system from a \textit{small} amount of training data. In many applications of data-driven modeling, e.g. biological network modeling,…

Dynamical Systems · Mathematics 2021-03-09 Subhrajit Sinha , Umesh Vaidya , Enoch Yeung

We propose a novel learning paradigm for Deep Neural Networks (DNN) by using Boolean logic algebra. We first present the basic differentiable operators of a Boolean system such as conjunction, disjunction and exclusive-OR and show how these…

Machine Learning · Computer Science 2019-04-10 Ali Payani , Faramarz Fekri

Linear dynamical systems are fully characterized by their eigenspectra, accessible directly from the generator of the dynamics. For nonlinear systems governed by partial differential equations, no equivalent theory exists. We introduce Lie…

Machine Learning · Computer Science 2026-04-02 Shafayeth Jamil , Rehan Kapadia

The analysis of nonlinear dynamical systems based on the Koopman operator is attracting attention in various applications. Dynamic mode decomposition (DMD) is a data-driven algorithm for Koopman spectral analysis, and several variants with…

Dynamical Systems · Mathematics 2017-10-31 Naoya Takeishi , Yoshinobu Kawahara , Takehisa Yairi

The framework of Koopman operator theory is discussed along with its connections to Dynamic Mode Decomposition (DMD) and (Kernel) Extended Dynamic Mode Decomposition (EDMD). This paper provides a succinct overview with consistent notation.…

Numerical Analysis · Mathematics 2024-10-07 Christophe Patyn , Geert Deconinck

Koopman operators provide tractable means of learning linear approximations of non-linear dynamics. Many approaches have been proposed to find these operators, typically based upon approximations using an a-priori fixed class of models.…

Systems and Control · Electrical Eng. & Systems 2021-02-09 Mario Sznaier

We propose a neural network-based model for nonlinear dynamics in continuous time that can impose inductive biases on decay rates and/or frequencies. Inductive biases are helpful for training neural networks especially when training data…

Machine Learning · Statistics 2022-12-27 Tomoharu Iwata , Yoshinobu Kawahara

Spatiotemporal graph neural networks (STGNNs) have shown promising results in many domains, from forecasting to epidemiology. However, understanding the dynamics learned by these models and explaining their behaviour is significantly more…

Machine Learning · Computer Science 2026-04-08 Michele Guerra , Simone Scardapane , Filippo Maria Bianchi

Nonlinear phenomena can be analyzed via linear techniques using operator-theoretic approaches. Data-driven method called the extended dynamic mode decomposition (EDMD) and its variants, which approximate the Koopman operator associated with…

Machine Learning · Computer Science 2022-05-18 Hiroaki Terao , Sho Shirasaka , Hideyuki Suzuki

This paper presents a class of linear predictors for nonlinear controlled dynamical systems. The basic idea is to lift the nonlinear dynamics into a higher dimensional space where its evolution is approximately linear. In an uncontrolled…

Optimization and Control · Mathematics 2018-03-26 Milan Korda , Igor Mezić

This paper presents a data-driven approach to approximate the dynamics of a nonlinear time-varying system (NTVS) by a linear time-varying system (LTVS), which is resulted from the Koopman operator and deep neural networks. Analysis of the…

Systems and Control · Electrical Eng. & Systems 2026-03-16 Wenjian Hao , Bowen Huang , Wei Pan , Di Wu , Shaoshuai Mou

Any deterministic autonomous dynamical system may be globally linearized by its' Koopman operator. This object is typically infinite-dimensional and can be approximated by the so-called Dynamic Mode Decomposition (DMD). In DMD, the central…

Dynamical Systems · Mathematics 2023-12-14 Gowtham S Seenivasaharagavan , Milan Korda , Hassan Arbabi , Igor Mezić

Dynamic Mode Decomposition (DMD) is a popular data-driven analysis technique used to decompose complex, nonlinear systems into a set of modes, revealing underlying patterns and dynamics through spectral analysis. This review presents a…

Dynamical Systems · Mathematics 2023-12-22 Matthew J. Colbrook