English
Related papers

Related papers: Credit Assignment for Trained Neural Networks Base…

200 papers

This paper introduces new model parameterizations for learning discrete-time dynamical systems from data via the Koopman operator and studies their properties. Whereas most existing works on Koopman learning do not take into account the…

Systems and Control · Electrical Eng. & Systems 2025-05-09 Fletcher Fan , Bowen Yi , David Rye , Guodong Shi , Ian R. Manchester

Nonlinear differential equations are encountered as models of fluid flow, spiking neurons, and many other systems of interest in the real world. Common features of these systems are that their behaviors are difficult to describe exactly and…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Zexin Sun , Mingyu Chen , John Baillieul

This paper develops a methodology for adaptive data-driven Model Predictive Control (MPC) using Koopman operators. While MPC is ubiquitous in various fields of engineering, the controller performance can deteriorate if the modeling error…

Optimization and Control · Mathematics 2024-12-05 Daisuke Uchida , Karthik Duraisamy

Recurrent neural networks are widely used for modeling spatio-temporal sequences in both nature language processing and neural population dynamics. However, understanding the temporal credit assignment is hard. Here, we propose that each…

Disordered Systems and Neural Networks · Physics 2023-02-20 Wenxuan Zou , Chan Li , Haiping Huang

The reconstruction of phase spaces is an essential step to analyze time series according to Dynamical System concepts. A regression performed on such spaces unveils the relationships among system states from which we can derive their…

Machine Learning · Computer Science 2020-06-23 Lucas Pagliosa , Alexandru Telea , Rodrigo Mello

The Koopman operator allows for handling nonlinear systems through a (globally) linear representation. In general, the operator is infinite-dimensional - necessitating finite approximations - for which there is no overarching framework.…

Systems and Control · Electrical Eng. & Systems 2021-12-23 Petar Bevanda , Stefan Sosnowski , Sandra Hirche

Learning complex network dynamics is fundamental to understanding, modelling and controlling real-world complex systems. There are two main problems in the task of predicting the dynamic evolution of complex networks: on the one hand,…

Artificial Intelligence · Computer Science 2025-10-14 Bicheng Wang , Junping Wang , Yibo Xue

Koopman operator theory is receiving increased attention due to its promise to linearize nonlinear dynamics. Neural networks that are developed to represent Koopman operators have shown great success thanks to their ability to approximate…

Machine Learning · Computer Science 2022-11-18 Yuying Liu , Aleksei Sholokhov , Hassan Mansour , Saleh Nabi

Koopman operator theory has found significant success in learning models of complex, real-world dynamical systems, enabling prediction and control. The greater interpretability and lower computational costs of these models, compared to…

Dynamical Systems · Mathematics 2025-01-08 William T. Redman , Dean Huang , Maria Fonoberova , Igor Mezić

The high computational and parameter complexity of neural networks makes their training very slow and difficult to deploy on energy and storage-constrained computing systems. Many network complexity reduction techniques have been proposed…

Machine Learning · Computer Science 2019-01-01 Charbel Sakr , Naresh Shanbhag

Deep learning has achieved impressive prediction accuracies in a variety of scientific and industrial domains. However, the nested non-linear feature of deep learning makes the learning highly non-transparent, i.e., it is still unknown how…

Machine Learning · Computer Science 2020-10-26 Chan Li , Haiping Huang

Koopman analysis of a general dynamics system provides a linear Koopman operator and an embedded eigenfunction space, enabling the application of standard techniques from linear analysis. However, in practice, deriving exact operators and…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Alexander Estornell , Leonard Jung , Alenna Spiro , Mario Sznaier , Michael Everett

This paper presents a data-learned linear Koopman embedding of nonlinear networked dynamics and uses it to enable real-time model predictive emergency voltage control in a power network. The approach involves a novel data-driven…

Systems and Control · Electrical Eng. & Systems 2023-10-06 Ramij R. Hossain , Rahmat Adesunkanmi , Ratnesh Kumar

With the development of end-to-end control based on deep learning, it is important to study new system modeling techniques to realize dynamics modeling with high-dimensional inputs. In this paper, a novel Koopman-based deep convolutional…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Yongqian Xiao , Xin Xu , QianLi Lin

The study of the Two-Body and Circular Restricted Three-Body Problems in the field of aerospace engineering and sciences is deeply important because they help describe the motion of both celestial and artificial satellites. With the growing…

Mathematical Physics · Physics 2025-04-17 George Nehma , Madhur Tiwari , Manasvi Lingam

The inductive biases of trained neural networks are difficult to understand and, consequently, to adapt to new settings. We study the inductive biases of linearizations of neural networks, which we show to be surprisingly good summaries of…

Machine Learning · Statistics 2021-04-29 Wesley J. Maddox , Shuai Tang , Pablo Garcia Moreno , Andrew Gordon Wilson , Andreas Damianou

We present an approach to construct approximate Koopman-type decompositions for dynamical systems depending on static or time-varying parameters. Our method simultaneously constructs an invariant subspace and a parametric family of…

Optimization and Control · Mathematics 2024-11-12 Yue Guo , Milan Korda , Ioannis G. Kevrekidis , Qianxiao Li

When complex systems with nonlinear dynamics achieve an output performance objective, only a fraction of the state dynamics significantly impacts that output. Those minimal state dynamics can be identified using the differential geometric…

Optimization and Control · Mathematics 2022-10-19 Shara Balakrishnan , Aqib Hasnain , Robert Egbert , Enoch Yeung

Deep learning is revolutionizing weather forecasting, with new data-driven models achieving accuracy on par with operational physical models for medium-term predictions. However, these models often lack interpretability, making their…

Machine Learning · Computer Science 2024-09-11 David Millard , Arielle Carr , Stéphane Gaudreault

Many tasks in graph machine learning, such as link prediction and node classification, are typically solved by using representation learning, in which each node or edge in the network is encoded via an embedding. Though there exists a lot…