English
Related papers

Related papers: Optimizing Neural Networks via Koopman Operator Th…

200 papers

Recently, Koopman operator theory has become a powerful tool for developing linear representations of non-linear dynamical systems. However, existing data-driven applications of Koopman operator theory, including both traditional and deep…

Machine Learning · Computer Science 2023-05-17 King Fai Yeh , Paris Flood , William Redman , Pietro Liò

Autonomous driving technologies have received notable attention in the past decades. In autonomous driving systems, identifying a precise dynamical model for motion control is nontrivial due to the strong nonlinearity and uncertainty in…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Yongqian Xiao , Xinglong Zhang , Xin Xu , Xueqing Liu , Jiahang Liu

Nonlinearity plays a crucial role in deep neural networks. In this paper, we investigate the degree to which the nonlinearity of the neural network is essential. For this purpose, we employ the Koopman operator, extended dynamic mode…

Machine Learning · Computer Science 2024-07-08 Naoki Sugishita , Kayo Kinjo , Jun Ohkubo

Analyzing the inner mechanisms of deep neural networks is a fundamental task in machine learning. Existing work provides limited analysis or it depends on local theories, such as fixed-point analysis. In contrast, we propose to analyze…

Machine Learning · Computer Science 2023-02-24 Ilan Naiman , Omri Azencot

Koopman operator theory offers a rigorous treatment of dynamics and has been emerging as an alternative modeling and learning-based control method across various robotics sub-domains. Due to its ability to represent nonlinear dynamics as a…

We consider the training process of a neural network as a dynamical system acting on the high-dimensional weight space. Each epoch is an application of the map induced by the optimization algorithm and the loss function. Using this induced…

Machine Learning · Computer Science 2020-06-23 Iva Manojlović , Maria Fonoberova , Ryan Mohr , Aleksandr Andrejčuk , Zlatko Drmač , Yannis Kevrekidis , Igor Mezić

Nonlinear differential equations are encountered as models of fluid flow, spiking neurons, and many other systems of interest in the real world. Common features of these systems are that their behaviors are difficult to describe exactly and…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Zexin Sun , Mingyu Chen , John Baillieul

Koopman analysis provides a general framework from which to analyze a nonlinear dynamical system in terms of a linear operator acting on an infinite-dimensional observable space. This theoretical framework provides a rigorous underpinning…

Dynamical Systems · Mathematics 2022-10-11 Dan Wilson

The strong performance of simple neural networks is often attributed to their nonlinear activations. However, a linear view of neural networks makes understanding and controlling networks much more approachable. We draw from a dynamical…

Machine Learning · Computer Science 2024-09-04 Nishant Suresh Aswani , Saif Eddin Jabari , Muhammad Shafique

Over the last few years, several works have proposed deep learning architectures to learn dynamical systems from observation data with no or little knowledge of the underlying physics. A line of work relies on learning representations where…

Machine Learning · Computer Science 2023-03-14 Anthony Frion , Lucas Drumetz , Mauro Dalla Mura , Guillaume Tochon , Abdeldjalil Aissa El Bey

The Koopman operator has recently garnered much attention for its value in dynamical systems analysis and data-driven model discovery. However, its application has been hindered by the computational complexity of extended dynamic mode…

Machine Learning · Computer Science 2017-12-11 Enoch Yeung , Soumya Kundu , Nathan Hodas

We propose a neural network-based model for nonlinear dynamics in continuous time that can impose inductive biases on decay rates and/or frequencies. Inductive biases are helpful for training neural networks especially when training data…

Machine Learning · Statistics 2022-12-27 Tomoharu Iwata , Yoshinobu Kawahara

Koopman operator theory is receiving increased attention due to its promise to linearize nonlinear dynamics. Neural networks that are developed to represent Koopman operators have shown great success thanks to their ability to approximate…

Machine Learning · Computer Science 2022-11-18 Yuying Liu , Aleksei Sholokhov , Hassan Mansour , Saleh Nabi

The Koopman operator allows for handling nonlinear systems through a (globally) linear representation. In general, the operator is infinite-dimensional - necessitating finite approximations - for which there is no overarching framework.…

Systems and Control · Electrical Eng. & Systems 2021-12-23 Petar Bevanda , Stefan Sosnowski , Sandra Hirche

Nonlinear optimal control is vital for numerous applications but remains challenging for unknown systems due to the difficulties in accurately modelling dynamics and handling computational demands, particularly in high-dimensional settings.…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Zhexuan Zeng , Ruikun Zhou , Yiming Meng , Jun Liu

The Koopman operator has entered and transformed many research areas over the last years. Although the underlying concept$\unicode{x2013}$representing highly nonlinear dynamical systems by infinite-dimensional linear…

Dynamical Systems · Mathematics 2024-12-17 Stefan Klus , Nataša Djurdjevac Conrad

Recently Koopman operator has become a promising data-driven tool to facilitate real-time control for unknown nonlinear systems. It maps nonlinear systems into equivalent linear systems in embedding space, ready for real-time linear control…

Robotics · Computer Science 2022-06-16 Haojie Shi , Max Q. -H. Meng

With the increasing availability of large scale datasets, computational power and tools like automatic differentiation and expressive neural network architectures, sequential data are now often treated in a data-driven way, with a dynamical…

Machine Learning · Computer Science 2024-06-25 Anthony Frion , Lucas Drumetz , Mauro Dalla Mura , Guillaume Tochon , Abdeldjalil Aïssa El Bey

Koopman operator theory has proven to be a promising approach to nonlinear system identification and global linearization. For nearly a century, there had been no efficient means of calculating the Koopman operator for applied engineering…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Waqas Manzoor , Samir Rawashdeh , Alireza Mohammadi

This paper presents a study of the Koopman operator theory and its application to optimal control of a multi-robot system. The Koopman operator, while operating on a set of observation functions of the state vector of a nonlinear system,…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Gang Tao , Qianhong Zhao
‹ Prev 1 2 3 10 Next ›