English
Related papers

Related papers: Representing Neural Network Layers as Linear Opera…

200 papers

As function approximators, deep neural networks have served as an effective tool to represent various signal types. Recent approaches utilize multi-layer perceptrons (MLPs) to learn a nonlinear mapping from a coordinate to its corresponding…

Machine Learning · Computer Science 2025-06-12 Woojin Cho , Minju Jo , Kookjin Lee , Noseong Park

This paper presents an active learning strategy for robotic systems that takes into account task information, enables fast learning, and allows control to be readily synthesized by taking advantage of the Koopman operator representation. We…

Robotics · Computer Science 2019-06-13 Ian Abraham , Todd D. Murphey

Developing agents that can perform complex control tasks from high-dimensional observations is a core ability of autonomous agents that requires underlying robust task control policies and adapting the underlying visual representations to…

Robotics · Computer Science 2024-09-06 Hemant Kumawat , Biswadeep Chakraborty , Saibal Mukhopadhyay

The scientific computation methods development in conjunction with artificial intelligence technologies remains a hot research topic. Finding a balance between lightweight and accurate computations is a solid foundation for this direction.…

Machine Learning · Computer Science 2025-07-03 Nikita Sakovich , Dmitry Aksenov , Ekaterina Pleshakova , Sergey Gataullin

Low dimensional representations of words allow accurate NLP models to be trained on limited annotated data. While most representations ignore words' local context, a natural way to induce context-dependent representations is to perform…

Machine Learning · Statistics 2015-06-02 David Belanger , Sham Kakade

Credit assignment problem of neural networks refers to evaluating the credit of each network component to the final outputs. For an untrained neural network, approaches to tackling it have made great contributions to parameter update and…

Machine Learning · Computer Science 2022-12-05 Zhen Liang , Changyuan Zhao , Wanwei Liu , Bai Xue , Wenjing Yang , Zhengbin Pang

Recent advancements in sensing and communication facilitate obtaining high-frequency real-time data from various physical systems like power networks, climate systems, biological networks, etc. However, since the data are recorded by…

Dynamical Systems · Mathematics 2023-12-27 S. Sinha , Sai P. Nandanoori , David Barajas-Solano

This paper presents a generalizable methodology for data-driven identification of nonlinear dynamics that bounds the model error in terms of the prediction horizon and the magnitude of the derivatives of the system states. Using…

Machine Learning · Statistics 2021-05-03 Giorgos Mamakoukas , Maria L. Castano , Xiaobo Tan , Todd D. Murphey

We propose a machine-learning approach to model long-term out-of-sample dynamics of brain activity from task-dependent fMRI data. Our approach is a three stage one. First, we exploit Diffusion maps (DMs) to discover a set of variables that…

Numerical Analysis · Mathematics 2024-11-05 Ioannis K. Gallos , Daniel Lehmberg , Felix Dietrich , Constantinos Siettos

Nonlinear coupled systems are ubiquitous in science and engineering. The analysis and modeling of such systems is challenging due to their high dimensionality and complex interactions among subsystems. In recent years, operator-theoretic…

Machine Learning · Computer Science 2026-05-05 Tatsuya Naoi , Jun Ohkubo

Koopman operators provide a linear framework for data-driven analyses of nonlinear dynamical systems, but their infinite-dimensional nature presents major computational challenges. In this article, we offer an introductory guide to Koopman…

Numerical Analysis · Mathematics 2025-10-28 Matthew J. Colbrook , Zlatko Drmač , Andrew Horning

Soft robots are challenging to model due in large part to the nonlinear properties of soft materials. Fortunately, this softness makes it possible to safely observe their behavior under random control inputs, making them amenable to…

Robotics · Computer Science 2019-05-03 Daniel Bruder , C. David Remy , Ram Vasudevan

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

This study introduces a data-driven twin modeling framework based on modern Koopman operator theory, offering a significant advancement over classical modal decomposition by accurately capturing nonlinear dynamics with reduced complexity…

Numerical Analysis · Mathematics 2025-08-06 D. A. Bistrian

This paper presents an interpretable machine learning approach that characterizes load dynamics within an operator-theoretic framework for electricity load forecasting in power grids. We represent the dynamics of load data using the Koopman…

Machine Learning · Computer Science 2024-12-02 Ali Tavasoli , Behnaz Moradijamei , Heman Shakeri

The Koopman operator lifts nonlinear dynamical systems into a functional space of observables, where the dynamics are linear. In this paper, we provide three different Koopman representations for hybrid systems. The first is specific to…

Dynamical Systems · Mathematics 2020-06-23 Craig Bakker , Arnab Bhattacharya , Samrat Chatterjee , Casey J. Perkins , Matthew R. Oster

Quadrotor systems are common and beneficial for many fields, but their intricate behavior often makes it challenging to design effective and optimal control strategies. Some traditional approaches to nonlinear control often rely on local…

Systems and Control · Electrical Eng. & Systems 2024-06-27 Zeyad M. Manaa , Ayman M. Abdallah , Mohammad A. Abido , Syed S. Azhar Ali

Koopman operator theory has proven to be a promising approach to nonlinear system identification and global linearization. For nearly a century, there had been no efficient means of calculating the Koopman operator for applied engineering…

Systems and Control · Electrical Eng. & Systems 2023-03-22 Waqas Manzoor , Samir Rawashdeh , Alireza Mohammadi

The Koopman representation is an infinite dimensional linear representation of linear or nonlinear dynamical systems. It represents the dynamics of output maps (aka observables), which are functions on the state space whose evaluation is…

Systems and Control · Electrical Eng. & Systems 2022-05-18 Bassam Bamieh

Reachability analysis of nonlinear dynamical systems is a challenging and computationally expensive task. Computing the reachable states for linear systems, in contrast, can often be done efficiently in high dimensions. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2021-05-04 Stanley Bak , Sergiy Bogomolov , Parasara Sridhar Duggirala , Adam R. Gerlach , Kostiantyn Potomkin