English
Related papers

Related papers: Subspace Pruning via Principal Vectors for Accurat…

200 papers

Koopman operators provide a linear framework for data-driven analyses of nonlinear dynamical systems, but their infinite-dimensional nature presents major computational challenges. In this article, we offer an introductory guide to Koopman…

Numerical Analysis · Mathematics 2025-10-28 Matthew J. Colbrook , Zlatko Drmač , Andrew Horning

The control of legged robots, particularly humanoid and quadruped robots, presents significant challenges due to their high-dimensional and nonlinear dynamics. While linear systems can be effectively controlled using methods like Model…

Robotics · Computer Science 2025-06-04 Feihan Li , Abulikemu Abuduweili , Yifan Sun , Rui Chen , Weiye Zhao , Changliu Liu

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

In this paper, we address two challenging problems in unsupervised subspace learning: 1) how to automatically identify the feature dimension of the learned subspace (i.e., automatic subspace learning), and 2) how to learn the underlying…

Computer Vision and Pattern Recognition · Computer Science 2017-05-17 Xi Peng , Jiwen Lu , Zhang Yi , Rui Yan

Koopman-based methods leverage a nonlinear lifting to enable linear regression techniques. Consequently, data generation, learning and prediction is performed through the lens of this lifting, giving rise to a nonlinear manifold that is…

Dynamical Systems · Mathematics 2025-06-24 Pieter van Goor , Robert Mahony , Manuel Schaller , Karl Worthmann

We present approximate algorithms for performing smoothing in a class of high-dimensional state-space models via sequential Monte Carlo methods ("particle filters"). In high dimensions, a prohibitively large number of Monte Carlo samples…

Computation · Statistics 2017-09-21 Axel Finke , Sumeetpal S. Singh

Many statistical models seek relationship between variables via subspaces of reduced dimensions. For instance, in factor models, variables are roughly distributed around a low dimensional subspace determined by the loading matrix; in mixed…

Methodology · Statistics 2018-05-09 Jianqing Fan , Yiqiao Zhong

The Koopman operator provides a linear perspective on non-linear dynamics by focusing on the evolution of observables in an invariant subspace. Observables of interest are typically linearly reconstructed from the Koopman eigenfunctions.…

Dynamical Systems · Mathematics 2024-03-06 Shaowu Pan , Karthik Duraisamy

Structured pruning is an effective approach for compressing large pre-trained neural networks without significantly affecting their performance. However, most current structured pruning methods do not provide any performance guarantees, and…

Machine Learning · Computer Science 2023-02-14 Marwa El Halabi , Suraj Srinivas , Simon Lacoste-Julien

MPC is widely used in real-time applications, but practical implementations are typically restricted to convex QP formulations to ensure fast and certified execution. Koopman-based MPC enables QP-based control of nonlinear systems by…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Liang Wu , Wallace Gian Yion Tan , Leqi Zhou , Richard D. Braatz , Jan Drgona

A large number of algorithms in machine learning, from principal component analysis (PCA), and its non-linear (kernel) extensions, to more recent spectral embedding and support estimation methods, rely on estimating a linear subspace from…

Machine Learning · Statistics 2014-08-22 Alessandro Rudi , Guille D. Canas , Lorenzo Rosasco

Deep learning networks excel at classification, yet identifying minimal architectures that reliably solve a task remains challenging. We present a computational methodology for systematically exploring and analyzing the relationships among…

Machine Learning · Computer Science 2026-01-27 Ziwei Zheng , Huizhi Liang , Vaclav Snasel , Vito Latora , Panos Pardalos , Giuseppe Nicosia , Varun Ojha

The accurate modeling and control of nonlinear dynamical effects are crucial for numerous robotic systems. The Koopman formalism emerges as a valuable tool for linear control design in nonlinear systems within unknown environments. However,…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Daning Huang , Muhammad Bayu Prasetyo , Yin Yu , Junyi Geng

Foundation models and their checkpoints have significantly advanced deep learning, boosting performance across various applications. However, fine-tuned models often struggle outside their specific domains and exhibit considerable…

In this paper, we propose to estimate the invariant subspace across heterogeneous multiple networks using a novel bias-corrected joint spectral embedding algorithm. The proposed algorithm recursively calibrates the diagonal bias of the sum…

Statistics Theory · Mathematics 2024-06-13 Fangzheng Xie

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken

The discovery of linear embedding is the key to the synthesis of linear control techniques for nonlinear systems. In recent years, while Koopman operator theory has become a prominent approach for learning these linear embeddings through…

Robotics · Computer Science 2026-03-02 Rajpal Singh , Chandan Kumar Sah , Jishnu Keshavan

Visual AutoRegressive (VAR) models based on next-scale prediction enable efficient hierarchical generation, yet the inference cost grows quadratically at high resolutions. We observe that the computationally intensive later scales…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Keli Liu , Zhendong Wang , Wengang Zhou , Houqiang Li

The Koopman operator provides a linear framework to study nonlinear dynamical systems. Its spectra offer valuable insights into system dynamics, but the operator can exhibit both discrete and continuous spectra, complicating direct…

Dynamical Systems · Mathematics 2025-05-02 Jonghyeon Lee , Boumediene Hamzi , Boya Hou , Houman Owhadi , Gabriele Santin , Umesh Vaidya

This paper presents a methodology to achieve lower-dimensional Koopman quasi-linear representations of nonlinear system dynamics using Koopman generalized eigenfunctions. The proposed approach considers the analytically derived Koopman…

Systems and Control · Electrical Eng. & Systems 2025-10-28 Simone Martini , Margareta Stefanovic , Kimon P. Valavanis