English
Related papers

Related papers: A Unified Algebraic Framework for Subspace Pruning…

200 papers

Weight pruning is an effective model compression technique to tackle the challenges of achieving real-time deep neural network (DNN) inference on mobile devices. However, prior pruning schemes have limited application scenarios due to…

Machine Learning · Computer Science 2022-03-29 Yifan Gong , Geng Yuan , Zheng Zhan , Wei Niu , Zhengang Li , Pu Zhao , Yuxuan Cai , Sijia Liu , Bin Ren , Xue Lin , Xulong Tang , Yanzhi Wang

The present paper treats the identification of nonlinear dynamical systems using Koopman-based deep state-space encoders. Through this method, the usual drawback of needing to choose a dictionary of lifting functions a priori is…

Systems and Control · Electrical Eng. & Systems 2022-06-16 Lucian Cristian Iacob , Gerben Izaak Beintema , Maarten Schoukens , Roland Tóth

We exploit the key idea that nonlinear system identification is equivalent to linear identification of the socalled Koopman operator. Instead of considering nonlinear system identification in the state space, we obtain a novel linear…

Systems and Control · Computer Science 2016-08-30 Alexandre Mauroy , Jorge Goncalves

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

Estimation of parameters is a crucial part of model development. When models are deterministic, one can minimise the fitting error; for stochastic systems one must be more careful. Broadly parameterisation methods for stochastic dynamical…

Statistics Theory · Mathematics 2018-04-12 Asbjørn N. Riseth , Jake P. Taylor-King

A high order optimal control strategy implemented in the Koopman operator framework is proposed in this work. The new technique exploits the Koopman representation of the solution of the equations of motion to develop an energy optimal…

Optimization and Control · Mathematics 2022-07-15 Simone Servadio , Roberto Armellin , Richard Linares

This paper proposes a unified family of learnable Koopman operator parameterizations that integrate linear dynamical systems theory with modern deep learning forecasting architectures. We introduce four learnable Koopman…

Machine Learning · Computer Science 2026-03-16 Ali Forootani , Raffaele Iervolino

The Koopman operator provides a linear perspective on non-linear dynamics by focusing on the evolution of observables in an invariant subspace. Observables of interest are typically linearly reconstructed from the Koopman eigenfunctions.…

Dynamical Systems · Mathematics 2024-03-06 Shaowu Pan , Karthik Duraisamy

A promising technique for the spectral design of acoustic metamaterials is based on the formulation of suitable constrained nonlinear optimization problems. Unfortunately, the straightforward application of classical gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2021-12-08 Giorgio Gnecco , Andrea Bacigalupo , Francesca Fantoni , Daniela Selvi

We propose a conjugate gradient type optimization technique for the computation of the Karcher mean on the set of complex linear subspaces of fixed dimension, modeled by the so-called Grassmannian. The identification of the Grassmannian…

Differential Geometry · Mathematics 2012-09-17 Knut Hüper , Martin Kleinsteuber , Hao Shen

In this paper we prove new connections between two frameworks for analysis and control of nonlinear systems: the Koopman operator framework and contraction analysis. Each method, in different ways, provides exact and global analyses of…

Systems and Control · Electrical Eng. & Systems 2023-09-22 Bowen Yi , Ian R. Manchester

This paper considers a nonlinear dynamical system on a complex, finite dimensional Banach space which has an asymptotically stable, hyperbolic fixed point. We investigate the connection between the so-called principle eigenfunctions of the…

Dynamical Systems · Mathematics 2016-11-07 Ryan Mohr , Igor Mezić

This paper proposes a new deterministic sampling strategy for constructing polynomial chaos approximations for expensive physics simulation models. The proposed approach, effectively subsampled quadratures involves sparsely subsampling an…

Numerical Analysis · Mathematics 2017-05-03 Pranay Seshadri , Akil Narayan , Sankaran Mahadevan

The decomposition or approximation of a linear operator on a matrix space as a sum of Kronecker products plays an important role in matrix equations and low-rank modeling. The approximation problem in Frobenius norm admits a well-known…

Optimization and Control · Mathematics 2023-12-08 Mareike Dressler , André Uschmajew , Venkat Chandrasekaran

In this paper, we systematically derive a finite set of Koopman based observables to construct a lifted linear state space model that describes the rigid body dynamics based on the dual quaternion representation. In general, the Koopman…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Vrushabh Zinage , Efstathios Bakolas

Identifying coordinate transformations that make strongly nonlinear dynamics approximately linear is a central challenge in modern dynamical systems. These transformations have the potential to enable prediction, estimation, and control of…

Dynamical Systems · Mathematics 2019-03-06 Bethany Lusch , J. Nathan Kutz , Steven L. Brunton

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

Existing methods of pruning deep neural networks focus on removing unnecessary parameters of the trained network and fine tuning the model afterwards to find a good solution that recovers the initial performance of the trained model. Unlike…

Machine Learning · Computer Science 2021-11-17 Abdolghani Ebrahimi , Diego Klabjan

This paper presents a general coding method where data in a Hilbert space are represented by finite dimensional coding vectors. The method is based on empirical risk minimization within a certain class of linear operators, which map the set…

Machine Learning · Statistics 2011-09-05 Andreas Maurer Massimiliano Pontil

Product quantization-based approaches are effective to encode high-dimensional data points for approximate nearest neighbor search. The space is decomposed into a Cartesian product of low-dimensional subspaces, each of which generates a sub…

Computer Vision and Pattern Recognition · Computer Science 2014-05-19 Jianfeng Wang , Jingdong Wang , Jingkuan Song , Xin-Shun Xu , Heng Tao Shen , Shipeng Li