English
Related papers

Related papers: Updating Singular Value Decomposition for Rank One…

200 papers

We present a new approach to calculating time eigenvalues of the neutron transport operator (also known as $\alpha$ eigenvalues) by extending the dynamic mode decomposition (DMD) to allow for non-uniform time steps. The new method, called…

Computational Physics · Physics 2022-08-24 Ethan Smith , Ilham Variansyah , Ryan McClarren

Computing eigenvalue decomposition (EVD) of a given linear operator, or finding its leading eigenvalues and eigenfunctions, is a fundamental task in many machine learning and scientific computing problems. For high-dimensional eigenvalue…

Machine Learning · Computer Science 2024-08-22 J. Jon Ryu , Xiangxiang Xu , H. S. Melihcan Erol , Yuheng Bu , Lizhong Zheng , Gregory W. Wornell

The hierarchical SVD provides a quasi-best low rank approximation of high dimensional data in the hierarchical Tucker framework. Similar to the SVD for matrices, it provides a fundamental but expensive tool for tensor computations. In the…

Numerical Analysis · Mathematics 2017-10-25 Benjamin Huber , Reinhold Schneider , Sebastian Wolf

Equations are presented which efficiently update or downdate the covariance matrix of a large number of $m$-dimensional observations. Updates and downdates to the covariance matrix, as well as mixed updates/downdates, are shown to be…

Numerical Analysis · Mathematics 2020-02-21 Don March , Vandy Tombs

In this letter, we propose a simple yet effective singular value decomposition (SVD) based strategy to reduce the optimization problem dimension in data-enabled predictive control (DeePC). Specifically, in the case of linear time-invariant…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Kaixiang Zhang , Yang Zheng , Chao Shang , Zhaojian Li

Advances in large language models have driven strong performance across many tasks, but their memory and compute costs still hinder deployment. SVD-based compression reduces storage and can speed up inference via low-rank factors, yet…

Machine Learning · Computer Science 2026-02-04 Ali Abbasi , Chayne Thrash , Haoran Qin , Shansita Sharma , Sepehr Seifi , Soheil Kolouri

In this work we consider generic losses of rank for complex valued matrix functions depending on two parameters. We give theoretical results that characterize parameter regions where these losses of rank occur. Our main results consist in…

Rings and Algebras · Mathematics 2025-09-01 Luca Dieci , Alessandro Pugliese

Simulations of large scale dynamical systems in multi-query or real-time contexts require efficient surrogate modelling techniques, as e.g. achieved via Model Order Reduction (MOR). Recently, symplectic methods like the complex singular…

Numerical Analysis · Mathematics 2023-03-08 Robin Herkert , Patrick Buchfink , Bernard Haasdonk , Johannes Rettberg , Jörg Fehr

Scale-resolving flow simulations often feature several million [thousand] spatial [temporal] discrete degrees of freedom. When storing or re-using these data, e.g., to subsequently train some sort of data-based surrogate or compute…

Fluid Dynamics · Physics 2024-07-26 Niklas Kühl

Variables in many massive high-dimensional data sets are structured, arising for example from measurements on a regular grid as in imaging and time series or from spatial-temporal measurements as in climate studies. Classical multivariate…

Methodology · Statistics 2012-03-14 Genevera I. Allen , Logan Grosenick , Jonathan Taylor

We address the problem of efficient sparse fixed-rank (S-FR) matrix decomposition, i.e., splitting a corrupted matrix $M$ into an uncorrupted matrix $L$ of rank $r$ and a sparse matrix of outliers $S$. Fixed-rank constraints are usually…

Computer Vision and Pattern Recognition · Computer Science 2015-03-26 German Ros , Julio Guerrero

Factorizing a large matrix into small matrices is a popular strategy for model compression. Singular value decomposition (SVD) plays a vital role in this compression strategy, approximating a learned matrix with fewer parameters. However,…

Machine Learning · Computer Science 2022-07-04 Yen-Chang Hsu , Ting Hua , Sungen Chang , Qian Lou , Yilin Shen , Hongxia Jin

Large language models (LLMs) have achieved remarkable success in natural language processing (NLP) tasks, yet their substantial memory requirements present significant challenges for deployment on resource-constrained devices. Singular…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Zhiteng Li , Mingyuan Xia , Jingyuan Zhang , Zheng Hui , Haotong Qin , Linghe Kong , Yulun Zhang , Xiaokang Yang

To analyze the abundance of multidimensional data, tensor-based frameworks have been developed. Traditionally, the matrix singular value decomposition (SVD) is used to extract the most dominant features from a matrix containing the…

Machine Learning · Computer Science 2021-11-02 Katherine Keegan , Tanvi Vishwanath , Yihua Xu

Classical data analysis requires computational efforts that become intractable in the age of Big Data. An essential task in time series analysis is the extraction of physically meaningful information from a noisy time series. One algorithm…

Singular value decompositions of matrices are widely used in numerical linear algebra with many applications. In this paper, we extend the notion of singular value decompositions to finite complexes of real vector spaces. We provide two…

With the enactment of privacy-preserving regulations, e.g., GDPR, federated SVD is proposed to enable SVD-based applications over different data sources without revealing the original data. However, many SVD-based applications cannot be…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-05 Di Chai , Leye Wang , Junxue Zhang , Liu Yang , Shuowei Cai , Kai Chen , Qiang Yang

Matrix completion is widely used in machine learning, engineering control, image processing, and recommendation systems. Currently, a popular algorithm for matrix completion is Singular Value Threshold (SVT). In this algorithm, the singular…

Information Retrieval · Computer Science 2019-12-05 Meng Qiao , Zheng Shan , Fudong Liu , Wenjie Sun

Dynamic Mode Decomposition (DMD) is a useful tool to effectively extract the dominant dynamic flow structure from a unsteady flow field. However, DMD requires massive computational resources with respect to memory consumption and the usage…

Fluid Dynamics · Physics 2017-04-03 Daiki Matsumoto , Thomas Indinger

BACKGROUND. Formal demography has a long history of building simple models of age schedules of demographic quantities, e.g. mortality and fertility rates. These are widely used in demographic methods to manipulate whole age schedules using…

Applications · Statistics 2015-04-09 Samuel J. Clark