English
Related papers

Related papers: Implicit Hari--Zimmermann algorithm for the genera…

200 papers

Singular value decomposition is widely used in modal analysis, such as proper orthogonal decomposition and resolvent analysis, to extract key features from complex problems. SVD derivatives need to be computed efficiently to enable the…

Numerical Analysis · Mathematics 2025-05-29 Rohit Kanchi , Sicheng He

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basic notion of SVD and…

Machine Learning · Computer Science 2015-10-30 Zhihua Zhang

Certified model reduction for high-dimensional nonlinear control systems remains challenging: unlike balanced truncation for LTI systems, most nonlinear reduction methods either lack computable worst-case error bounds or rely on intractable…

Optimization and Control · Mathematics 2026-04-07 Brian Brown , Michael King

We propose an efficient, distributed, out-of-memory implementation of the truncated singular value decomposition (t-SVD) for heterogeneous (CPU+GPU) high performance computing (HPC) systems. Various implementations of SVD have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Ismael Boureima , Manish Bhattarai , Maksim E. Eren , Nick Solovyev , Hristo Djidjev , Boian S. Alexandrov

Singular Value Decomposition (SVD) is one of the most useful techniques for analyzing data in linear algebra. SVD decomposes a rectangular real or complex matrix into two orthogonal matrices and one diagonal matrix. In this work we…

Quantum Physics · Physics 2012-07-31 Laszlo Gyongyosi , Sandor Imre

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

We present a new formulation of the hyperbolic singular value decomposition (HSVD) for an arbitrary complex (or real) matrix without hyperexchange matrices and redundant invariant parameters. In our formulation, we use only the concept of…

Numerical Analysis · Mathematics 2021-02-17 D. S. Shirokov

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD such as…

Mathematical Software · Computer Science 2020-09-03 Drew Schmidt

The singular value decomposition (SVD) of a matrix is a powerful tool for many matrix computation problems. In this paper, we consider generalizing the standard SVD to analyze and compute the regularized solution of linear ill-posed…

Numerical Analysis · Mathematics 2023-12-19 Haibo Li

With the abundance of data in recent years, interesting challenges are posed in the area of recommender systems. Producing high quality recommendations with scalability and performance is the need of the hour. Singular Value…

Machine Learning · Computer Science 2019-07-19 Prasad Bhavana , Vikas Kumar , Vineet Padmanabhan

Higher order singular value decomposition (HOSVD) is an important tool for analyzing big data in multilinear algebra and machine learning. In this paper, we present two quantum algorithms for HOSVD. Our methods allow one to decompose a…

Quantum Physics · Physics 2020-04-07 Lejia Gu , Xiaoqiang Wang , H. W. Joseph Lee , Guofeng Zhang

We propose a contour integral-based algorithm for computing a few singular values of a matrix or a few generalized singular values of a matrix pair. Mathematically, the generalized singular values of a matrix pair are the eigenvalues of an…

Numerical Analysis · Mathematics 2026-03-10 Yuqi Liu , Xinyu Shan , Meiyue Shao

An efficient Singular Value Decomposition (SVD) algorithm is an important tool for distributed and streaming computation in big data problems. It is observed that update of singular vectors of a rank-1 perturbed matrix is similar to a…

Machine Learning · Computer Science 2017-07-27 Ratnik Gandhi , Amoli Rajgor

High fidelity scientific simulations modeling physical phenomena typically require solving large linear systems of equations which result from discretization of a partial differential equation (PDE) by some numerical method. This step often…

Mathematical Software · Computer Science 2020-07-01 Mohammad Shafaet Islam , Qiqi Wang

Building on the abstract Generalized Singular Value Decomposition (GSVD) theory of Brown et al. [2025], we prove that most modern neural architectures admit a generalized SVD representation in which they are left-invertible before a final…

Machine Learning · Computer Science 2026-05-11 Brian Charles Brown , Robert Bridges , David Grimsman , Mauricio Munoz , Sean Warnick

This paper aims to develop a simple procedure to reduce and control the condition number of random matrices, and investigate the effect on the persistent homology (PH) of point clouds of well- and ill-conditioned matrices. For a square…

Algebraic Topology · Mathematics 2023-02-23 Jehan Ghafuri , Sabah Jassim

Three refined and refined harmonic extraction-based Jacobi--Davidson (JD) type methods are proposed, and their thick-restart algorithms with deflation and purgation are developed to compute several generalized singular value decomposition…

Numerical Analysis · Mathematics 2026-05-14 Jinzhi Huang , Zhongxiao Jia

We propose a new fast streaming algorithm for the tensor completion problem of imputing missing entries of a low-tubal-rank tensor using the tensor singular value decomposition (t-SVD) algebraic framework. We show the t-SVD is a…

Signal Processing · Electrical Eng. & Systems 2022-04-18 Kyle Gilman , Davoud Ataee Tarzanagh , Laura Balzano

We propose a mixed precision Jacobi algorithm for computing the singular value decomposition (SVD) of a dense matrix. After appropriate preconditioning, the proposed algorithm computes the SVD in a lower precision as an initial guess, and…

Numerical Analysis · Mathematics 2025-05-12 Weiguo Gao , Yuxin Ma , Meiyue Shao