English
Related papers

Related papers: High-Performance Out-of-core Block Randomized Sing…

200 papers

The generalized singular value decomposition (GSVD) is a valuable tool that has many applications in computational science. However, computing the GSVD for large-scale problems is challenging. Motivated by applications in hyper-differential…

Numerical Analysis · Mathematics 2020-02-10 Arvind K. Saibaba , Joseph Hart , Bart van Bloemen Waanders

This thesis gives an overview of the state-of-the-art randomized linear algebra algorithms for singular value decomposition (SVD), including the presentation of existing pseudo-codes and theoretical error analysis. Our main focus is on…

Optimization and Control · Mathematics 2024-02-29 Xiaowen Li

The singular value decomposition (SVD) allows to write a matrix as a product of a left singular vectors matrix, a nonnegative singular values diagonal matrix and a right singular vectors matrix. Among the applications of the SVD are the…

Numerical Analysis · Mathematics 2025-12-09 Doulaye Dembele

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

Machine Learning · Computer Science 2015-08-03 Ohad Shamir

Singular value decomposition (SVD) is a widely used technique for dimensionality reduction and computation of basis vectors. In many applications, especially in fluid mechanics and image processing the matrices are dense, but low-rank…

Numerical Analysis · Computer Science 2019-05-13 Vinita Vasudevan , M. Ramakrishna

Singular value decomposition (SVD) is the mathematical basis of principal component analysis (PCA). Together, SVD and PCA are one of the most widely used mathematical formalism/decomposition in machine learning, data mining, pattern…

Machine Learning · Computer Science 2018-04-17 Shuai Zheng , Chris Ding , Feiping Nie

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

Singular value decomposition (SVD) is widely used for dimensionality reduction and noise suppression, and it plays a pivotal role in numerous scientific and engineering applications. As the dimensions of the matrix grow rapidly, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Fangqiang Du , Sixuan Chong , Zixuan Huang , Rui Qin , Fengnan Mi , Caibao Hu , Jiangang Chen

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

In this paper a vectorized algorithm for simultaneously computing up to eight singular value decompositions (SVDs, each of the form $A=U\Sigma V^{\ast}$) of real or complex matrices of order two is proposed. The algorithm extends to a batch…

Mathematical Software · Computer Science 2021-01-08 Vedran Novaković

This work develops a parallelized algorithm to compute the dynamic mode decomposition (DMD) on a graphics processing unit using the streaming method of snapshots singular value decomposition. This allows the algorithm to operate efficiently…

Numerical Analysis · Mathematics 2016-12-26 Seth D. Pendergrass , J. Nathan Kutz , Steven L. Brunton

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat

This paper presents a portable, GPU-accelerated implementation of a QR-based singular value computation algorithm in Julia. The singular value ecomposition (SVD) is a fundamental numerical tool in scientific computing and machine learning,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Evelyne Ringoot , Rabab Alomairy , Valentin Churavy , Alan Edelman

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey

Singular Value Decomposition (SVD) is one of the most useful techniques for analyzing data in linear algebra. SVD decomposes a rectangular real or complex matrix into two orthogonal matrices and one diagonal matrix. In this work we…

Quantum Physics · Physics 2012-07-31 Laszlo Gyongyosi , Sandor Imre

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

Classical data analysis requires computational efforts that become intractable in the age of Big Data. An essential task in time series analysis is the extraction of physically meaningful information from a noisy time series. One algorithm…

This article presents svds-C, an open-source and high-performance C program for accurately and robustly computing truncated SVD, e.g. computing several largest singular values and corresponding singular vectors. We have re-implemented the…

Mathematical Software · Computer Science 2024-05-30 Xu Feng , Wenjian Yu , Yuyang Xie

Big data analysis has become a crucial part of new emerging technologies such as the internet of things, cyber-physical analysis, deep learning, anomaly detection, etc. Among many other techniques, dimensionality reduction plays a key role…

Singular Value Decomposition (SVD) is a powerful tool in linear algebra.We propose an extension of SVD for both the qualitative detection and quantitative determination of nonlinearity in a time series. The paper illustrates nonlinear SVD…

Chaotic Dynamics · Physics 2009-02-11 Prabhakar G. Vaidya , Sajini Anand P. S , Nithin Nagaraj