English
Related papers

Related papers: Highly Parallel Singular Value Decomposition for L…

200 papers

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat

Convergence of a matrix decomposition technique, the multi-field singular value decomposition (MFSVD) which efficiently analyzes nonlinear correlations by simultaneously decomposing multiple fields, is investigated. Toward applications in…

Fluid Dynamics · Physics 2024-11-08 Go Yatomi , Motoki Nakata

Signal decomposition (SD) approaches aim to decompose non-stationary signals into their constituent amplitude- and frequency-modulated components. This represents an important preprocessing step in many practical signal processing…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Thomas Eriksen , Naveed ur Rehman

This paper presents a new method capable of reconstructing datasets with great precision and very low computational cost using a novel variant of the singular value decomposition (SVD) algorithm that has been named low-cost SVD (lcSVD).…

Computational Engineering, Finance, and Science · Computer Science 2023-11-20 Ashton Hetherington , Soledad Le Clainche

Multiple-input multiple-output (MIMO) or multi-antenna communication is a key technique to achieve high spectral efficiency in wireless systems. For the point-to-point MIMO channel, it is a well-known result that the channel singular value…

Information Theory · Computer Science 2016-11-17 Liang Liu , Rui Zhang

Singular Value Decomposition (SVD) has recently emerged as a new paradigm for processing different types of images. SVD is an attractive algebraic transform for image processing applications. The paper proposes an experimental survey for…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Rowayda A. Sadek

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

We address the reduction to compact band forms, via unitary similarity transformations, for the solution of symmetric eigenvalue problems and the computation of the singular value decomposition (SVD). Concretely, in the first case we…

Mathematical Software · Computer Science 2017-11-07 Rafael Rodríguez-Sánchez , Sandra Catalán , José R. Herrero , Enrique S. Quintana-Ortí , Andrés E. Tomás

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey

Singular Value Decomposition (SVD) has recently seen a surge of interest as a simple yet powerful tool for large language models (LLMs) compression, with a growing number of works demonstrating 20-80% parameter reductions at minimal…

Machine Learning · Computer Science 2025-08-05 Zishan Shao , Yixiao Wang , Qinsi Wang , Ting Jiang , Zhixu Du , Hancheng Ye , Danyang Zhuo , Yiran Chen , Hai Li

This work presents an analysis of Higher Order Singular Value Decomposition (HO-SVD) applied to lossy compression of 3D mesh animations. We describe strategies for choosing a number of preserved spatial and temporal components after tensor…

Graphics · Computer Science 2013-10-07 Michał Romaszewski , Piotr Gawron , Sebastian Opozda

We present a simple yet novel parameterized form of linear mapping to achieves remarkable network compression performance: a pseudo SVD called Ternary SVD (TSVD). Unlike vanilla SVD, TSVD limits the $U$ and $V$ matrices in SVD to ternary…

Machine Learning · Computer Science 2023-08-16 Boyu Chen , Hanxuan Chen , Jiao He , Fengyu Sun , Shangling Jui

This paper presents a self-contained factorization for the delay Vandermonde matrix (DVM), which is the super class of the discrete Fourier transform, using sparse and companion matrices. An efficient DVM algorithm is proposed to reduce the…

Signal Processing · Electrical Eng. & Systems 2022-06-03 S. M. Perera , A. Madanayake , R. J. Cintra

We propose a mixed precision Jacobi algorithm for computing the singular value decomposition (SVD) of a dense matrix. After appropriate preconditioning, the proposed algorithm computes the SVD in a lower precision as an initial guess, and…

Numerical Analysis · Mathematics 2025-05-12 Weiguo Gao , Yuxin Ma , Meiyue Shao

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique…

Numerical Analysis · Mathematics 2020-11-23 Charumathi V , M. Ramakrishna , Vinita Vasudevan

In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique…

Numerical Analysis · Computer Science 2021-07-07 V. Charumathi , M. Ramakrishna , Vinita Vasudevan

This article presents svds-C, an open-source and high-performance C program for accurately and robustly computing truncated SVD, e.g. computing several largest singular values and corresponding singular vectors. We have re-implemented the…

Mathematical Software · Computer Science 2024-05-30 Xu Feng , Wenjian Yu , Yuyang Xie

In this paper, we propose a novel transmission scheme, called sparse layered MIMO (SL-MIMO), that combines non-orthogonal transmission and singular value decomposition (SVD) precoding. Nonorthogonality in SL-MIMO allows re-using of the…

Information Theory · Computer Science 2022-08-15 Mohamad H. Dinan , Nemanja Stefan Perovic , Mark F. Flanagan

Vision-Language Models (VLMs) are integral to tasks such as image captioning and visual question answering, but their high computational cost, driven by large memory footprints and processing time, limits their scalability and real-time…

Machine Learning · Computer Science 2025-10-21 Yutong Wang , Haiyu Wang , Sai Qian Zhang