English
Related papers

Related papers: A GPU-based hyperbolic SVD algorithm

200 papers

We present a hierarchically blocked one-sided Jacobi algorithm for the singular value decomposition (SVD), targeting both single and multiple graphics processing units (GPUs). The blocking structure reflects the levels of GPU's memory…

Numerical Analysis · Computer Science 2015-02-05 Vedran Novaković

The singular value decomposition (SVD) is a powerful tool in modern numerical linear algebra, which underpins computational methods such as principal component analysis (PCA), low-rank approximations, and randomized algorithms. Many…

Mathematical Software · Computer Science 2026-04-10 Ahmad Abdelfattah , Massimiliano Fasi

Fast computation of singular value decomposition (SVD) is of great interest in various machine learning tasks. Recently, SVD methods based on randomized linear algebra have shown significant speedup in this regime. This paper attempts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Yuechao Lu , Fumihiko Ino , Yasuyuki Matsushita

In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits…

Numerical Analysis · Mathematics 2022-05-10 Vedran Novaković , Sanja Singer

We describe two main classes of one-sided trigonometric and hyperbolic Jacobi-type algorithms for computing eigenvalues and eigenvectors of Hermitian matrices. These types of algorithms exhibit significant advantages over many other…

Numerical Analysis · Computer Science 2020-03-18 Sanja Singer , Sasa Singer , Vedran Novakovic , Aleksandar Uscumlic , Vedran Dunjko

The paper describes several efficient parallel implementations of the one-sided hyperbolic Jacobi-type algorithm for computing eigenvalues and eigenvectors of Hermitian matrices. By appropriate blocking of the algorithms an almost ideal…

Numerical Analysis · Computer Science 2020-03-18 Sanja Singer , Sasa Singer , Vedran Novakovic , Davor Davidovic , Kresimir Bokulic , Aleksandar Uscumlic

Singular Value Decomposition (SVD) is a fundamental matrix factorization technique in linear algebra, widely applied in numerous matrix-related problems. However, traditional SVD approaches are hindered by slow panel factorization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-18 Shifang Liu , Huiyuan Li , Hongjiao Sheng , Haoyuan Gui , Xiaoyu Zhang

Singular value decomposition (SVD) is widely used for dimensionality reduction and noise suppression, and it plays a pivotal role in numerous scientific and engineering applications. As the dimensions of the matrix grow rapidly, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Fangqiang Du , Sixuan Chong , Zixuan Huang , Rui Qin , Fengnan Mi , Caibao Hu , Jiangang Chen

A parallel, blocked, one-sided Hari--Zimmermann algorithm for the generalized singular value decomposition (GSVD) of a real or a complex matrix pair $(F,G)$ is here proposed, where $F$ and $G$ have the same number of columns, and are both…

Numerical Analysis · Mathematics 2021-02-18 Vedran Novaković , Sanja Singer

The eigenvalue decomposition (EVD) of (a batch of) Hermitian matrices of order two has a role in many numerical algorithms, of which the one-sided Jacobi method for the singular value decomposition (SVD) is the prime example. In this paper…

Numerical Analysis · Mathematics 2023-10-31 Vedran Novaković

We present high performance implementations of the QR and the singular value decomposition of a batch of small matrices hosted on the GPU with applications in the compression of hierarchical matrices. The one-sided Jacobi algorithm is used…

Mathematical Software · Computer Science 2017-07-18 Wajih Halim Boukaram , George Turkiyyah , Hatem Ltaief , David E. Keyes

We present a new formulation of the hyperbolic singular value decomposition (HSVD) for an arbitrary complex (or real) matrix without hyperexchange matrices and redundant invariant parameters. In our formulation, we use only the concept of…

Numerical Analysis · Mathematics 2021-02-17 D. S. Shirokov

We propose a mixed precision Jacobi algorithm for computing the singular value decomposition (SVD) of a dense matrix. After appropriate preconditioning, the proposed algorithm computes the SVD in a lower precision as an initial guess, and…

Numerical Analysis · Mathematics 2025-05-12 Weiguo Gao , Yuxin Ma , Meiyue Shao

The adoption of hybrid GPU-CPU nodes in traditional supercomputing platforms opens acceleration opportunities for electronic structure calculations in materials science and chemistry applications, where medium sized Hermitian generalized…

Numerical Analysis · Computer Science 2012-07-10 Raffaele Solcà , Thomas C. Schulthess , Azzam Haidar , Stanimire Tomov , Ichitaro Yamazaki , Jack Dongarra

In this work, we present a mixed precision algorithm that leverages the Gram matrix and Jacobi methods to compute the singular value decomposition (SVD) of tall-and-skinny matrices. By constructing the Gram matrix in higher precision and…

Numerical Analysis · Mathematics 2026-03-13 Erin Carson , Yuxin Ma , Meiyue Shao

This paper considers the hyperparameter optimization problem of mathematical techniques that arise in the numerical solution of differential and integral equations. The well-known approaches grid and random search, in a parallel algorithm…

Numerical Analysis · Mathematics 2023-04-28 Alireza Afzal Aghaei , Kourosh Parand

The randomized singular value decomposition (SVD) is a popular and effective algorithm for computing a near-best rank $k$ approximation of a matrix $A$ using matrix-vector products with standard Gaussian vectors. Here, we generalize the…

Numerical Analysis · Mathematics 2022-01-24 Nicolas Boullé , Alex Townsend

In this paper we propose an accurate, highly parallel algorithm for the generalized eigendecomposition of a matrix pair $(H, S)$, given in a factored form $(F^{\ast} J F, G^{\ast} G)$. Matrices $H$ and $S$ are generally complex and…

Numerical Analysis · Mathematics 2020-09-22 Sanja Singer , Edoardo Di Napoli , Vedran Novaković , Gayatri Čaklović

This paper presents a portable, GPU-accelerated implementation of a QR-based singular value computation algorithm in Julia. The singular value ecomposition (SVD) is a fundamental numerical tool in scientific computing and machine learning,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Evelyne Ringoot , Rabab Alomairy , Valentin Churavy , Alan Edelman

Benefiting from the advancement of hardware accelerators such as GPUs, deep neural networks and scientific computing applications can achieve superior performance. Recently, the computing capacity of emerging hardware accelerators has…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-04 Hansheng Wang , Lu Shi , Zhekai duan , Panruo Wu , Liwei Guo , Shaoshuai Zhang
‹ Prev 1 2 3 10 Next ›