English
Related papers

Related papers: A Preconditioned Hybrid SVD Method for Computing A…

200 papers

Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power…

Mathematical Software · Computer Science 2024-04-16 Xu Feng , Wenjian Yu , Yuyang Xie , Jie Tang

This paper introduces a preconditioned method designed to comprehensively address the saddle point system with the aim of improving convergence efficiency. In the preprocessor construction phase, a technical approach for solving the…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

The cross-product matrix-based CJ-FEAST SVDsolver proposed previously by the authors is shown to compute the left singular vector possibly much less accurately than the right singular vector and may be numerically backward unstable when a…

Numerical Analysis · Mathematics 2024-04-22 Zhongxiao Jia , Kailiang Zhang

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

Large pre-trained models (LPMs) have demonstrated exceptional performance in diverse natural language processing and computer vision tasks. However, fully fine-tuning these models poses substantial memory challenges, particularly in…

Machine Learning · Computer Science 2024-09-12 Chengwei Sun , Jiwei Wei , Yujia Wu , Yiming Shi , Shiyuan He , Zeyu Ma , Ning Xie , Yang Yang

Large collections of matrices arise throughout modern machine learning, signal processing, and scientific computing, where they are commonly compressed by concatenation followed by truncated singular value decomposition (SVD). This strategy…

Numerical Analysis · Mathematics 2026-01-21 Maksym Shamrai

A new algorithm to compute the restricted singular value decomposition of dense matrices is presented. Like Zha's method \cite{Zha92}, the new algorithm uses an implicit Kogbetliantz iteration, but with four major innovations. The first…

Numerical Analysis · Mathematics 2020-02-13 Ian N. Zwaan

In this paper, we present a class of high order methods to approximate the singular value decomposition of a given complex matrix (SVD). To the best of our knowledge, only methods up to order three appear in the the literature. A first part…

Numerical Analysis · Mathematics 2023-09-13 Diego Armentano , Jean-Claude Yakoubsohn

As integrated circuits become increasingly complex, the demand for efficient and accurate simulation solvers continues to rise. Traditional solvers often struggle with large-scale sparse systems, leading to prolonged simulation times and…

Numerical Analysis · Mathematics 2025-09-12 Zijian Zhang , Rui Hong , Xuesong Chen , Shuting Cai

In this paper we propose a new iterative method to hierarchically compute a relatively large number of leftmost eigenpairs of a sparse symmetric positive matrix under the multiresolution operator compression framework. We exploit the…

Numerical Analysis · Mathematics 2018-06-28 Thomas Y. Hou , De Huang , Ka Chun Lam , Ziyun Zhang

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice speed for…

Machine Learning · Statistics 2024-02-16 Sangil Han , Kyoowon Kim , Sungkyu Jung

We describe preconditioned iterative methods for estimating the number of eigenvalues of a Hermitian matrix within a given interval. Such estimation is useful in a number of applications.In particular, it can be used to develop an efficient…

Numerical Analysis · Mathematics 2016-02-09 Eugene Vecharynski , Chao Yang

This paper introduces a novel Transformed Primal-Dual with variable-metric/preconditioner (TPDv) algorithm, designed to efficiently solve affine constrained optimization problems common in nonlinear partial differential equations (PDEs).…

Numerical Analysis · Mathematics 2023-12-20 Long Chen , Ruchi Guo , Jingrong Wei

This paper offers a review of numerical methods for computation of the eigenvalues of Hermitian matrices and the singular values of general and some classes of structured matrices. The focus is on the main principles behind the methods that…

Numerical Analysis · Mathematics 2020-06-05 Zlatko Drmač

The spectral transformation Lanczos method for the sparse symmetric definite generalized eigenvalue problem for matrices $A$ and $B$ is an iterative method that addresses the case of semidefinite or ill conditioned $B$ using a shifted and…

Numerical Analysis · Mathematics 2024-11-07 Michael Stewart

The joint bidiagonalization (JBD) method has been used to compute some extreme generalized singular values and vectors of a large regular matrix pair $\{A,L\}$, where we propose three approaches to compute approximate generalized singular…

Numerical Analysis · Mathematics 2023-09-19 Zhongxiao Jia , Haibo Li

Singular value decomposition (SVD) and matrix inversion are ubiquitous in scientific computing. Both tasks are computationally demanding for large scale matrices. Existing algorithms can approximatively solve these problems with a given…

Numerical Analysis · Mathematics 2026-01-28 Weiwei Xu , Weijie Shen , Zhengjian Bai , Chen Xu

This paper presents an efficient Krylov subspace iterative solver for the three-dimensional (3D) Helmholtz equation with non-constant coefficients and absorbing boundary conditions, combining high-resolution compact schemes with low-order…

Numerical Analysis · Mathematics 2026-02-10 Yury Gryazin , Ron Gonzales , Xiaoye Sherry Li

In this paper, we analyze different preconditionings designed to enhance robustness of pure-pixel search algorithms, which are used for blind hyperspectral unmixing and which are equivalent to near-separable nonnegative matrix factorization…

Machine Learning · Statistics 2015-05-29 Nicolas Gillis , Wing-Kin Ma

The Randomized Singular Value Decomposition (RSVD) is a widely used algorithm for efficiently computing low-rank approximations of large matrices, without the need to construct a full-blown SVD. Of interest, of course, is the approximation…

Numerical Analysis · Mathematics 2025-10-09 Danil Akhtiamov , Reza Ghane , Babak Hassibi