English
Related papers

Related papers: An Efficient Batch Solver for the Singular Value D…

200 papers

Various Neural Networks employ time-consuming matrix operations like matrix inversion. Many such matrix operations are faster to compute given the Singular Value Decomposition (SVD). Previous work allows using the SVD in Neural Networks…

Machine Learning · Computer Science 2020-09-30 Alexander Mathiasen , Frederik Hvilshøj , Jakob Rødsgaard Jørgensen , Anshul Nasery , Davide Mottin

The traditional method of computing singular value decomposition (SVD) of a data matrix is based on a least squares principle, thus, is very sensitive to the presence of outliers. Hence the resulting inferences across different applications…

Statistics Theory · Mathematics 2024-09-17 Subhrajyoty Roy , Abhik Ghosh , Ayanendranath Basu

Singular Value Decomposition (SVD) has recently emerged as a new paradigm for processing different types of images. SVD is an attractive algebraic transform for image processing applications. The paper proposes an experimental survey for…

Computer Vision and Pattern Recognition · Computer Science 2012-12-03 Rowayda A. Sadek

The generalized singular value decomposition (GSVD) is a valuable tool that has many applications in computational science. However, computing the GSVD for large-scale problems is challenging. Motivated by applications in hyper-differential…

Numerical Analysis · Mathematics 2020-02-10 Arvind K. Saibaba , Joseph Hart , Bart van Bloemen Waanders

This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This…

Numerical Analysis · Mathematics 2026-02-11 Zhipeng Chang , Wenrui Hao , Nian Liu

In this paper, we present a class of high order methods to approximate the singular value decomposition of a given complex matrix (SVD). To the best of our knowledge, only methods up to order three appear in the the literature. A first part…

Numerical Analysis · Mathematics 2023-09-13 Diego Armentano , Jean-Claude Yakoubsohn

Sparsity regularization has garnered significant interest across multiple disciplines, including statistics, imaging, and signal processing. Standard techniques for addressing sparsity regularization include iterative soft thresholding…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

Variables in many massive high-dimensional data sets are structured, arising for example from measurements on a regular grid as in imaging and time series or from spatial-temporal measurements as in climate studies. Classical multivariate…

Methodology · Statistics 2012-03-14 Genevera I. Allen , Logan Grosenick , Jonathan Taylor

Singular value decomposition is central to many problems in engineering and scientific fields. Several quantum algorithms have been proposed to determine the singular values and their associated singular vectors of a given matrix. Although…

Quantum Physics · Physics 2021-06-30 Xin Wang , Zhixin Song , Youle Wang

The singular value decomposition (SVD) is a popular matrix factorization that has been used widely in applications ever since an efficient algorithm for its computation was developed in the 1970s. In recent years, the SVD has become even…

Numerical Analysis · Mathematics 2012-03-13 Carla D. Martin , Mason A. Porter

Recently, graphics processors (GPUs) have been increasingly leveraged in a variety of scientific computing applications. However, architectural differences between CPUs and GPUs necessitate the development of algorithms that take advantage…

Mathematical Software · Computer Science 2015-01-05 Jonathan Wong , Ellen Kuhl , Eric Darve

In signal processing and identification, generalized singular value decomposition (GSVD), related to a sequence of matrices in product/quotient form are essential numerical linear algebra tools. On behalf of the growing demand for efficient…

Numerical Analysis · Mathematics 2025-11-13 Sitao Ling , Wenxuan Ma , Musheng Wei

The singular value decomposition (SVD) of a matrix is a powerful tool for many matrix computation problems. In this paper, we consider generalizing the standard SVD to analyze and compute the regularized solution of linear ill-posed…

Numerical Analysis · Mathematics 2023-12-19 Haibo Li

A novel and scalable geometric multi-level algorithm is presented for the numerical solution of elliptic partial differential equations, specially designed to run with high occupancy of streaming processors inside Graphics Processing…

Mathematical Software · Computer Science 2017-03-22 J. T. Becerra-Sagredo , F. Mandujano , C. Malaga

In this paper, we show that the SVD of a matrix can be constructed efficiently in a hierarchical approach. Our algorithm is proven to recover the singular values and left singular vectors if the rank of the input matrix $A$ is known.…

Numerical Analysis · Mathematics 2017-01-09 M. A. Iwen , B. W. Ong

Singular value decomposition (SVD) and matrix inversion are ubiquitous in scientific computing. Both tasks are computationally demanding for large scale matrices. Existing algorithms can approximatively solve these problems with a given…

Numerical Analysis · Mathematics 2026-01-28 Weiwei Xu , Weijie Shen , Zhengjian Bai , Chen Xu

Dynamic programming (DP) is a cornerstone of combinatorial optimization, yet its inherently sequential structure has long limited its scalability in scenario-based stochastic programming (SP). This paper introduces a GPU-accelerated…

Optimization and Control · Mathematics 2025-11-25 Jingyi Zhao , Linxin Yang , Haohua Zhang , Tian Ding

A major bottleneck in scenario-based Sample Average Approximation (SAA) for stochastic programming (SP) is the cost of solving an exact second-stage problem for every scenario, especially when each scenario contains an NP-hard combinatorial…

Optimization and Control · Mathematics 2026-05-12 Jingyi Zhao , Linxin Yang , Haohua Zhang , Qile He , Tian Ding

While transfer learning is an effective strategy, it often overlooks the opportunity to leverage knowledge from numerous available models online. Addressing this multi-source transfer learning problem is a promising path to boost…

Machine Learning · Computer Science 2026-04-24 Marcin Osial , Bartosz Wójcik , Bartosz Zieliński , Sebastian Cygert

This paper discusses clustering and latent semantic indexing (LSI) aspects of the singular value decomposition (SVD). The purpose of this paper is twofold. The first is to give an explanation on how and why the singular vectors can be used…

Machine Learning · Computer Science 2012-11-19 Andri Mirzal