English
Related papers

Related papers: Randomized Algorithms for Solving Singular Value D…

200 papers

Higher-order tensor decompositions are analogous to the familiar Singular Value Decomposition (SVD), but they transcend the limitations of matrices (second-order tensors). SVD is a powerful tool that has achieved impressive results in…

Machine Learning · Computer Science 2007-11-14 Peter D. Turney

We propose a new algorithm for the computation of a singular value decomposition (SVD) low-rank approximation of a matrix in the Matrix Product Operator (MPO) format, also called the Tensor Train Matrix format. Our tensor network randomized…

Numerical Analysis · Mathematics 2017-07-26 Kim Batselier , Wenjian Yu , Luca Daniel , Ngai Wong

This survey explores modern approaches for computing low-rank approximations of high-dimensional matrices by means of the randomized SVD, randomized subspace iteration, and randomized block Krylov iteration. The paper compares the…

Numerical Analysis · Mathematics 2023-09-25 Joel A. Tropp , Robert J. Webber

The generalized singular value decomposition (GSVD) of a matrix pair $\{A, L\}$ with $A\in\mathbb{R}^{m\times n}$ and $L\in\mathbb{R}^{p\times n}$ generalizes the singular value decomposition (SVD) of a single matrix. In this paper, we…

Numerical Analysis · Mathematics 2024-04-02 Haibo Li

In this paper, we describe a new hybrid algorithm for computing all singular triplets above a given threshold and provide its implementation in MATLAB/Octave and R. The high performance of our codes and ease at which they can be used,…

Numerical Analysis · Mathematics 2024-08-05 James Baglama , Jonathan A. Chávez Casillas , Vasilije Perović

We apply the truncated singular value decomposition (SVD) to extract the underlying 2D correlation functions from small-angle scattering patterns. We test the approach by transforming the simulated data of ellipsoidal particles and show…

Data Analysis, Statistics and Probability · Physics 2019-09-11 Philipp Bender , Dominika Zákutná , Sabrina Disch , Lourdes Marcano , Diego Alba Venero , Dirk Honecker

This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented…

Numerical Analysis · Mathematics 2021-10-18 Ugochukwu O. Ugwu , Lothar Reichel

Affine rank minimization problem is the generalized version of low rank matrix completion problem where linear combinations of the entries of a low rank matrix are observed and the matrix is estimated from these measurements. We propose a…

Machine Learning · Computer Science 2021-05-17 Siva Shanmugam , Sheetal Kalyani

A new algorithm to compute the restricted singular value decomposition of dense matrices is presented. Like Zha's method \cite{Zha92}, the new algorithm uses an implicit Kogbetliantz iteration, but with four major innovations. The first…

Numerical Analysis · Mathematics 2020-02-13 Ian N. Zwaan

Two-dimensional singular decomposition (2DSVD) has been widely used for image processing tasks, such as image reconstruction, classification, and clustering. However, traditional 2DSVD algorithm is based on the mean square error (MSE) loss,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Miaohua Zhang , Yongsheng Gao

In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits…

Numerical Analysis · Mathematics 2022-05-10 Vedran Novaković , Sanja Singer

The paper presents a new Kalman filter (KF) implementation useful in applications where the accuracy of numerical solution of the associated Riccati equation might be crucially reduced by influence of roundoff errors. Since the appearance…

Optimization and Control · Mathematics 2017-09-22 Maria V. Kulikova , Julia V. Tsyganova

The higher-order tensor renormalization group (HOTRG) is a fundamental method to calculate the physical quantities by using a tensor network representation. This method is based on the singular value decomposition (SVD) to take the…

Statistical Mechanics · Physics 2023-07-27 Katsumasa Nakayama

The singular value decomposition (SVD) is a popular matrix factorization that has been used widely in applications ever since an efficient algorithm for its computation was developed in the 1970s. In recent years, the SVD has become even…

Numerical Analysis · Mathematics 2012-03-13 Carla D. Martin , Mason A. Porter

Given a family of nearly commuting symmetric matrices, we consider the task of computing an orthogonal matrix that nearly diagonalizes every matrix in the family. In this paper, we propose and analyze randomized joint diagonalization (RJD)…

Numerical Analysis · Mathematics 2024-02-27 Haoze He , Daniel Kressner

The rising number of bridge collapses worldwide has compelled governments to introduce predictive maintenance strategies to extend structural lifespan. In this context, vibration-based Structural Health Monitoring (SHM) techniques utilizing…

Computational Engineering, Finance, and Science · Computer Science 2024-11-11 Elisa Tomassini , Enrique García-Macías , Filippo Ubertini

Eigensystem Realization Algorithm (ERA) is a data-driven approach for subspace system identification and is widely used in many areas of engineering. However, the computational cost of the ERA is dominated by a step that involves the…

Numerical Analysis · Mathematics 2020-11-03 Rachel Minster , Arvind K. Saibaba , Jishnudeep Kar , Aranya Chakrabortty

Vanishing and exploding gradients are two of the main obstacles in training deep neural networks, especially in capturing long range dependencies in recurrent neural networks~(RNNs). In this paper, we present an efficient parametrization of…

Machine Learning · Computer Science 2018-03-28 Jiong Zhang , Qi Lei , Inderjit S. Dhillon

An important task when processing sensor data is to distinguish relevant from irrelevant data. This paper describes a method for an iterative singular value decomposition that maintains a model of the background via singular vectors…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Günther Reitberger , Tomas Sauer

This work deals with developing two fast randomized algorithms for computing the generalized tensor singular value decomposition (GTSVD) based on the tubal product (t-product). The random projection method is utilized to compute the…

Numerical Analysis · Mathematics 2024-09-13 Salman Ahmadi-Asl , Ugochukwu Ugwu