English
Related papers

Related papers: Fast algorithms for Higher-order Singular Value De…

200 papers

In this paper, we show that the SVD of a matrix can be constructed efficiently in a hierarchical approach. Our algorithm is proven to recover the singular values and left singular vectors if the rank of the input matrix $A$ is known.…

Numerical Analysis · Mathematics 2017-01-09 M. A. Iwen , B. W. Ong

In this paper, we propose a general framework for tensor singular value decomposition (tensor SVD), which focuses on the methodology and theory for extracting the hidden low-rank structure from high-dimensional tensor data. Comprehensive…

Statistics Theory · Mathematics 2020-01-09 Anru Zhang , Dong Xia

Snapshot hyperspectral imaging can capture the 3D hyperspectral image (HSI) with a single 2D measurement and has attracted increasing attention recently. Recovering the underlying HSI from the compressive measurement is an ill-posed problem…

Image and Video Processing · Electrical Eng. & Systems 2021-01-25 Niankai Cheng , Hua Huang , Lei Zhang , Lizhi Wang

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

Fast computation of singular value decomposition (SVD) is of great interest in various machine learning tasks. Recently, SVD methods based on randomized linear algebra have shown significant speedup in this regime. This paper attempts to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Yuechao Lu , Fumihiko Ino , Yasuyuki Matsushita

In this paper a new dictionary learning algorithm for multidimensional data is proposed. Unlike most conventional dictionary learning methods which are derived for dealing with vectors or matrices, our algorithm, named KTSVD, learns a…

Machine Learning · Computer Science 2016-01-01 Zemin Zhang , Shuchin Aeron

In this paper, we demonstrate that higher order singular value decomposition (HOSVD) can be used to identify special states in three qubits by local unitary (LU) operations. Since the matrix unfoldings of three qubits are related to their…

Quantum Physics · Physics 2020-09-15 P. S. Choong , H. Zainuddin , K. T. Chan , Sh. K. Said Husain

For tensor decompositions such as HOSVD and ParaFac, the objective functions are nonconvex. This implies, theoretically, there exists a large number of local optimas: starting from different starting point, the iteratively improved solution…

Computer Vision and Pattern Recognition · Computer Science 2009-09-30 Dijun Luo , Heng Huang , Chris Ding

In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique…

Numerical Analysis · Mathematics 2020-11-23 Charumathi V , M. Ramakrishna , Vinita Vasudevan

In this paper, we propose a computationally efficient iterative algorithm for proper orthogonal decomposition (POD) using random sampling based techniques. In this algorithm, additional rows and columns are sampled and a merging technique…

Numerical Analysis · Computer Science 2021-07-07 V. Charumathi , M. Ramakrishna , Vinita Vasudevan

We prove that the classic approximation guarantee for the higher-order singular value decomposition (HOSVD) is tight by constructing a tensor for which HOSVD achieves an approximation ratio of $N/(1+\varepsilon)$, for any $\varepsilon > 0$.…

Data Structures and Algorithms · Computer Science 2025-08-12 Matthew Fahrbach , Mehrdad Ghadiri

We propose new iterative methods for computing nontrivial extremal generalized singular values and vectors. The first method is a generalized Davidson-type algorithm and the second method employs a multidirectional subspace expansion…

Numerical Analysis · Mathematics 2017-05-18 Ian N. Zwaan , Michiel E. Hochstenbach

The generalized singular value decomposition (GSVD) is a valuable tool that has many applications in computational science. However, computing the GSVD for large-scale problems is challenging. Motivated by applications in hyper-differential…

Numerical Analysis · Mathematics 2020-02-10 Arvind K. Saibaba , Joseph Hart , Bart van Bloemen Waanders

The problem of incomplete data is common in signal processing and machine learning. Tensor completion algorithms aim to recover the incomplete data from its partially observed entries. In this paper, taking advantages of high…

Numerical Analysis · Computer Science 2018-12-03 Longhao Yuan , Jianting Cao , Qiang Wu , Qibin Zhao

We introduce a broad lemma, one consequence of which is the higher order singular value decomposition (HOSVD) of tensors defined by DeLathauwer, DeMoor and Vandewalle (2000). By an analogous application of the lemma, we find a complex…

Quantum Physics · Physics 2025-10-16 Luke Oeding , Ian Tan

The higher order singular value decomposition (HOSVD) of tensors is a generalization of matrix SVD. The perturbation analysis of HOSVD under random noise is more delicate than its matrix counterpart. Recently, polynomial time algorithms…

Statistics Theory · Mathematics 2019-01-03 Dong Xia , Fan Zhou

The incremental singular value decomposition (SVD) updates a truncated SVD as new columns arrive, replacing a single large SVD with a sequence of small ones. In floating-point arithmetic, each update multiplies the running singular basis by…

Numerical Analysis · Mathematics 2026-05-05 Yangwen Zhang

The randomized singular value decomposition (SVD) is a popular and effective algorithm for computing a near-best rank $k$ approximation of a matrix $A$ using matrix-vector products with standard Gaussian vectors. Here, we generalize the…

Numerical Analysis · Mathematics 2022-01-24 Nicolas Boullé , Alex Townsend

The Randomized Singular Value Decomposition (RSVD) is a widely used algorithm for efficiently computing low-rank approximations of large matrices, without the need to construct a full-blown SVD. Of interest, of course, is the approximation…

Numerical Analysis · Mathematics 2025-10-09 Danil Akhtiamov , Reza Ghane , Babak Hassibi

Singular Value Decomposition (SVD) is one of the most useful techniques for analyzing data in linear algebra. SVD decomposes a rectangular real or complex matrix into two orthogonal matrices and one diagonal matrix. In this work we…

Quantum Physics · Physics 2012-07-31 Laszlo Gyongyosi , Sandor Imre