English
Related papers

Related papers: A Randomized Tensor Train Singular Value Decomposi…

200 papers

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basic notion of SVD and…

Machine Learning · Computer Science 2015-10-30 Zhihua Zhang

The Tucker tensor decomposition is a natural extension of the singular value decomposition (SVD) to multiway data. We propose to accelerate Tucker tensor decomposition algorithms by using randomization and parallelization. We present two…

Numerical Analysis · Mathematics 2023-06-12 Rachel Minster , Zitong Li , Grey Ballard

Within the tensor singular value decomposition (T-SVD) framework, existing robust low-rank tensor completion approaches have made great achievements in various areas of science and engineering. Nevertheless, these methods involve the T-SVD…

Machine Learning · Computer Science 2023-05-22 Wenjin Qin , Hailin Wang , Feng Zhang , Weijun Ma , Jianjun Wang , Tingwen Huang

The Randomized Singular Value Decomposition (RSVD) is a widely used algorithm for efficiently computing low-rank approximations of large matrices, without the need to construct a full-blown SVD. Of interest, of course, is the approximation…

Numerical Analysis · Mathematics 2025-10-09 Danil Akhtiamov , Reza Ghane , Babak Hassibi

In this paper, we show that the SVD of a matrix can be constructed efficiently in a hierarchical approach. Our algorithm is proven to recover the singular values and left singular vectors if the rank of the input matrix $A$ is known.…

Numerical Analysis · Mathematics 2017-01-09 M. A. Iwen , B. W. Ong

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

Low-rank approximation of images via singular value decomposition is well-received in the era of big data. However, singular value decomposition (SVD) is only for order-two data, i.e., matrices. It is necessary to flatten a higher order…

Machine Learning · Computer Science 2022-08-26 Liang Liao , Sen Lin , Lun Li , Xiuwei Zhang , Song Zhao , Yan Wang , Xinqiang Wang , Qi Gao , Jingyu Wang

An efficient, accurate and reliable approximation of a matrix by one of lower rank is a fundamental task in numerical linear algebra and signal processing applications. In this paper, we introduce a new matrix decomposition approach termed…

Numerical Analysis · Computer Science 2018-08-15 Maboud F. Kaloorazi , Rodrigo C. de Lamare

In this paper, we define a semi-tensor product for third-order tensors. Based on this definition, we present a new type of tensor decomposition strategy and give the specific algorithm. This decomposition strategy actually generalizes the…

Numerical Analysis · Mathematics 2023-01-18 Zhuo-Ran Chen , Seak-Weng Vong , Ze-Jia Xie

In this paper we focus on the problem of completion of multidimensional arrays (also referred to as tensors) from limited sampling. Our approach is based on a recently proposed tensor-Singular Value Decomposition (t-SVD) [1]. Using this…

Machine Learning · Computer Science 2015-03-02 Zemin Zhang , Shuchin Aeron

We propose a constructive algorithm that decomposes an arbitrary real tensor into a finite sum of orthonormal rank-1 outer products. The algorithm, named TTr1SVD, works by converting the tensor into a tensor-train rank-1 (TTr1) series via…

Numerical Analysis · Mathematics 2015-06-26 Kim Batselier , Haotian Liu , Ngai Wong

Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameters within the matrix with equal importance, which is a simple…

Computation and Language · Computer Science 2022-12-19 Ting Hua , Yen-Chang Hsu , Felicity Wang , Qian Lou , Yilin Shen , Hongxia Jin

Tensor train decomposition is a powerful tool for dealing with high-dimensional, large-scale tensor data, which is not suffering from the curse of dimensionality. To accelerate the calculation of the auxiliary unfolding matrix, some…

Numerical Analysis · Mathematics 2023-08-08 Gaohang Yu , Jinhong Feng , Zhongming Chen , Xiaohao Cai , Liqun Qi

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat

The Singular Value Decomposition (SVD) of matrices is a widely used tool in scientific computing. In many applications of machine learning, data analysis, signal and image processing, the large datasets are structured into tensors, for…

Numerical Analysis · Mathematics 2023-11-07 Anas El Hachimi , Khalide Jbilou , Mustapha Hached , Ahmed Ratnani

The singular value decomposition (SVD) and the principal component analysis are fundamental tools and probably the most popular methods for data dimension reduction. The rapid growth in the size of data matrices has lead to a need for…

Statistics Theory · Mathematics 2020-02-03 Ting-Li Chen , Su-Yun Huang , Weichung Wang

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

In this era of big data, data analytics and machine learning, it is imperative to find ways to compress large data sets such that intrinsic features necessary for subsequent analysis are not lost. The traditional workhorse for data…

Numerical Analysis · Mathematics 2020-01-03 Misha Kilmer , Lior Horesh , Haim Avron , Elizabeth Newman

The singular value decomposition (SVD) allows to write a matrix as a product of a left singular vectors matrix, a nonnegative singular values diagonal matrix and a right singular vectors matrix. Among the applications of the SVD are the…

Numerical Analysis · Mathematics 2025-12-09 Doulaye Dembele

Low-rank approximation of tensors has been widely used in high-dimensional data analysis. It usually involves singular value decomposition (SVD) of large-scale matrices with high computational complexity. Sketching is an effective data…

Numerical Analysis · Mathematics 2023-01-30 Wandi Dong , Gaohang Yu , Liqun Qi , Xiaohao Cai