English
Related papers

Related papers: A randomized singular value decomposition for thir…

200 papers

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently…

Computer Vision and Pattern Recognition · Computer Science 2014-10-31 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

Computing eigenvalue decomposition (EVD) of a given linear operator, or finding its leading eigenvalues and eigenfunctions, is a fundamental task in many machine learning and scientific computing problems. For high-dimensional eigenvalue…

Machine Learning · Computer Science 2024-08-22 J. Jon Ryu , Xiangxiang Xu , H. S. Melihcan Erol , Yuheng Bu , Lizhong Zheng , Gregory W. Wornell

Approximating higher-order tensors by the Tucker format has been applied in many fields such as psychometrics, chemometrics, signal processing, pattern classification, and so on. In this paper, we propose some new Tucker-like approximations…

Numerical Analysis · Mathematics 2023-01-18 Ze-Jia Xie , Xiao-Qing Jin , Zhi Zhao

The randomized singular value decomposition (R-SVD) is a popular sketching-based algorithm for efficiently computing the partial SVD of a large matrix. When the matrix is low-rank, the R-SVD produces its partial SVD exactly; but when the…

Information Theory · Computer Science 2023-07-07 Elad Romanov

Higher-order singular value decomposition (HOSVD) is a celebrated tool for tensor data analysis. The sequential HOSVD was recently generalized to the quaternion domain, while a naive quaternion extension of the classical HOSVD% by De…

Numerical Analysis · Mathematics 2025-06-26 Hanxin Ya , Yuning Yang

Under certain conditions, an element of a tensor product space can be identified with a compact operator and the singular value decomposition (SVD) applies to the latter. These conditions are not fulfilled in Sobolev spaces. In the previous…

Functional Analysis · Mathematics 2022-03-25 Mazen Ali , Anthony Nouy

Randomized numerical linear algebra is proved to bridge theoretical advancements to offer scalable solutions for approximating tensor decomposition. This paper introduces fast randomized algorithms for solving the fixed Tucker-rank problem…

Numerical Analysis · Mathematics 2025-06-06 Maolin Che , Yimin Wei , Chong Wu , Hong Yan

Tensor completion and robust principal component analysis have been widely used in machine learning while the key problem relies on the minimization of a tensor rank that is very challenging. A common way to tackle this difficulty is to…

Machine Learning · Computer Science 2021-05-26 Tao Li , Jinwen Ma

There are several factorizations of multi-dimensional tensors into lower-dimensional components, known as `tensor networks'. We consider the popular `tensor-train' (TT) format and ask: How efficiently can we compute a low-rank approximation…

Numerical Analysis · Mathematics 2023-04-18 Melven Röhrig-Zöllner , Jonas Thies , Achim Basermann

The higher-order generalized singular value decomposition (HO-GSVD) is a matrix factorization technique that extends the GSVD to $N \ge 2$ data matrices, and can be used to identify shared subspaces in multiple large-scale datasets with…

Numerical Analysis · Mathematics 2022-06-22 Idris Kempf , Paul J. Goulart , Stephen R. Duncan

This article studies the problem of decentralized Singular Value Decomposition (d-SVD), which is fundamental in various signal processing applications. Two scenarios are considered depending on the availability of the data matrix under…

Signal Processing · Electrical Eng. & Systems 2025-01-10 Yufan Fan , Marius Pesavento

The randomized singular value decomposition (SVD) has become a popular approach to computing cheap, yet accurate, low-rank approximations to matrices due to its efficiency and strong theoretical guarantees. Recent work by Boull\'e and…

Numerical Analysis · Mathematics 2024-12-10 David Persson , Nicolas Boullé , Daniel Kressner

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

Tensor train (TT) decomposition has drawn people's attention due to its powerful representation ability and performance stability in high-order tensors. In this paper, we propose a novel approach to recover the missing entries of incomplete…

Numerical Analysis · Computer Science 2018-12-03 Longhao Yuan , Qibin Zhao , Lihua Gui , Jianting Cao

The higher order singular value decomposition (HOSVD) of tensors is a generalization of matrix SVD. The perturbation analysis of HOSVD under random noise is more delicate than its matrix counterpart. Recently, polynomial time algorithms…

Statistics Theory · Mathematics 2019-01-03 Dong Xia , Fan Zhou

To analyze the abundance of multidimensional data, tensor-based frameworks have been developed. Traditionally, the matrix singular value decomposition (SVD) is used to extract the most dominant features from a matrix containing the…

Machine Learning · Computer Science 2021-11-02 Katherine Keegan , Tanvi Vishwanath , Yihua Xu

This paper studies a general framework for high-order tensor SVD. We propose a new computationally efficient algorithm, tensor-train orthogonal iteration (TTOI), that aims to estimate the low tensor-train rank structure from the noisy…

Statistics Theory · Mathematics 2022-01-26 Yuchen Zhou , Anru R. Zhang , Lili Zheng , Yazhen Wang

Singular Value Decomposition (SVD) is a powerful tool for multivariate analysis. However, independent computation of the SVD for each sample taken from a bandlimited matrix random process will result in singular value sample paths whose…

Statistics Theory · Mathematics 2007-06-13 D. W. Browne , M. W. Browne , M. P. Fitz

Randomized methods, such as the randomized SVD (singular value decomposition) and Nystr\"om approximation, are an effective way to compute low-rank approximations of large matrices. Motivated by applications to operator learning, Boull\'e…

Numerical Analysis · Mathematics 2026-02-09 Daniel Kressner , David Persson , André Uschmajew