English
Related papers

Related papers: Fast algorithm for overcomplete order-3 tensor dec…

200 papers

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

DeepTensor is a computationally efficient framework for low-rank decomposition of matrices and tensors using deep generative networks. We decompose a tensor as the product of low-rank tensor factors (e.g., a matrix as the outer product of…

Efficient and fast computation of a tensor singular value decomposition (t-SVD) with a few passes over the underlying data tensor is crucial because of its many potential applications. The current/existing subspace randomized algorithms…

Numerical Analysis · Mathematics 2025-02-10 Salman Ahmadi-Asl , Anh-Huy Phan , Andrzej Cichocki

Motivated by a flurry of recent work on efficient tensor decomposition algorithms, we show that the celebrated moment matrix extension algorithm of Brachat, Comon, Mourrain, and Tsigaridas for symmetric tensor canonical polyadic (CP)…

Algebraic Geometry · Mathematics 2025-07-01 Bobby Shi , Julia Lindberg , Joe Kileel

In this paper, we provide local and global convergence guarantees for recovering CP (Candecomp/Parafac) tensor decomposition. The main step of the proposed algorithm is a simple alternating rank-$1$ update which is the alternating version…

Machine Learning · Computer Science 2015-03-05 Animashree Anandkumar , Rong Ge , Majid Janzamin

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

We propose a new fast randomized algorithm for interpolative decomposition of matrices which utilizes CountSketch. We then extend this approach to the tensor interpolative decomposition problem introduced by Biagioni et al. (J. Comput.…

Numerical Analysis · Mathematics 2024-12-20 Osman Asif Malik , Stephen Becker

We present a new method for online prediction and learning of tensors ($N$-way arrays, $N >2$) from sequential measurements. We focus on the specific case of 3-D tensors and exploit a recently developed framework of structured tensor…

Machine Learning · Statistics 2015-07-30 John Pothier , Josh Girson , Shuchin Aeron

This paper develops fast and efficient algorithms for computing Tucker decomposition with a given multilinear rank. By combining random projection and the power scheme, we propose two efficient randomized versions for the truncated…

Numerical Analysis · Mathematics 2023-03-22 Maolin Che , Yimin Wei , Hong Yan

A tensor network is a diagram that specifies a way to "multiply" a collection of tensors together to produce another tensor (or matrix). Many existing algorithms for tensor problems (such as tensor decomposition and tensor PCA), although…

Data Structures and Algorithms · Computer Science 2018-11-05 Ankur Moitra , Alexander S. Wein

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

Numerical Analysis · Mathematics 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

In this paper, we present a quantum singular value decomposition algorithm for third-order tensors inspired by the classical algorithm of tensor singular value decomposition (t-svd) and then extend it to order-$p$ tensors. It can be proved…

Quantum Physics · Physics 2020-02-04 Xiaoqiang Wang , Lejia Gu , Joseph Heung-wing Joseph Lee , Guofeng Zhang

We present the first deterministic, finite-step algorithm for exact tensor ring (TR) decomposition, addressing an open question about the existence of such procedures. Our method leverages blockwise simultaneous diagonalization to recover…

Numerical Analysis · Mathematics 2025-12-02 Han Chen , Sitan Chen , Anru R. Zhang

We present an iterative algorithm, called the symmetric tensor eigen-rank-one iterative decomposition (STEROID), for decomposing a symmetric tensor into a real linear combination of symmetric rank-1 unit-norm outer factors using only…

Numerical Analysis · Mathematics 2016-02-18 Kim Batselier , Ngai Wong

The tensor rank decomposition, also known as canonical polyadic(CP) or simply tensor decomposition, has a long history in multilinear algebra. However, computing a rank decomposition becomes particularly challenging when the rank lies…

Optimization and Control · Mathematics 2025-11-11 Zequn Zheng , Hongchao Zhang , Guangming Zhou

We present a polynomial time algorithm to approximately scale tensors of any format to arbitrary prescribed marginals (whenever possible). This unifies and generalizes a sequence of past works on matrix, operator and tensor scaling. Our…

Data Structures and Algorithms · Computer Science 2020-03-10 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

The oriented singular value decomposition (O-SVD) proposed by Zeng and Ng provides a hybrid approach to the t-product based third-order tensor singular value decomposition with the transform matrix being a factor matrix of the higher order…

Numerical Analysis · Mathematics 2023-02-28 Minghui Ding , Yimin Wei , Pengpeng Xie

The prevalent fully-connected tensor network (FCTN) has achieved excellent success to compress data. However, the FCTN decomposition suffers from slow computational speed when facing higher-order and large-scale data. Naturally, there…

Machine Learning · Computer Science 2022-10-20 Peilin Yang , Weijun Sun , Qibin Zhao , Guoxu Zhou