English
Related papers

Related papers: Multi-subspace power method for decomposing partia…

200 papers

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

The tensor decomposition addressed in this paper may be seen as a generalisation of Singular Value Decomposition of matrices. We consider general multilinear and multihomogeneous tensors. We show how to reduce the problem to a truncated…

Algebraic Geometry · Mathematics 2012-10-17 Alessandra Bernardi , Jerome Brachat , Pierre Comon , Bernard Mourrain

We study symmetric tensor decompositions, i.e. decompositions of the input symmetric tensor T of order 3 as sum of r 3rd-order tensor powers of u_i where u_i are vectors in \C^n. In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

We study symmetric tensor decompositions, i.e., decompositions of the form $T = \sum_{i=1}^r u_i^{\otimes 3}$ where $T$ is a symmetric tensor of order 3 and $u_i \in \mathbb{C}^n$.In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness…

Machine Learning · Computer Science 2017-04-20 Miaoyan Wang , Yun S. Song

We study the best low-rank Tucker decomposition of symmetric tensors. The motivating application is decomposing higher-order multivariate moments. Moment tensors have special structure and are important to various data science problems. We…

Numerical Analysis · Mathematics 2023-06-13 Ruhui Jin , Joe Kileel , Tamara G. Kolda , Rachel Ward

Tensor decomposition serves as a powerful primitive in statistics and machine learning, and has numerous applications in problems such as learning latent variable models or mixture of Gaussians. In this paper, we focus on using power…

Machine Learning · Computer Science 2025-03-25 Yuchen Wu , Kangjie Zhou

We consider the problem of decomposing a real-valued symmetric tensor as the sum of outer products of real-valued, pairwise orthogonal vectors. Such decompositions do not generally exist, but we show that some symmetric tensor decomposition…

Numerical Analysis · Mathematics 2015-03-05 Tamara G. Kolda

This chapter studies the problem of decomposing a tensor into a sum of constituent rank one tensors. While tensor decompositions are very useful in designing learning algorithms and data analysis, they are NP-hard in the worst-case. We will…

Data Structures and Algorithms · Computer Science 2020-07-31 Aravindan Vijayaraghavan

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

Matrices can be decomposed via rank-one approximations: the best rank-one approximation is a singular vector pair, and the singular value decomposition writes a matrix as a sum of singular vector pairs. The singular vector tuples of a…

Algebraic Geometry · Mathematics 2025-12-02 Alvaro Ribot , Emil Horobet , Anna Seigal , Ettore Teixeira Turatti

The tensor power method generalizes the matrix power method to higher order arrays, or tensors. Like in the matrix case, the fixed points of the tensor power method are the eigenvectors of the tensor. While every real symmetric matrix has…

Numerical Analysis · Mathematics 2025-03-28 Tommi Muller , Elina Robeva , Konstantin Usevich

In this paper, we introduce a new tensor decomposition for third order tensors, which decomposes a third order tensor to three third order low rank tensors in a balanced way. We call such a decomposition the triple decomposition, and the…

Numerical Analysis · Mathematics 2020-03-03 Liqun Qi , Yannan Chen , Mayank Bakshi , Xinzhen Zhang

Decompositions of tensors into factor matrices, which interact through a core tensor, have found numerous applications in signal processing and machine learning. A more general tensor model which represents data as an ordered network of…

Numerical Analysis · Computer Science 2016-09-30 Anh-Huy Phan , Andrzej Cichocki , Andre Uschmajew , Petr Tichavsky , George Luta , Danilo Mandic

The tensor-train (TT) decomposition is widely used to compress large tensors into a more compact form by exploiting their inherent data structures. A fundamental approach for constructing the TT format is the well-known TT-SVD method, which…

Numerical Analysis · Mathematics 2026-05-26 Yuchao Wang , Maolin Che , Yimin Wei

In this paper, we define a semi-tensor product for third-order tensors. Based on this definition, we present a new type of tensor decomposition strategy and give the specific algorithm. This decomposition strategy actually generalizes the…

Numerical Analysis · Mathematics 2023-01-18 Zhuo-Ran Chen , Seak-Weng Vong , Ze-Jia Xie

We give algorithms to compute decompositions of a given polynomial, or more generally mixed tensor, as sum of rank one tensors, and to establish whether such a decomposition is unique. In particular, we present methods to compute the…

Algebraic Geometry · Mathematics 2021-07-12 Antonio Laface , Alex Massarenti , Rick Rischter

We give a new approach to the dictionary learning (also known as "sparse coding") problem of recovering an unknown $n\times m$ matrix $A$ (for $m \geq n$) from examples of the form \[ y = Ax + e, \] where $x$ is a random vector in $\mathbb…

Data Structures and Algorithms · Computer Science 2014-11-11 Boaz Barak , Jonathan A. Kelner , David Steurer

Tensor train (TT) decomposition has drawn people's attention due to its powerful representation ability and performance stability in high-order tensors. In this paper, we propose a novel approach to recover the missing entries of incomplete…

Numerical Analysis · Computer Science 2018-12-03 Longhao Yuan , Qibin Zhao , Lihua Gui , Jianting Cao

We propose a new numerical algorithm for computing the tensor rank decomposition or canonical polyadic decomposition of higher-order tensors subject to a rank and genericity constraint. Reformulating this computational problem as a system…

Numerical Analysis · Mathematics 2024-07-02 Simon Telen , Nick Vannieuwenhoven