English
Related papers

Related papers: New results in canonical polyadic decomposition ov…

200 papers

Tensor CANDECOMP/PARAFAC decomposition (CPD) is a fundamental model for tensor reconstruction. Although the Bayesian framework allows for principled uncertainty quantification and automatic hyperparameter learning, existing methods do not…

Machine Learning · Computer Science 2026-01-27 Bingyang Cheng , Zhongtao Chen , Yichen Jin , Hao Zhang , Chen Zhang , Edmund Y. Lam , Yik-Chung Wu

This paper explores a new version of the Levenberg-Marquardt algorithm used for Tensor Canonical Polyadic (CP) decomposition with an emphasis on image compression and reconstruction. Tensor computation, especially CP decomposition, holds…

Numerical Analysis · Mathematics 2024-07-26 Ramin Goudarzi Karim , Dipak Dulal , Carmeliza Navasca

Tensor decomposition has proven to be a strong tool in various 3D image processing tasks such as denoising and super-resolution. In this context, we recently proposed a canonical polyadic decomposition (CPD) based algorithm for single image…

Image and Video Processing · Electrical Eng. & Systems 2020-09-21 J. Hatvani , A. Basarab , J. Michetti , M. Gyöngy , D. Kouamé

Canonical Polyadic (CP) tensor decomposition is a fundamental technique for analyzing high-dimensional tensor data. While the Alternating Least Squares (ALS) algorithm is widely used for computing CP decomposition due to its simplicity and…

Methodology · Statistics 2025-05-30 Runshi Tang , Julien Chhor , Olga Klopp , Anru R. Zhang

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Canonical Polyadic (CP) tensor decomposition is a workhorse algorithm for discovering underlying low-dimensional structure in tensor data. This is accomplished in conventional CP decomposition by fitting a low-rank tensor to data with…

Numerical Analysis · Mathematics 2026-01-12 Alex Mulrooney , David Hong

Generalizing work of K\"unnemann, Paturi, and Schneider [ICALP 2017], we study a wide class of high-dimensional dynamic programming (DP) problems in which one must find the shortest path between two points in a high-dimensional grid given a…

Computational Complexity · Computer Science 2024-01-03 Josh Alman , Ethan Turok , Hantao Yu , Hengzhi Zhang

We consider the problem of factorizing a structured 3-way tensor into its constituent Canonical Polyadic (CP) factors. This decomposition, which can be viewed as a generalization of singular value decomposition (SVD) for tensors, reveals…

Machine Learning · Computer Science 2020-07-01 Sirisha Rambhatla , Xingguo Li , Jarvis Haupt

Recovering a low-rank matrix from highly corrupted measurements arises in compressed sensing of structured high-dimensional signals (e.g., videos and hyperspectral images among others). Robust principal component analysis (RPCA), solved via…

Optimization and Control · Mathematics 2022-06-28 Vahan Hovhannisyan , Yannis Panagakis , Panos Parpas , Stefanos Zafeiriou

We consider the problem of low canonical polyadic (CP) rank tensor completion. A completion is a tensor whose entries agree with the observed entries and its rank matches the given CP rank. We analyze the manifold structure corresponding to…

Machine Learning · Computer Science 2017-04-03 Morteza Ashraphijuo , Xiaodong Wang

Tensor decompositions are powerful tools for large data analytics as they jointly model multiple aspects of data into one framework and enable the discovery of the latent structures and higher-order correlations within the data. One of the…

Machine Learning · Computer Science 2018-07-05 Ekta Gujral , Ravdeep Pasricha , Tianxiong Yang , Evangelos E. Papalexakis

We develop the first fast spectral algorithm to decompose a random third-order tensor over $\mathbb{R}^d$ of rank up to $O(d^{3/2}/\text{polylog}(d))$. Our algorithm only involves simple linear algebra operations and can recover all…

Machine Learning · Computer Science 2022-06-30 Jingqiu Ding , Tommaso d'Orsi , Chih-Hung Liu , Stefan Tiegel , David Steurer

A rising problem in the compression of Deep Neural Networks is how to reduce the number of parameters in convolutional kernels and the complexity of these layers by low-rank tensor approximation. Canonical polyadic tensor decomposition…

Machine Learning · Computer Science 2022-03-08 Anh-Huy Phan , Konstantin Sobolev , Dmitry Ermilov , Igor Vorona , Nikolay Kozyrskiy , Petr Tichavsky , Andrzej Cichocki

Motivated by a flurry of recent work on efficient tensor decomposition algorithms, we show that the celebrated moment matrix extension algorithm of Brachat, Comon, Mourrain, and Tsigaridas for symmetric tensor canonical polyadic (CP)…

Algebraic Geometry · Mathematics 2025-07-01 Bobby Shi , Julia Lindberg , Joe Kileel

We show that finding rank-$R$ decompositions of a 3D tensor, for $R\le 4$, over a fixed finite field can be done in polynomial time. However, if some cells in the tensor are allowed to have arbitrary values, then rank-2 is NP-hard over the…

Computational Complexity · Computer Science 2024-04-18 Jason Yang

The ParaTuck-2 decomposition (PT2D) of third-order tensor is a two-layer generalization of the well-known canonical polyadic decomposition (CPD).While being more flexible than the CPD, the PT2D also possesses similar uniqueness…

Numerical Analysis · Mathematics 2025-03-11 Konstantin Usevich

Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to $n^{\lfloor p/2 \rfloor}$ for a $p$-th order tensor in…

Data Structures and Algorithms · Computer Science 2015-04-23 Rong Ge , Tengyu Ma

Cylindrical Algebraic Decomposition (CAD) has long been one of the most important algorithms within Symbolic Computation, as a tool to perform quantifier elimination in first order logic over the reals. More recently it is finding…

Symbolic Computation · Computer Science 2020-03-23 Matthew England , Russell Bradford , James H. Davenport

We find conditions that guarantee that a decomposition of a generic third-order tensor in a minimal number of rank-$1$ tensors (canonical polyadic decomposition (CPD)) is unique up to permutation of rank-$1$ tensors. Then we consider the…

Algebraic Geometry · Mathematics 2016-07-20 Ignat Domanov , Lieven De Lathauwer

Coupled decompositions are a widely used tool for data fusion. As the volume of data increases, so does the dimensionality of matrices and tensors, highlighting the need for more efficient coupled decomposition algorithms. This paper…

Numerical Analysis · Mathematics 2026-04-22 Erna Begovic , Anita Carevic , Ivana Sain Glibic