English
Related papers

Related papers: Revisit CP Tensor Decomposition: Statistical Optim…

200 papers

Recently, coupled tensor decomposition has been widely used in data fusion of a hyperspectral image (HSI) and a multispectral image (MSI) for hyperspectral super-resolution (HSR). However, exsiting works often ignore the inherent…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Xi-Yuan Liu , Xiao-Feng Gong , Lei Wang , Wei Feng , Qiu-Hua Lin

This paper presents a canonical polyadic (CP) tensor decomposition that addresses unaligned observations. The mode with unaligned observations is represented using functions in a reproducing kernel Hilbert space (RKHS). We introduce a…

Machine Learning · Statistics 2025-08-12 Runshi Tang , Tamara Kolda , Anru R. Zhang

The CANDECOMP/PARAFAC (or Canonical polyadic, CP) decomposition of tensors has numerous applications in various fields, such as chemometrics, signal processing, machine learning, etc. Tensor CP decomposition assumes the knowledge of the…

Numerical Analysis · Mathematics 2025-01-08 Zihao Wang , Minru Bai , Liang Chen , Xueying Zhao

High-dimensional tensor-valued predictors arise in modern applications, increasingly as learned representations from neural networks. Existing tensor classification methods rely on sparsity or Tucker structures and often lack theoretical…

Machine Learning · Computer Science 2025-12-16 Elynn Chen , Yuefeng Han , Jiayu Li

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction…

Machine Learning · Computer Science 2021-03-31 Alexandros Haliassos , Kriton Konstantinidis , Danilo P. Mandic

A new algorithm of the canonical polyadic decomposition (CPD) presented here. It features lower computational complexity and memory usage than the available state of the art implementations. We begin with some examples of CPD applications…

Numerical Analysis · Mathematics 2021-10-13 Felipe Bottega Diniz

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

The Semi-Algebraic framework for the approximate Canonical Polyadic (CP) decomposition via SImultaneaous matrix diagonalization (SECSI) is an efficient tool for the computation of the CP decomposition. The SECSI framework reformulates the…

Information Theory · Computer Science 2017-10-19 Sher Ali Cheema , Emilio Rafael Balda , Yao Cheng , Martin Haardt , Amir Weiss , Arie Yeredor

In the present work, a method is proposed in order to compute a Canonical Polyadic (CP) approximation of a given tensor. It is based on a greedy method and an adaptation of the TT-SVD method. The proposed approach can be straightforwardly…

Numerical Analysis · Mathematics 2020-11-20 Virginie Ehrlacher , Maria Fuente Ruiz , Damiano Lombardi

Canonical polyadic decomposition (CPD) is at the core of fast matrix multiplication, a computational problem with widespread implications across several seemingly unrelated problems in computer science. Much recent progress in this field…

Computational Complexity · Computer Science 2025-11-11 Jason Yang

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

The canonical polyadic decomposition (CPD) of a low rank tensor plays a major role in data analysis and signal processing by allowing for unique recovery of underlying factors. However, it is well known that the low rank CPD approximation…

Numerical Analysis · Mathematics 2021-12-16 Eric Evert , Lieven De Lathauwer

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of…

Chemical Physics · Physics 2025-06-23 Karl Pierce

In this paper we study the problem of noisy tensor completion for tensors that admit a canonical polyadic or CANDECOMP/PARAFAC (CP) decomposition with one of the factors being sparse. We present general theoretical error bounds for an…

Machine Learning · Statistics 2017-04-11 Swayambhoo Jain , Alexander Gutierrez , Jarvis Haupt

This paper introduces a novel collaborative neurodynamic model for computing nonnegative Canonical Polyadic Decomposition (CPD). The model relies on a system of recurrent neural networks to solve the underlying nonconvex optimization…

Numerical Analysis · Mathematics 2025-01-03 Salman Ahmadi-Asl , Valentin Leplat , Anh-Huy Phan , Andrzej Cichocki

Performance tuning, software/hardware co-design, and job scheduling are among the many tasks that rely on models to predict application performance. We propose and evaluate low-rank tensor decomposition for modeling application performance.…

Performance · Computer Science 2023-08-30 Edward Hutter , Edgar Solomonik

We propose an online tensor subspace tracking algorithm based on the CP decomposition exploiting the recursive least squares (RLS), dubbed OnLine Low-rank Subspace tracking by TEnsor CP Decomposition (OLSTEC). Numerical evaluations show…

Numerical Analysis · Computer Science 2016-08-23 Hiroyuki Kasai

We consider the problem of factorizing a structured 3-way tensor into its constituent Canonical Polyadic (CP) factors. This decomposition, which can be viewed as a generalization of singular value decomposition (SVD) for tensors, reveals…

Machine Learning · Computer Science 2020-07-01 Sirisha Rambhatla , Xingguo Li , Jarvis Haupt

The CP tensor decomposition is a low-rank approximation of a tensor. We present a distributed-memory parallel algorithm and implementation of an alternating optimization method for computing a CP decomposition of dense tensor data that can…

Numerical Analysis · Computer Science 2018-06-22 Grey Ballard , Koby Hayashi , Ramakrishnan Kannan