English
Related papers

Related papers: Randomized Online CP Decomposition

200 papers

The matricized-tensor times Khatri-Rao product (MTTKRP) is the computational bottleneck for algorithms computing CP decompositions of tensors. In this paper, we develop shared-memory parallel algorithms for MTTKRP involving dense tensors.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-31 Koby Hayashi , Grey Ballard , Jeffrey Jiang , Michael Tobia

Tensor decomposition is a fundamental technique widely applied in signal processing, machine learning, and various other fields. However, traditional tensor decomposition methods encounter limitations when jointly analyzing multi-block…

Machine Learning · Computer Science 2024-06-27 Xiulin Wang , Jing Liu , Fengyu Cong

In this paper, we develop a method which we call OnlineGCP for computing the Generalized Canonical Polyadic (GCP) tensor decomposition of streaming data. GCP differs from traditional canonical polyadic (CP) tensor decompositions as it…

Numerical Analysis · Mathematics 2021-10-28 Eric Phipps , Nick Johnson , Tamara G. Kolda

We consider the line spectral estimation problem which aims to recover a mixture of complex sinusoids from a small number of randomly observed time domain samples. Compressed sensing methods formulates line spectral estimation as a sparse…

Numerical Analysis · Computer Science 2015-12-11 Jun Fang , Linxiao Yang , Hongbin Li

The canonical polyadic (CP) tensor decomposition decomposes a multidimensional data array into a sum of outer products of finite-dimensional vectors. Instead, we can replace some or all of the vectors with continuous functions…

Numerical Analysis · Mathematics 2024-08-13 Brett W. Larsen , Tamara G. Kolda , Anru R. Zhang , Alex H. Williams

In CANDECOMP/PARAFAC tensor decomposition, degeneracy often occurs in some difficult scenarios, e.g., when the rank exceeds the tensor dimension, or when the loading components are highly collinear in several or all modes, or when CPD does…

Numerical Analysis · Computer Science 2017-09-26 Anh-Huy Phan , Petr Tichavský , Andrzej Cichocki

High-dimensional tensors or multi-way data are becoming prevalent in areas such as biomedical imaging, chemometrics, networking and bibliometrics. Traditional approaches to finding lower dimensional representations of tensor data include…

Machine Learning · Statistics 2012-02-14 Genevera I. Allen

Product between mode-$n$ unfolding $\bY_{(n)}$ of an $N$-D tensor $\tY$ and Khatri-Rao products of $(N-1)$ factor matrices $\bA^{(m)}$, $m = 1,..., n-1, n+1, ..., N$ exists in algorithms for CANDECOMP/PARAFAC (CP). If $\tY$ is an error…

Numerical Analysis · Computer Science 2015-03-20 Anh Huy Phan , Petr Tichavský , Andrzej Cichocki

Recurrent neural networks (RNNs) are powerful in the tasks oriented to sequential data, such as natural language processing and video recognition. However, since the modern RNNs, including long-short term memory (LSTM) and gated recurrent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Dingheng Wang , Bijiao Wu , Guangshe Zhao , Man Yao , Hengnu Chen , Lei Deng , Tianyi Yan , Guoqi Li

CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually…

Machine Learning · Computer Science 2015-01-22 Qibin Zhao , Liqing Zhang , Andrzej Cichocki

We consider the problem of online subspace tracking of a partially observed high-dimensional data stream corrupted by noise, where we assume that the data lie in a low-dimensional linear subspace. This problem is cast as an online low-rank…

Numerical Analysis · Computer Science 2017-10-02 Hiroyuki Kasai

The CANDECOMP/PARAFAC (CP) decomposition is a generalization of the spectral decomposition of matrices to higher-order tensors. In this paper we use the CP decomposition to study unitary equivalence of higher order tensors and construct…

Quantum Physics · Physics 2022-05-16 Jingmei Chang , Naihuan Jing

Randomization has emerged as a powerful set of tools for large-scale matrix and tensor decompositions. Randomized algorithms involve computing sketches with random matrices. A prevalent approach is to take the random matrix as a standard…

Numerical Analysis · Mathematics 2026-04-02 Arvind K. Saibaba , Bhisham Dev Verma , Grey Ballard

In biomedical research and other fields, it is now common to generate high content data that are both multi-source and multi-way. Multi-source data are collected from different high-throughput technologies while multi-way data are collected…

Machine Learning · Statistics 2025-02-28 Zhiyu Kang , Raghavendra B. Rao , Eric F. Lock

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

The problem of incomplete data - i.e., data with missing or unknown values - in multi-way arrays is ubiquitous in biomedical signal processing, network traffic analysis, bibliometrics, social network analysis, chemometrics, computer vision,…

Numerical Analysis · Mathematics 2015-03-17 Evrim Acar , Tamara G. Kolda , Daniel M. Dunlavy , Morten Morup

In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is…

Numerical Analysis · Mathematics 2016-03-07 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

This paper proposes fast randomized algorithms for computing the Kronecker Tensor Decomposition (KTD). The proposed algorithms can decompose a given tensor into the KTD format much faster than the existing state-of-the-art algorithms. Our…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Andre L. F. de Almeida , Yipeng Liu

Rank-revealing matrix decompositions provide an essential tool in spectral analysis of matrices, including the Singular Value Decomposition (SVD) and related low-rank approximation techniques. QR with Column Pivoting (QRCP) is usually…

Mathematical Software · Computer Science 2020-08-12 Jed A. Duersch , Ming Gu

In numerous settings, it is increasingly common to deal with longitudinal data organized as high-dimensional multi-dimensional arrays, also known as tensors. Within this framework, the time-continuous property of longitudinal data often…

Methodology · Statistics 2026-01-28 Lucas Sort , Laurent Le Brusquet , Arthur Tenenhaus