English
Related papers

Related papers: Tensor Deflation for CANDECOMP/PARAFAC. Part 3: Ra…

200 papers

In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is…

Numerical Analysis · Mathematics 2016-03-07 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

We study rank-1 {L1-norm-based TUCKER2} (L1-TUCKER2) decomposition of 3-way tensors, treated as a collection of $N$ $D \times M$ matrices that are to be jointly decomposed. Our contributions are as follows. i) We prove that the problem is…

Data Structures and Algorithms · Computer Science 2018-04-04 Panos P. Markopoulos , Dimitris G. Chachlakis , Evangelos E. Papalexakis

Structural Health Monitoring (SHM) provides an economic approach which aims to enhance understanding the behavior of structures by continuously collects data through multiple networked sensors attached to the structure. This data is then…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman , Seid Miad Zandavi

In low-rank tensor completion tasks, due to the underlying multiple large-scale singular value decomposition (SVD) operations and rank selection problem of the traditional methods, they suffer from high computational cost and high…

Numerical Analysis · Computer Science 2018-05-23 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

In this paper, the canonical polyadic (CP) decomposition of tensors that corresponds to matrix multiplications is studied. Finding the rank of these tensors and computing the decompositions is a fundamental problem of algebraic complexity…

Computational Complexity · Computer Science 2021-04-13 Petr Tichavsky

Tensor decompositions, such as CANDECOMP/PARAFAC (CP), are widely used in a variety of applications, such as chemometrics, signal processing, and machine learning. A broadly used method for computing such decompositions relies on the…

Mathematical Software · Computer Science 2022-05-02 Christos Psarras , Lars Karlsson , Rasmus Bro , Paolo Bientinesi

The PARAFAC2 model provides a flexible alternative to the popular CANDECOMP/PARAFAC (CP) model for tensor decompositions. Unlike CP, PARAFAC2 allows factor matrices in one mode (i.e., evolving mode) to change across tensor slices, which has…

Machine Learning · Computer Science 2023-10-18 Marie Roald , Carla Schenker , Jeremy E. Cohen , Evrim Acar

One of the main issues in computing a tensor decomposition is how to choose the number of rank-one components, since there is no finite algorithms for determining the rank of a tensor. A commonly used approach for this purpose is to find a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Claudio Turchetti

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered…

Machine Learning · Statistics 2023-03-20 Mohamed El Amine Seddik , Mohammed Mahfoud , Merouane Debbah

In the last decades, tensors have emerged as the right tool to represent multidimensional data in a compact yet informative manner. Moreover, it is well-known that by performing low-rank factorizations of such tensors one is often able to…

Numerical Analysis · Mathematics 2026-03-31 Martina Iannacito , Sascha Portaro , Davide Palitta , Claudio Arlandini , Domitilla Brandoni

Tensor decomposition has emerged as a powerful framework for feature extraction in multi-modal biomedical data. In this review, we present a comprehensive analysis of tensor decomposition methods such as Tucker, CANDECOMP/PARAFAC, spiked…

The damped Gauss-Newton (dGN) algorithm for CANDECOMP/PARAFAC (CP) decomposition can handle the challenges of collinearity of factors and different magnitudes of factors; nevertheless, for factorization of an $N$-D tensor of size $I_1\times…

Numerical Analysis · Computer Science 2015-03-20 Anh Huy Phan , Petr Tichavský , Andrzej Cichocki

Tensor rank and low-rank tensor decompositions have many applications in learning and complexity theory. Most known algorithms use unfoldings of tensors and can only handle rank up to $n^{\lfloor p/2 \rfloor}$ for a $p$-th order tensor in…

Data Structures and Algorithms · Computer Science 2015-04-23 Rong Ge , Tengyu Ma

This article provides next step towards solving speed bottleneck of any system that intensively uses convolutions operations (e.g. CNN). Method described in the article is applied on deformable part models (DPM) algorithm. Method described…

Computer Vision and Pattern Recognition · Computer Science 2017-07-12 D. V. Parkhomenko , I. L. Mazurenko

This chapter studies the problem of decomposing a tensor into a sum of constituent rank one tensors. While tensor decompositions are very useful in designing learning algorithms and data analysis, they are NP-hard in the worst-case. We will…

Data Structures and Algorithms · Computer Science 2020-07-31 Aravindan Vijayaraghavan

We consider the problem of downlink channel estimation for millimeter wave (mmWave) MIMO-OFDM systems, where both the base station (BS) and the mobile station (MS) employ large antenna arrays for directional precoding/beamforming. Hybrid…

Information Theory · Computer Science 2016-11-02 Zhou Zhou , Jun Fang , Linxiao Yang , Hongbin Li , Zhi Chen , Rick S. Blum

The decoupling of multivariate functions is a powerful modeling paradigm for learning multivariate input-output relations from data. For the single-layer case, established CPD-based methods are available, but the multi-layer case remained…

Systems and Control · Electrical Eng. & Systems 2026-04-14 Joppe De Jonghe , Konstantin Usevich , Philippe Dreesen , Mariya Ishteva

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

The ParaTuck-2 decomposition (PT2D) of third-order tensor is a two-layer generalization of the well-known canonical polyadic decomposition (CPD).While being more flexible than the CPD, the PT2D also possesses similar uniqueness…

Numerical Analysis · Mathematics 2025-03-11 Konstantin Usevich