English
Related papers

Related papers: Tensor decompositions and algorithms, with applica…

200 papers

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GCP) low-rank tensor…

Numerical Analysis · Mathematics 2020-07-09 David Hong , Tamara G. Kolda , Jed A. Duersch

In this paper, the canonical polyadic (CP) decomposition of tensors that corresponds to matrix multiplications is studied. Finding the rank of these tensors and computing the decompositions is a fundamental problem of algebraic complexity…

Computational Complexity · Computer Science 2021-04-13 Petr Tichavsky

This paper introduces a novel collaborative neurodynamic model for computing nonnegative Canonical Polyadic Decomposition (CPD). The model relies on a system of recurrent neural networks to solve the underlying nonconvex optimization…

Numerical Analysis · Mathematics 2025-01-03 Salman Ahmadi-Asl , Valentin Leplat , Anh-Huy Phan , Andrzej Cichocki

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

Machine Learning · Computer Science 2023-07-25 Xingyi Liu , Keshab K. Parhi

In recent years, the application of tensors has become more widespread in fields that involve data analytics and numerical computation. Due to the explosive growth of data, low-rank tensor decompositions have become a powerful tool to…

Numerical Analysis · Mathematics 2020-11-03 Lingjie Li , Wenjian Yu , Kim Batselier

Tensor decompositions are powerful tools for large data analytics as they jointly model multiple aspects of data into one framework and enable the discovery of the latent structures and higher-order correlations within the data. One of the…

Machine Learning · Computer Science 2018-07-05 Ekta Gujral , Ravdeep Pasricha , Tianxiong Yang , Evangelos E. Papalexakis

The widespread use of multisensor technology and the emergence of big data sets have brought the necessity to develop more versatile tools to represent higher-order data with multiple aspects and high dimensionality. Data in the form of…

Signal Processing · Electrical Eng. & Systems 2018-06-27 Ali Zare , Alp Ozdemir , Mark A. Iwen , Selin Aviyente

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Tensor CANDECOMP/PARAFAC decomposition (CPD) is a fundamental model for tensor reconstruction. Although the Bayesian framework allows for principled uncertainty quantification and automatic hyperparameter learning, existing methods do not…

Machine Learning · Computer Science 2026-01-27 Bingyang Cheng , Zhongtao Chen , Yichen Jin , Hao Zhang , Chen Zhang , Edmund Y. Lam , Yik-Chung Wu

The widespread use of multi-sensor technology and the emergence of big datasets has highlighted the limitations of standard flat-view matrix models and the necessity to move towards more versatile data analysis tools. We show that…

Numerical Analysis · Computer Science 2015-06-19 A. Cichocki , D. Mandic , A-H. Phan , C. Caiafa , G. Zhou , Q. Zhao , L. De Lathauwer

Scientific problems require resolving multi-scale phenomena across different resolutions and learning solution operators in infinite-dimensional function spaces. Neural operators provide a powerful framework for this, using…

Performance tuning, software/hardware co-design, and job scheduling are among the many tasks that rely on models to predict application performance. We propose and evaluate low-rank tensor decomposition for modeling application performance.…

Performance · Computer Science 2023-08-30 Edward Hutter , Edgar Solomonik

We propose a new numerical algorithm for computing the tensor rank decomposition or canonical polyadic decomposition of higher-order tensors subject to a rank and genericity constraint. Reformulating this computational problem as a system…

Numerical Analysis · Mathematics 2024-07-02 Simon Telen , Nick Vannieuwenhoven

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

The paper surveys the topic of tensor decompositions in modern machine learning applications. It focuses on three active research topics of significant relevance for the community. After a brief review of consolidated works on multi-way…

Machine Learning · Computer Science 2020-02-28 Davide Bacciu , Danilo P. Mandic

One of the main issues in computing a tensor decomposition is how to choose the number of rank-one components, since there is no finite algorithms for determining the rank of a tensor. A commonly used approach for this purpose is to find a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Claudio Turchetti

This chapter studies the problem of decomposing a tensor into a sum of constituent rank one tensors. While tensor decompositions are very useful in designing learning algorithms and data analysis, they are NP-hard in the worst-case. We will…

Data Structures and Algorithms · Computer Science 2020-07-31 Aravindan Vijayaraghavan

CP decomposition is a powerful tool for data science, especially gene analysis, deep learning, and quantum computation. However, the application of tensor decomposition is largely hindered by the exponential increment of the computational…

Machine Learning · Computer Science 2023-11-27 Zeliang Zhang , Zhuo Liu , Susan Liang , Zhiyuan Wang , Yifan Zhu , Chen Ding , Chenliang Xu

In autoregressive modeling for tensor-valued time series, Tucker decomposition, when applied to the coefficient tensor, provides a clear interpretation of supervised factor modeling but loses its efficiency rapidly with increasing tensor…

Methodology · Statistics 2025-06-03 Yuxi Cai , Lan Li , Yize Wang , Guodong Li

The canonical polyadic decomposition (CPD) is a compact decomposition which expresses a tensor as a sum of its rank-1 components. A common step in the computation of a CPD is computing a generalized eigenvalue decomposition (GEVD) of the…

Numerical Analysis · Mathematics 2021-12-16 Eric Evert , Michiel Vandecappelle , Lieven De Lathauwer