English
Related papers

Related papers: Tensor Decomposition for Signal Processing and Mac…

200 papers

The paper surveys the topic of tensor decompositions in modern machine learning applications. It focuses on three active research topics of significant relevance for the community. After a brief review of consolidated works on multi-way…

Machine Learning · Computer Science 2020-02-28 Davide Bacciu , Danilo P. Mandic

Tensor networks are a compressed format for multi-dimensional data. One-dimensional tensor networks -- often referred to as tensor trains (TT) or matrix product states (MPS) -- are increasingly being used as a numerical ansatz for continuum…

Quantum Physics · Physics 2025-12-09 Joseph Tindall , E. Miles Stoudenmire , Ryan Levy

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA),…

Numerical Analysis · Computer Science 2013-05-03 Andrzej Cichocki

Tensor networks are a class of algorithms aimed at reducing the computational complexity of high-dimensional problems. They are used in an increasing number of applications, from quantum simulations to machine learning. Exploiting data…

Numerical Analysis · Mathematics 2024-10-25 Melven Röhrig-Zöllner , Manuel Joey Becklas , Jonas Thies , Achim Basermann

Tensors of order three or higher have found applications in diverse fields, including image and signal processing, data mining, biomedical engineering and link analysis, to name a few. In many applications that involve for example time…

Data Structures and Algorithms · Computer Science 2018-09-05 Davoud Ataee Tarzanagh , George Michailidis

We discuss how recently discovered techniques and tools from compressed sensing can be used in tensor decompositions, with a view towards modeling signals from multiple arrays of multiple sensors. We show that with appropriate bounds on a…

Numerical Analysis · Mathematics 2015-05-18 Lek-Heng Lim , Pierre Comon

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Tensor decomposition is an important technique for capturing the high-order interactions among multiway data. Multi-linear tensor composition methods, such as the Tucker decomposition and the CANDECOMP/PARAFAC (CP), assume that the complex…

Machine Learning · Statistics 2016-11-04 Bin Liu , Zenglin Xu , Yingming Li

Tensor decomposition plays a key role in identifying common features across a collection of matrices in many areas of science. A fundamental need in big data research is to process data tabulated as large-scale matrices using eigenvectors.…

Computational Engineering, Finance, and Science · Computer Science 2016-05-24 HyungSeon Oh

Tensor networks provide extremely powerful tools for the study of complex classical and quantum many-body problems. Over the last two decades, the increment in the number of techniques and applications has been relentless, and especially…

Quantum Physics · Physics 2023-03-29 Mari Carmen Bañuls

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

This work considers the notion of random tensors and reviews some fundamental concepts in statistics when applied to a tensor based data or signal. In several engineering fields such as Communications, Signal Processing, Machine learning,…

Statistics Theory · Mathematics 2024-04-24 Divyanshu Pandey , Alexis Decurninge , Harry Leib

Low rank tensor decompositions are a powerful tool for learning generative models, and uniqueness results give them a significant advantage over matrix decomposition methods. However, tensors pose significant algorithmic challenges and…

Data Structures and Algorithms · Computer Science 2014-01-21 Aditya Bhaskara , Moses Charikar , Ankur Moitra , Aravindan Vijayaraghavan

The analysis and visualization of tensor fields is a very challenging task. Besides the cases of zeroth- and first-order tensors, most techniques focus on symmetric second-order tensors. Only a few works concern totally symmetric tensors of…

General Mathematics · Mathematics 2020-09-25 Chiara Hergl , Thomas Nagel , Gerik Scheuermann

Tensor Network (TN) decompositions have emerged as an indispensable tool in Big Data analytics owing to their ability to provide compact low-rank representations, thus alleviating the ``Curse of Dimensionality'' inherent in handling…

Machine Learning · Computer Science 2025-07-15 Wuyang Zhou , Giorgos Iacovides , Kriton Konstantinidis , Ilya Kisil , Danilo Mandic

Tensors naturally model many real world processes which generate multi-aspect data. Such processes appear in many different research disciplines, e.g, chemometrics, computer vision, psychometrics and neuroimaging analysis. Tensor…

Data Structures and Algorithms · Computer Science 2009-09-29 Charalampos E. Tsourakakis

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper…

Other Computer Science · Computer Science 2008-02-19 P. Comon , J. ten Berge

Tensors in the form of multilinear arrays are ubiquitous in data science applications. Captured real-world data, including video, hyperspectral images, and discretized physical systems, naturally occur as tensors and often come with…

Machine Learning · Computer Science 2023-03-13 Jonathan Gryak , Kayvan Najarian , Harm Derksen

In problems involving approximation, completion, denoising, dimension reduction, estimation, interpolation, modeling, order reduction, regression, etc, we argue that the near-universal practice of assuming that a function, matrix, or tensor…

Numerical Analysis · Mathematics 2019-02-12 Ke Ye , Lek-Heng Lim