English
Related papers

Related papers: Rank-1 Tensor Approximation Methods and Applicatio…

200 papers

We present an orthogonal matrix outer product decomposition for the fourth-order conjugate partial-symmetric (CPS) tensor and show that the greedy successive rank-one approximation (SROA) algorithm can recover this decomposition exactly.…

Numerical Analysis · Mathematics 2021-11-08 Amina Sabir , Pegnfei Huang , Qingzhi Yang

In this paper, the canonical polyadic (CP) decomposition of tensors that corresponds to matrix multiplications is studied. Finding the rank of these tensors and computing the decompositions is a fundamental problem of algebraic complexity…

Computational Complexity · Computer Science 2021-04-13 Petr Tichavsky

We propose a block coordinate descent type algorithm for estimating the rank of a given tensor. In addition, the algorithm provides the canonical polyadic decomposition of a tensor. In order to estimate the tensor rank we use sparse…

Numerical Analysis · Mathematics 2019-04-30 Ramin Goudarzi Karim , Carmeliza Navasca , Da Yan

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada

We give reconstruction algorithms for subclasses of depth-3 arithmetic circuits. In particular, we obtain the first efficient algorithm for finding tensor rank, and an optimal tensor decomposition as a sum of rank-one tensors, when given…

Computational Complexity · Computer Science 2022-09-12 Shir Peleg , Amir Shpilka , Ben Lee Volk

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness…

Machine Learning · Computer Science 2017-04-20 Miaoyan Wang , Yun S. Song

Tensor methods are among the most prominent tools for the numerical solution of high-dimensional problems where functions of multiple variables have to be approximated. These methods exploit the tensor structure of function spaces and apply…

Numerical Analysis · Mathematics 2021-02-01 Anthony Nouy

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

In the present work, a method is proposed in order to compute a Canonical Polyadic (CP) approximation of a given tensor. It is based on a greedy method and an adaptation of the TT-SVD method. The proposed approach can be straightforwardly…

Numerical Analysis · Mathematics 2020-11-20 Virginie Ehrlacher , Maria Fuente Ruiz , Damiano Lombardi

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new…

Numerical Analysis · Mathematics 2023-08-16 Alec Dektor , Daniele Venturi

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

The CANDECOMP/PARAFAC (CP) tensor decomposition is a popular dimensionality-reduction method for multiway data. Dimensionality reduction is often sought after since many high-dimensional tensors have low intrinsic rank relative to the…

Numerical Analysis · Computer Science 2020-03-16 N. Benjamin Erichson , Krithika Manohar , Steven L. Brunton , J. Nathan Kutz

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

Low rank orthogonal tensor approximation (LROTA) is an important problem in tensor computations and their applications. A classical and widely used algorithm is the alternating polar decomposition method (APD). In this article, an improved…

Optimization and Control · Mathematics 2020-01-01 Shenglong Hu , Ke Ye

The widespread use of multisensor technology and the emergence of big datasets have created the need to develop tools to reduce, approximate, and classify large and multimodal data such as higher-order tensors. While early approaches…

Numerical Analysis · Computer Science 2018-07-03 Alp Ozdemir , Ali Zare , Mark A. Iwen , Selin Aviyente

The canonical polyadic decomposition (CPD) is a compact decomposition which expresses a tensor as a sum of its rank-1 components. A common step in the computation of a CPD is computing a generalized eigenvalue decomposition (GEVD) of the…

Numerical Analysis · Mathematics 2021-12-16 Eric Evert , Michiel Vandecappelle , Lieven De Lathauwer