English
Related papers

Related papers: Numerical CP Decomposition of Some Difficult Tenso…

200 papers

A novel algorithm is proposed for CANDECOMP/PARAFAC tensor decomposition to exploit best rank-1 tensor approximation. Different from the existing algorithms, our algorithm updates rank-1 tensors simultaneously in parallel. In order to…

Numerical Analysis · Computer Science 2017-09-26 Anh-Huy Phan , Petr Tichavský , Andrzej Cichocki

Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity…

Machine Learning · Computer Science 2015-05-20 Volodymyr Kuleshov , Arun Tejasvi Chaganty , Percy Liang

This paper proposes fast randomized algorithms for computing the Kronecker Tensor Decomposition (KTD). The proposed algorithms can decompose a given tensor into the KTD format much faster than the existing state-of-the-art algorithms. Our…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Andre L. F. de Almeida , Yipeng Liu

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

We study several variants of decomposing a symmetric matrix into a sum of a low-rank positive semidefinite matrix and a diagonal matrix. Such decompositions have applications in factor analysis and they have been studied for many decades.…

Optimization and Control · Mathematics 2023-10-02 Levent Tunçel , Stephen A. Vavasis , Jingye Xu

We consider the problem of finding the smallest or largest entry of a tensor of order N that is specified via its rank decomposition. Stated in a different way, we are given N sets of R-dimensional vectors and we wish to select one vector…

Signal Processing · Electrical Eng. & Systems 2023-12-25 Nicholas D. Sidiropoulos , Paris Karakasis , Aritra Konar

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

Tensor decomposition is an important technique for capturing the high-order interactions among multiway data. Multi-linear tensor composition methods, such as the Tucker decomposition and the CANDECOMP/PARAFAC (CP), assume that the complex…

Machine Learning · Statistics 2016-11-04 Bin Liu , Zenglin Xu , Yingming Li

An important building block in all current asymptotically fast algorithms for matrix multiplication are tensors with low border rank, that is, tensors whose border rank is equal or very close to their size. To find new asymptotically fast…

Computational Complexity · Computer Science 2016-08-25 Markus Bläser , Vladimir Lysikov

Low-rank Tucker and CP tensor decompositions are powerful tools in data analytics. The widely used alternating least squares (ALS) method, which solves a sequence of over-determined least squares subproblems, is costly for large and sparse…

Numerical Analysis · Mathematics 2021-08-26 Linjian Ma , Edgar Solomonik

Motivated by connections between algebraic complexity lower bounds and tensor decompositions, we investigate Koszul-Young flattenings, which are the main ingredient in recent lower bounds for matrix multiplication. Based on this tool we…

Data Structures and Algorithms · Computer Science 2025-10-27 Pravesh K. Kothari , Ankur Moitra , Alexander S. Wein

This paper discusses the problem of symmetric tensor decomposition on a given variety $X$: decomposing a symmetric tensor into the sum of tensor powers of vectors contained in $X$. In this paper, we first study geometric and algebraic…

Numerical Analysis · Mathematics 2020-03-24 Jiawang Nie , Ke Ye , Lihong Zhi

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

A tensor is a multi-way array that can represent, in addition to a data set, the expression of a joint law or a multivariate function. As such it contains the description of the interactions between the variables corresponding to each of…

Numerical Analysis · Mathematics 2022-01-20 Alain Franc

This paper analyses a Waring type decomposition of a noncommuting (NC) polynomial $p$ with respect to the goal of evaluating $p$ efficiently on tuples of matrices. Such a decomposition can reduce the number of matrix multiplications needed…

Functional Analysis · Mathematics 2022-02-24 Eric Evert , J. William Helton , Shiyuan Huang , Jiawang Nie

This paper introduces a novel general-purpose algorithm for Pauli decomposition that employs matrix slicing and addition rather than expensive matrix multiplication, significantly accelerating the decomposition of multi-qubit matrices. In a…

Quantum Physics · Physics 2024-09-25 Lukas Hantzko , Lennart Binkowski , Sabhyata Gupta

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada

Completely positive (CP) tensors, which correspond to a generalization of CP matrices, allow to reformulate or approximate a general polynomial optimization problem (POP) with a conic optimization problem over the cone of CP tensors.…

Optimization and Control · Mathematics 2018-08-22 Xiaolong Kuang , Luis F. Zuluaga

In applications where the tensor rank decomposition arises, one often relies on its identifiability properties for interpreting the individual rank-$1$ terms appearing in the decomposition. Several criteria for identifiability have been…

Algebraic Geometry · Mathematics 2022-09-02 Luca Chiantini , Giorgio Ottaviani , Nick Vannieuwenhoven

This paper introduces a randomized variation of the alternating least squares (ALS) algorithm for rank reduction of canonical tensor formats. The aim is to address the potential numerical ill-conditioning of least squares matrices at each…

Numerical Analysis · Mathematics 2015-10-07 Matthew Reynolds , Alireza Doostan , Gregory Beylkin