English
Related papers

Related papers: From computation to comparison of tensor decomposi…

200 papers

We present an algorithm for low rank decomposition of tensors of any symmetry type, from fully asymmetric to fully symmetric. It recovers the decomposition one summand at a time via the higher-order power method. This approach is known to…

Numerical Analysis · Mathematics 2026-05-22 Kexin Wang , João M. Pereira , Joe Kileel , Anna Seigal

Most popular word embedding techniques involve implicit or explicit factorization of a word co-occurrence based matrix into low rank factors. In this paper, we aim to generalize this trend by using numerical methods to factor higher-order…

Machine Learning · Statistics 2017-09-19 Eric Bailey , Shuchin Aeron

Higher-order tensors are becoming prevalent in many scientific areas such as computer vision, social network analysis, data mining and neuroscience. Traditional tensor decomposition approaches face three major challenges: model selecting,…

Numerical Analysis · Computer Science 2014-07-08 Fanhua Shang , Yuanyuan Liu , James Cheng

We introduce an algorithm to decide isomorphism between tensors. The algorithm uses the Lie algebra of derivations of a tensor to compress the space in which the search takes place to a so-called densor space. To make the method practicable…

Rings and Algebras · Mathematics 2022-08-19 Peter A. Brooksbank , Joshua Maglione , James B. Wilson

The tensor rank decomposition, or canonical polyadic decomposition, is the decomposition of a tensor into a sum of rank-1 tensors. The condition number of the tensor rank decomposition measures the sensitivity of the rank-1 summands with…

Numerical Analysis · Mathematics 2024-07-02 Carlos Beltrán , Paul Breiding , Nick Vannieuwenhoven

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to…

Machine Learning · Statistics 2022-06-15 Jan Decuyper , Koen Tiels , Siep Weiland , Mark C. Runacres , Johan Schoukens

We provide a computational framework for approximating a class of structured matrices; here, the term structure is very general, and may refer to a regular sparsity pattern (e.g., block-banded), or be more highly structured (e.g., symmetric…

Numerical Analysis · Mathematics 2021-05-05 Misha E. Kilmer , Arvind K. Saibaba

We give a robust version of the celebrated result of Kruskal on the uniqueness of tensor decompositions: we prove that given a tensor whose decomposition satisfies a robust form of Kruskal's rank condition, it is possible to approximately…

Data Structures and Algorithms · Computer Science 2013-05-01 Aditya Bhaskara , Moses Charikar , Aravindan Vijayaraghavan

This paper discusses the problem of symmetric tensor decomposition on a given variety $X$: decomposing a symmetric tensor into the sum of tensor powers of vectors contained in $X$. In this paper, we first study geometric and algebraic…

Numerical Analysis · Mathematics 2020-03-24 Jiawang Nie , Ke Ye , Lihong Zhi

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

It is easily checkable if a given tensor is a B tensor, or a B$_0$ tensor or not. In this paper, we show that a symmetric B tensor can always be decomposed to the sum of a strictly diagonally dominated symmetric M tensor and several…

Spectral Theory · Mathematics 2014-05-15 Liqun Qi , Yisheng Song

Let $T$ be a real tensor of (real) rank $r$. $T$ is 'identifiable' when it has a unique decomposition in terms of rank $1$ tensors. There are cases in which the identifiability fails over the complex field, for general tensors of rank $r$.…

Algebraic Geometry · Mathematics 2018-01-23 Elena Angelini , Cristiano Bocci , Luca Chiantini

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new…

Machine Learning · Statistics 2018-03-13 Jérémy E. Cohen , Nicolas Gillis

We study orthogonal decompositions of symmetric and ordinary tensors using methods from linear algebra. For the field of real numbers we show that the sets of decomposable tensors can be defined be equations of degree 2. This gives a new…

Rings and Algebras · Mathematics 2019-10-01 Pascal Koiran

Comon's conjecture on the equality of the rank and the symmetric rank of a symmetric tensor, and Strassen's conjecture on the additivity of the rank of tensors are two of the most challenging and guiding problems in the area of tensor…

Algebraic Geometry · Mathematics 2018-10-23 Alex Casarotti , Alex Massarenti , Massimiliano Mella

We introduce an inductive method for the study of the uniqueness of decompositions of tensors, by means of tensors of rank 1. The method is based on the geometric notion of weak defectivity. For three-dimensional tensors of type (a, b, c),…

Algebraic Geometry · Mathematics 2011-03-15 Luca Chiantini , Giorgio Ottaviani

A novel method for common and individual feature analysis from exceedingly large-scale data is proposed, in order to ensure the tractability of both the computation and storage and thus mitigate the curse of dimensionality, a major…

Signal Processing · Electrical Eng. & Systems 2017-11-03 Ilia Kisil , Giuseppe G. Calvi , Danilo P. Mandic

These lecture notes are intended as an introduction to several notions of tensor rank and their connections to the asymptotic complexity of matrix multiplication. The latter is studied with the exponent of matrix multiplication, which will…

Algebraic Geometry · Mathematics 2022-08-01 Giorgio Ottaviani , Philipp Reichenbach

We prove that multilinear (tensor) analogues of many efficiently computable problems in numerical linear algebra are NP-hard. Our list here includes: determining the feasibility of a system of bilinear equations, deciding whether a 3-tensor…

Computational Complexity · Computer Science 2013-07-02 Christopher Hillar , Lek-Heng Lim

The decoupling of multivariate functions is a powerful modeling paradigm for learning multivariate input-output relations from data. For the single-layer case, established CPD-based methods are available, but the multi-layer case remained…

Systems and Control · Electrical Eng. & Systems 2026-04-14 Joppe De Jonghe , Konstantin Usevich , Philippe Dreesen , Mariya Ishteva