English
Related papers

Related papers: Pencil-based algorithms for tensor rank decomposit…

200 papers

A well studied problem in algebraic complexity theory is the determination of the complexity of problems relying on evaluations of bilinear maps. One measure of the complexity of a bilinear map (or 3-tensor) is the optimal number of…

Information Theory · Computer Science 2021-03-23 Eimear Byrne , Giuseppe Cotardo

We give a sufficient criterion for a lower bound of the cactus rank of a tensor. Then we refine that criterion in order to be able to give an explicit sufficient condition for a non-redundant decomposition of a tensor to be minimal and…

Algebraic Geometry · Mathematics 2017-05-08 Edoardo Ballico , Alessandra Bernardi , Luca Chiantini , Elena Guardo

We consider the problem of recovering an orthogonally decomposable tensor with a subset of elements distorted by noise with arbitrarily large magnitude. We focus on the particular case where each mode in the decomposition is corrupted by…

Numerical Analysis · Mathematics 2021-02-22 Oscar Mickelin , Sertac Karaman

The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper…

Other Computer Science · Computer Science 2008-02-19 P. Comon , J. ten Berge

In intelligent transportation systems, traffic data imputation, estimating the missing value from partially observed data is an inevitable and challenging task. Previous studies have not fully considered traffic data's multidimensionality…

Machine Learning · Statistics 2023-11-01 Wenwu Gong , Zhejun Huang , Lili Yang

There are several different notions of "low rank" for tensors, associated to different formats. Among them, the Tensor Train (TT) format is particularly well suited for tensors of high order, as it circumvents the curse of dimensionality:…

Optimization and Control · Mathematics 2020-11-30 Michael Psenka , Nicolas Boumal

The tensor network representation of many-body quantum states, given by local tensors, provides a promising numerical tool for the study of strongly correlated topological phases in two dimension. However, tensor network representations may…

Strongly Correlated Electrons · Physics 2018-09-12 Sujeet K. Shukla , M. Burak Şahinoğlu , Frank Pollmann , Xie Chen

Large language models have become ubiquitous in modern life, finding applications in various domains such as natural language processing, language translation, and speech recognition. Recently, a breakthrough work [Zhao, Panigrahi, Ge, and…

Data Structures and Algorithms · Computer Science 2023-04-14 Yichuan Deng , Yeqi Gao , Zhao Song

The theory and computation of tensors with different tensor products play increasingly important roles in scientific computing and machine learning. Different products aim to preserve different algebraic properties from the matrix algebra,…

In [13], Hillar and Lim famously demonstrated that "multilinear (tensor) analogues of many efficiently computable problems in numerical linear algebra are NP-hard". Despite many recent advancements, the state-of-the-art methods for…

Optimization and Control · Mathematics 2016-11-08 Bo Jiang , Fan Yang , Shuzhong Zhang

In applications where the tensor rank decomposition arises, one often relies on its identifiability properties for interpreting the individual rank-$1$ terms appearing in the decomposition. Several criteria for identifiability have been…

Algebraic Geometry · Mathematics 2022-09-02 Luca Chiantini , Giorgio Ottaviani , Nick Vannieuwenhoven

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

Dimensionality reduction is an essential technique for multi-way large-scale data, i.e., tensor. Tensor ring (TR) decomposition has become popular due to its high representation ability and flexibility. However, the traditional TR…

Numerical Analysis · Mathematics 2024-12-20 Longhao Yuan , Chao Li , Jianting Cao , Qibin Zhao

The (efficient and parsimonious) decomposition of higher-order tensors is a fundamental problem with numerous applications in a variety of fields. Several methods have been proposed in the literature to that end, with the Tucker and PARAFAC…

General Mathematics · Mathematics 2024-06-28 Sergio Rozada , Antonio G. Marques

In previous work, theoretical analysis based on the tensor Restricted Isometry Property (t-RIP) established the robust recovery guarantees of a low-tubal-rank tensor. The obtained sufficient conditions depend strongly on the assumption that…

Machine Learning · Statistics 2019-09-17 Feng Zhang , Wendong Wang , Jingyao Hou , Jianjun Wang , Jianwen Huang

Tensors are often compressed by expressing them in low rank tensor formats. In this paper, we develop three methodologies that bound the compressibility of a tensor: (1) Algebraic structure, (2) Smoothness, and (3) Displacement structure.…

Numerical Analysis · Mathematics 2020-02-04 Tianyi Shi , Alex Townsend

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

We prove a generalization to Jennrich's uniqueness theorem for tensor decompositions in the undercomplete setting. Our uniqueness theorem is based on an alternative definition of the standard tensor decomposition, which we call…

Computational Complexity · Computer Science 2025-10-31 Pascal Koiran , Rafael Oliveira

This work introduces a tensor-based method to perform supervised classification on spatiotemporal data processed in an echo state network. Typically when performing supervised classification tasks on data processed in an echo state network,…

Machine Learning · Computer Science 2017-08-25 Ashley Prater

We present an efficient low-rank approximation algorithm for non-negative tensors. The algorithm is derived from our two findings: First, we show that rank-1 approximation for tensors can be viewed as a mean-field approximation by treating…

Machine Learning · Statistics 2021-10-26 Kazu Ghalamkari , Mahito Sugiyama