English
Related papers

Related papers: Tensor Reconstruction Beyond Constant Rank

200 papers

We consider the problem of recovering a low-multilinear-rank tensor from a small amount of linear measurements. We show that the Riemannian gradient algorithm initialized by one step of iterative hard thresholding can reconstruct an…

Numerical Analysis · Mathematics 2021-01-14 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

We prove the existence of an open set of $n_1\times n_2 \times n_3$ tensors of rank $r$ on which a popular and efficient class of algorithms for computing tensor rank decompositions based on a reduction to a linear matrix pencil, typically…

Numerical Analysis · Mathematics 2022-09-02 Carlos Beltrán , Paul Breiding , Nick Vannieuwenhoven

We present the first deterministic, finite-step algorithm for exact tensor ring (TR) decomposition, addressing an open question about the existence of such procedures. Our method leverages blockwise simultaneous diagonalization to recover…

Numerical Analysis · Mathematics 2025-12-02 Han Chen , Sitan Chen , Anru R. Zhang

Generalizing work of K\"unnemann, Paturi, and Schneider [ICALP 2017], we study a wide class of high-dimensional dynamic programming (DP) problems in which one must find the shortest path between two points in a high-dimensional grid given a…

Computational Complexity · Computer Science 2024-01-03 Josh Alman , Ethan Turok , Hantao Yu , Hengzhi Zhang

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

Machine Learning · Computer Science 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

Sparse and low rank tensor recovery has emerged as a significant area of research with applications in many fields such as computer vision. However, minimizing the $\ell_0$-norm of a vector or the rank of a matrix is NP-hard. Instead, their…

Optimization and Control · Mathematics 2024-04-23 Katherine Henneberger , Jing Qin

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

We obtain the first polynomial-time algorithm for exact tensor completion that improves over the bound implied by reduction to matrix completion. The algorithm recovers an unknown 3-tensor with $r$ incoherent, orthogonal components in…

Machine Learning · Computer Science 2017-06-27 Aaron Potechin , David Steurer

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new…

Numerical Analysis · Mathematics 2023-08-16 Alec Dektor , Daniele Venturi

We study symmetric tensor decompositions, i.e. decompositions of the input symmetric tensor T of order 3 as sum of r 3rd-order tensor powers of u_i where u_i are vectors in \C^n. In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

We develop fast spectral algorithms for tensor decomposition that match the robustness guarantees of the best known polynomial-time algorithms for this problem based on the sum-of-squares (SOS) semidefinite programming hierarchy. Our…

Machine Learning · Computer Science 2017-06-28 Tselil Schramm , David Steurer

In this paper, we propose a novel model to recover a low-rank tensor by simultaneously performing double nuclear norm regularized low-rank matrix factorizations to the all-mode matricizations of the underlying tensor. An block successive…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

Tensors of order three or higher have found applications in diverse fields, including image and signal processing, data mining, biomedical engineering and link analysis, to name a few. In many applications that involve for example time…

Data Structures and Algorithms · Computer Science 2018-09-05 Davoud Ataee Tarzanagh , George Michailidis

DeepTensor is a computationally efficient framework for low-rank decomposition of matrices and tensors using deep generative networks. We decompose a tensor as the product of low-rank tensor factors (e.g., a matrix as the outer product of…

In the tensor completion problem, one seeks to estimate a low-rank tensor based on a random sample of revealed entries. In terms of the required sample size, earlier work revealed a large gap between estimation with unbounded computational…

Data Structures and Algorithms · Computer Science 2016-12-26 Andrea Montanari , Nike Sun

We give algorithms to compute decompositions of a given polynomial, or more generally mixed tensor, as sum of rank one tensors, and to establish whether such a decomposition is unique. In particular, we present methods to compute the…

Algebraic Geometry · Mathematics 2021-07-12 Antonio Laface , Alex Massarenti , Rick Rischter

We study the low-rank phase retrieval problem, where the objective is to recover a sequence of signals (typically images) given the magnitude of linear measurements of those signals. Existing solutions involve recovering a matrix…

Image and Video Processing · Electrical Eng. & Systems 2022-02-18 Soo Min Kwon , Xin Li , Anand D. Sarwate

Despite their high accuracy, complex neural networks demand significant computational resources, posing challenges for deployment on resource constrained devices such as mobile phones and embedded systems. Compression algorithms have been…

Machine Learning · Computer Science 2025-09-23 Ali Aghababaei-Harandi , Massih-Reza Amini

In this paper we present the first known deterministic algorithm for the construction of multiple rank-1 lattices for the approximation of periodic functions of many variables. The algorithm works by converting a potentially large…

Numerical Analysis · Mathematics 2020-03-24 Craig Gross , Mark A. Iwen , Lutz Kämmerer , Toni Volkmer