English
Related papers

Related papers: On Polynomial Time Methods for Exact Low Rank Tens…

200 papers

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng

We study low rank approximation of tensors, focusing on the tensor train and Tucker decompositions, as well as approximations with tree tensor networks and more general tensor networks. For tensor train decomposition, we give a bicriteria…

Data Structures and Algorithms · Computer Science 2023-11-28 Arvind V. Mahankali , David P. Woodruff , Ziyu Zhang

This paper focuses on recovering a low-rank tensor from its incomplete measurements. We propose a novel algorithm termed the Single Mode Quasi Riemannian Gradient Descent (SM-QRGD). By exploiting the benefits of both fixed-rank matrix…

Optimization and Control · Mathematics 2024-01-30 Yuanwei Zhang , Ya-Nan Zhu , Xiaoqun Zhang

In this paper we present the first known deterministic algorithm for the construction of multiple rank-1 lattices for the approximation of periodic functions of many variables. The algorithm works by converting a potentially large…

Numerical Analysis · Mathematics 2020-03-24 Craig Gross , Mark A. Iwen , Lutz Kämmerer , Toni Volkmer

We introduce Wedge Sampling, a new non-adaptive sampling scheme for low-rank tensor completion. We study recovery of an order-$k$ low-rank tensor of dimension $n \times \cdots \times n$ from a subset of its entries. Unlike the standard…

Machine Learning · Statistics 2026-02-06 Hengrui Luo , Anna Ma , Ludovic Stephan , Yizhe Zhu

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

A tensor nuclear norm (TNN) based method for solving the tensor recovery problem was recently proposed, and it has achieved state-of-the-art performance. However, it may fail to produce a highly accurate solution since it tends to treats…

Optimization and Control · Mathematics 2022-05-13 Quan Yu

We present an algorithm for decomposing a symmetric tensor, of dimension n and order d as a sum of rank-1 symmetric tensors, extending the algorithm of Sylvester devised in 1886 for binary forms. We recall the correspondence between the…

Symbolic Computation · Computer Science 2010-11-29 Jerome Brachat , Pierre Comon , Bernard Mourrain , Elias Tsigaridas

Sparse and low rank tensor recovery has emerged as a significant area of research with applications in many fields such as computer vision. However, minimizing the $\ell_0$-norm of a vector or the rank of a matrix is NP-hard. Instead, their…

Optimization and Control · Mathematics 2024-04-23 Katherine Henneberger , Jing Qin

We study the problem of obtaining efficient, deterministic, black-box polynomial identity testing algorithms for depth-3 set-multilinear circuits (over arbitrary fields). This class of circuits has an efficient, deterministic, white-box…

Computational Complexity · Computer Science 2012-12-03 Michael A. Forbes , Amir Shpilka

We consider the rank minimization problem from quadratic measurements, i.e., recovering a rank $r$ matrix $X \in \mathbb{R}^{n \times r}$ from $m$ scalar measurements $y_i=a_i^{\top} XX^{\top} a_i,\;a_i\in \mathbb{R}^n,\;i=1,\ldots,m$. Such…

Numerical Analysis · Mathematics 2018-06-05 Meng Huang , Zhiqiang Xu

We present an algorithm for low rank decomposition of tensors of any symmetry type, from fully asymmetric to fully symmetric. It recovers the decomposition one summand at a time via the higher-order power method. This approach is known to…

Numerical Analysis · Mathematics 2026-05-22 Kexin Wang , João M. Pereira , Joe Kileel , Anna Seigal

We present an $O^*(|\mathbb{F}|^{\min\left\{R,\ \sum_{d\ge 2} n_d\right\} + (R-n_0)(\sum_{d\ne 0} n_d)})$-time algorithm for determining whether the rank of a concise tensor $T\in\mathbb{F}^{n_0\times\dots\times n_{D-1}}$ is $\le R$,…

Computational Complexity · Computer Science 2025-02-19 Jason Yang

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

We present deterministic algorithms for the uniform recovery of $d$-variate rank one tensors from function values. These tensors are given as product of $d$ univariate functions whose $r$th weak derivative is bounded by $M$. The recovery…

Numerical Analysis · Mathematics 2018-08-21 David Krieg , Daniel Rudolf

In this paper, we investigate effective sketching schemes via sparsification for high dimensional multilinear arrays or tensors. More specifically, we propose a novel tensor sparsification algorithm that retains a subset of the entries of a…

Methodology · Statistics 2017-11-17 Dong Xia , Ming Yuan

Low rank tensor ring model is powerful for image completion which recovers missing entries in data acquisition and transformation. The recently proposed tensor ring (TR) based completion algorithms generally solve the low rank optimization…

Machine Learning · Statistics 2021-04-07 Zhen Long , Ce Zhu , Jiani Liu , Yipeng Liu

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

This work presents a comprehensive understanding of the estimation of a planted low-rank signal from a general spiked tensor model near the computational threshold. Relying on standard tools from the theory of large random matrices, we…

Machine Learning · Statistics 2025-01-15 Hugo Lebeau , Florent Chatelain , Romain Couillet