English
Related papers

Related papers: Provable Near-Optimal Low-Multilinear-Rank Tensor …

200 papers

We analyze low rank tensor completion (TC) using noisy measurements of a subset of the tensor. Assuming a rank-$r$, order-$d$, $N \times N \times \cdots \times N$ tensor where $r=O(1)$, the best sampling complexity that was achieved is…

Machine Learning · Computer Science 2017-11-15 Navid Ghadermarzy , Yaniv Plan , Özgür Yılmaz

Low rank matrix recovery problems, including matrix completion and matrix sensing, appear in a broad range of applications. In this work we present GNMR -- an extremely simple iterative algorithm for low rank matrix recovery, based on a…

Optimization and Control · Mathematics 2022-04-28 Pini Zilber , Boaz Nadler

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

We consider the problem of low rank matrix recovery in a stochastically noisy high dimensional setting. We propose a new estimator for the low rank matrix, based on the iterative hard thresholding method, and that is computationally…

Statistics Theory · Mathematics 2016-03-02 Alexandra Carpentier , Arlene K. H. Kim

We investigate the low-rank tensor recovery problem using a relaxation of the nuclear p-norm by theta bodies. We provide algebraic descriptions of the norms and compute their Gr\"obner bases. Moreover, we develop geometric properties of…

Optimization and Control · Mathematics 2025-04-15 Felix Röhrich , Yuhuai Zhou

In this paper, we consider the estimation of a low Tucker rank tensor from a number of noisy linear measurements. The general problem covers many specific examples arising from applications, including tensor regression, tensor completion,…

Machine Learning · Statistics 2023-07-11 Yuetian Luo , Anru R. Zhang

A numerical algorithm to decompose an exact low-rank skew-symmetric tensor into a sum of elementary (rank-$1$) skew-symmetric tensors is introduced. The algorithm uncovers this Grassmann decomposition based on linear relations that are…

Numerical Analysis · Mathematics 2026-01-27 Nick Vannieuwenhoven

Higher-order low-rank tensor arises in many data processing applications and has attracted great interests. Inspired by low-rank approximation theory, researchers have proposed a series of effective tensor completion methods. However, most…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Haijin Zeng , Xiaozhen Xie , Jifeng Ning

We propose new Riemannian preconditioned algorithms for low-rank tensor completion via the polyadic decomposition of a tensor. These algorithms exploit a non-Euclidean metric on the product space of the factor matrices of the low-rank…

Optimization and Control · Mathematics 2022-06-06 Shuyu Dong , Bin Gao , Yu Guan , François Glineur

This paper considers the problem of recovering a tensor with an underlying low-tubal-rank structure from a small number of corrupted linear measurements. Traditional approaches tackling such a problem require the computation of tensor…

Machine Learning · Computer Science 2025-01-13 Zhiyu Liu , Zhi Han , Yandong Tang , Xi-Le Zhao , Yao Wang

We give new and efficient black-box reconstruction algorithms for some classes of depth-$3$ arithmetic circuits. As a consequence, we obtain the first efficient algorithm for computing the tensor rank and for finding the optimal tensor…

Computational Complexity · Computer Science 2021-05-06 Vishwas Bhargava , Shubhangi Saraf , Ilya Volkovich

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

This paper is concerned with the low Tucker-rank tensor completion problem, which is about reconstructing a tensor $ T \in\mathbb{R}^{n\times n \times n}$ of low multilinear rank from partially observed entries. Riemannian optimization…

Optimization and Control · Mathematics 2023-08-03 Haifeng Wang , Jinchi Chen , Ke Wei

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

Machine Learning · Computer Science 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

A tensor nuclear norm (TNN) based method for solving the tensor recovery problem was recently proposed, and it has achieved state-of-the-art performance. However, it may fail to produce a highly accurate solution since it tends to treats…

Optimization and Control · Mathematics 2022-05-13 Quan Yu

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

We propose a new numerical algorithm for computing the tensor rank decomposition or canonical polyadic decomposition of higher-order tensors subject to a rank and genericity constraint. Reformulating this computational problem as a system…

Numerical Analysis · Mathematics 2024-07-02 Simon Telen , Nick Vannieuwenhoven

This paper explores robust recovery of a superposition of $R$ distinct complex exponential functions from a few random Gaussian projections. We assume that the signal of interest is of $2N-1$ dimensional and $R<<2N-1$. This framework covers…

Information Theory · Computer Science 2015-03-11 Jian-Feng Cai , Xiaobo Qu , Weiyu Xu , Gui-Bo Ye

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi