English
Related papers

Related papers: Low-M-Rank Tensor Completion and Robust Tensor PCA

200 papers

The nuclear norm and Schatten-$p$ quasi-norm are popular rank proxies in low-rank matrix recovery. However, computing the nuclear norm or Schatten-$p$ quasi-norm of a tensor is hard in both theory and practice, hindering their application…

Machine Learning · Computer Science 2023-10-19 Jicong Fan , Lijun Ding , Chengrun Yang , Zhao Zhang , Madeleine Udell

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

We propose a new tensor completion method based on tensor trains. The to-be-completed tensor is modeled as a low-rank tensor train, where we use the known tensor entries and their coordinates to update the tensor train. A novel tensor train…

Numerical Analysis · Computer Science 2018-11-14 Ching-Yun Ko , Kim Batselier , Wenjian Yu , Ngai Wong

Robust matrix completion aims to recover a low-rank matrix from a subset of noisy entries perturbed by complex noises, where traditional methods for matrix completion may perform poorly due to utilizing $l_2$ error norm in optimization. In…

Information Theory · Computer Science 2020-02-19 Yicong He , Fei Wang , Yingsong Li , Jing Qin , Badong Chen

Principal component analysis (PCA) requires the computation of a low-rank approximation to a matrix containing the data being analyzed. In many applications of PCA, the best possible accuracy of any rank-deficient approximation is at most a…

Computation · Statistics 2010-06-04 Vladimir Rokhlin , Arthur Szlam , Mark Tygert

This paper studies the rank-1 tensor completion problem for cubic tensors when there are noises for observed tensor entries. First, we propose a robust biquadratic optimization model for obtaining rank-1 completing tensors. When the…

Optimization and Control · Mathematics 2025-04-02 Jiawang Nie , Xindong Tang , Jinling Zhou

Multiple network alignment is the problem of identifying similar and related regions in a given set of networks. While there are a large number of effective techniques for pairwise problems with two networks that scale in terms of edges,…

Social and Information Networks · Computer Science 2018-09-24 Huda Nassar , Georgios Kollias , Ananth Grama , David F. Gleich

The (efficient and parsimonious) decomposition of higher-order tensors is a fundamental problem with numerous applications in a variety of fields. Several methods have been proposed in the literature to that end, with the Tucker and PARAFAC…

General Mathematics · Mathematics 2024-06-28 Sergio Rozada , Antonio G. Marques

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

We propose an adaptive and provably accurate tensor completion approach based on combining matrix completion techniques (see, e.g., arXiv:0805.4471, arXiv:1407.3619, arXiv:1306.2979) for a small number of slices with a modified noise robust…

Numerical Analysis · Mathematics 2023-07-06 Cullen Haselby , Santhosh Karnik , Mark Iwen

We consider the problem of low-rank rectangular matrix completion in the regime where the matrix $M$ of size $n\times m$ is ``long", i.e., the aspect ratio $m/n$ diverges to infinity. Such matrices are of particular interest in the study of…

Statistics Theory · Mathematics 2024-06-24 Ludovic Stephan , Yizhe Zhu

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

Tensor networks developed in the context of condensed matter physics try to approximate order-$N$ tensors with a reduced number of degrees of freedom that is only polynomial in $N$ and arranged as a network of partially contracted smaller…

Machine Learning · Computer Science 2025-01-07 Hao Chen , Thomas Barthel

Matrix completion, the problem of completing missing entries in a data matrix with low dimensional structure (such as rank), has seen many fruitful approaches and analyses. Tensor completion is the tensor analog, that attempts to impute…

Numerical Analysis · Mathematics 2021-07-07 Zehan Chao , Longxiu Huang , Deanna Needell

Tensor robust principal component analysis (RPCA), which seeks to separate a low-rank tensor from its sparse corruptions, has been crucial in data science and machine learning where tensor structures are becoming more prevalent. While…

Machine Learning · Statistics 2022-12-23 Harry Dong , Megna Shah , Sean Donegan , Yuejie Chi

There has been continued interest in seeking a theorem describing optimal low-rank approximations to tensors of order 3 or higher, that parallels the Eckart-Young theorem for matrices. In this paper, we argue that the naive approach to this…

Numerical Analysis · Mathematics 2008-04-01 Vin de Silva , Lek-Heng Lim

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical…

Numerical Analysis · Mathematics 2019-08-23 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We study robust PCA for the fully observed setting, which is about separating a low rank matrix $\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from their sum $\boldsymbol{D}=\boldsymbol{L}+\boldsymbol{S}$. In this paper, a new…

Information Theory · Computer Science 2021-06-29 HanQin Cai , Jian-Feng Cai , Ke Wei

The aim of this paper is to present a mathematical framework for tensor PCA. The proposed approach is able to overcome the limitations of previous methods that extract a low dimensional subspace by iteratively solving an optimization…

Numerical Analysis · Mathematics 2024-10-28 Claudio Turchetti , Laura Falaschetti

Recent approaches to the tensor completion problem have often overlooked the nonnegative structure of the data. We consider the problem of learning a nonnegative low-rank tensor, and using duality theory, we propose a novel factorization of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Tanmay Kumar Sinha , Jayadev Naram , Pawan Kumar