English
Related papers

Related papers: Nonconvex Low-Rank Tensor Completion from Noisy Da…

200 papers

Large-scale nonsmooth optimization problems arise in many real-world applications, but obtaining exact function and subgradient values for these problems may be computationally expensive or even infeasible. In many practical settings, only…

Optimization and Control · Mathematics 2026-04-10 Jenni Lampainen , Kaisa Joki , Napsu Karmitsa , Marko M. Mäkelä

We analyze low rank tensor completion (TC) using noisy measurements of a subset of the tensor. Assuming a rank-$r$, order-$d$, $N \times N \times \cdots \times N$ tensor where $r=O(1)$, the best sampling complexity that was achieved is…

Machine Learning · Computer Science 2017-11-15 Navid Ghadermarzy , Yaniv Plan , Özgür Yılmaz

We consider the problem of noisy 1-bit matrix completion under an exact rank constraint on the true underlying matrix $M^*$. Instead of observing a subset of the noisy continuous-valued entries of a matrix $M^*$, we observe a subset of…

Machine Learning · Statistics 2015-02-25 Sonia Bhaskar , Adel Javanmard

We consider the problem of noiseless and noisy low-rank tensor completion from a set of random linear measurements. In our derivations, we assume that the entries of the tensor belong to a finite field of arbitrary size and that…

Information Theory · Computer Science 2011-04-05 Amin Emad , Olgica Milenkovic

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

We consider a problem of significant practical importance, namely, the reconstruction of a low-rank data matrix from a small subset of its entries. This problem appears in many areas such as collaborative filtering, computer vision and…

Machine Learning · Computer Science 2009-11-04 Raghunandan H. Keshavan , Andrea Montanari , Sewoong Oh

This paper studies the Tensor Robust Principal Component (TRPCA) problem which extends the known Robust PCA (Candes et al. 2011) to the tensor case. Our model is based on a new tensor Singular Value Decomposition (t-SVD) (Kilmer and Martin…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Canyi Lu , Jiashi Feng , Yudong Chen , Wei Liu , Zhouchen Lin , Shuicheng Yan

This paper considers the completion problem for a tensor (also referred to as a multidimensional array) from limited sampling. Our greedy method is based on extending the low-rank approximation pursuit (LRAP) method for matrix completions…

Numerical Analysis · Mathematics 2020-04-21 An-Bao Xu

This work studies the Tensor Robust Principal Component Analysis (TRPCA) problem, which aims to exactly recover the low-rank and sparse components from their sum. Our model is motivated by the recently proposed linear transforms based…

Machine Learning · Computer Science 2019-07-22 Canyi Lu , Pan Zhou

The problem of tensor completion has applications in healthcare, computer vision, and other domains. However, past approaches to tensor completion have faced a tension in that they either have polynomial-time computation but require…

Machine Learning · Computer Science 2024-03-21 Wenhao Pan , Anil Aswani , Chen Chen

We study stochastic nonconvex optimization under heavy-tailed noise. In this setting, the stochastic gradients only have bounded $p$-th central moment ($p$-BCM) for some $p \in (1,2]$. Building on the foundational work of Arjevani et al.…

Optimization and Control · Mathematics 2026-04-01 Adrien Fradin , Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

We consider an extension of the Newton-MR algorithm for nonconvex unconstrained optimization to the settings where Hessian information is approximated. Under a particular noise model on the Hessian matrix, we investigate the iteration and…

Optimization and Control · Mathematics 2024-09-16 Alexander Lim , Fred Roosta

Low-rank tensor recovery has attracted much attention among various tensor recovery approaches. A tensor rank has several definitions, unlike the matrix rank--e.g. the CP rank and the Tucker rank. Many low-rank tensor recovery methods are…

Signal Processing · Electrical Eng. & Systems 2020-09-09 Kaito Hosono , Shunsuke Ono , Takamichi Miyata

The Hessian-vector product has been utilized to find a second-order stationary solution with strong complexity guarantee (e.g., almost linear time complexity in the problem's dimensionality). In this paper, we propose to further reduce the…

Optimization and Control · Mathematics 2017-10-03 Mingrui Liu , Tianbao Yang

One of the popular approaches for low-rank tensor completion is to use the latent trace norm regularization. However, most existing works in this direction learn a sparse combination of tensors. In this work, we fill this gap by proposing a…

Machine Learning · Computer Science 2018-11-13 Madhav Nimishakavi , Pratik Jawanpuria , Bamdev Mishra

In this paper, nonconvex and nonsmooth models for compressed sensing (CS) and low rank matrix completion (MC) is studied. The problem is formulated as a nonconvex regularized leat square optimization problems, in which the l0-norm and the…

Optimization and Control · Mathematics 2016-05-03 Zhuo-Xu Cui , Qibin Fan

We study the problem of low-rank tensor factorization in the presence of missing data. We ask the following question: how many sampled entries do we need, to efficiently and exactly reconstruct a tensor with a low-rank orthogonal…

Machine Learning · Statistics 2014-06-12 Prateek Jain , Sewoong Oh

Low-rank and nonsmooth matrix optimization problems capture many fundamental tasks in statistics and machine learning. While significant progress has been made in recent years in developing efficient methods for \textit{smooth} low-rank…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

We consider the tensor completion problem of predicting the missing entries of a tensor. The commonly used CP model has a triple product form, but an alternate family of quadratic models, which are the sum of pairwise products instead of a…

Machine Learning · Computer Science 2023-08-01 Hongyang R. Zhang , Vatsal Sharan , Moses Charikar , Yingyu Liang

We consider the problem of recovering an orthogonally decomposable tensor with a subset of elements distorted by noise with arbitrarily large magnitude. We focus on the particular case where each mode in the decomposition is corrupted by…

Numerical Analysis · Mathematics 2021-02-22 Oscar Mickelin , Sertac Karaman