English
Related papers

Related papers: Guaranteed Nonconvex Factorization Approach for Te…

200 papers

Current spectral compressed sensing methods via Hankel matrix completion employ symmetric factorization to demonstrate the low-rank property of the Hankel matrix. However, previous non-convex gradient methods only utilize asymmetric…

Information Retrieval · Computer Science 2024-09-25 Jinsheng Li , Wei Cui , Xu Zhang

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

Robust tensor principal component analysis (RTPCA) aims to separate the low-rank and sparse components from multi-dimensional data, making it an essential technique in the signal processing and computer vision fields. Recently emerging…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Lanlan Feng , Ce Zhu , Yipeng Liu , Saiprasad Ravishankar , Longxiu Huang

In this paper, we investigate decentralized non-convex optimization with orthogonal constraints. Conventional algorithms for this setting require either manifold retractions or other types of projection to ensure feasibility, both of which…

Machine Learning · Computer Science 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

This paper presents a geometric analysis of the simultaneous blind deconvolution and phase retrieval (BDPR) problem via a structured low-rank tensor recovery framework. Due to the highly complicated structure of the associated sensing…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Xiao Liang , Zhen Qin , Zhihui Zhu , Shuang Li

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

This paper conducts a rigorous analysis for provable estimation of multidimensional arrays, in particular third-order tensors, from a random subset of its corrupted entries. Our study rests heavily on a recently proposed tensor algebraic…

Machine Learning · Computer Science 2017-08-03 Jonathan Q. Jiang , Michael K. Ng

We propose an efficient implementation of the numerical tensor-train (TT) based algorithm solving the multicomponent coagulation equation preserving the nonnegativeness of solution. Unnatural negative elements in the constructed…

Numerical Analysis · Mathematics 2025-01-20 Sergey A. Matveev , Ilya Tretyak

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

Machine Learning · Statistics 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

We investigate the sample size requirement for exact recovery of a high order tensor of low rank from a subset of its entries. In the Tucker decomposition framework, we show that the Riemannian optimization algorithm with initial value…

Machine Learning · Statistics 2019-11-13 Jian-Feng Cai , Lizhang Miao , Yang Wang , Yin Xian

Structure learning methods for covariance and concentration graphs are often validated on synthetic models, usually obtained by randomly generating: (i) an undirected graph, and (ii) a compatible symmetric positive definite (SPD) matrix. In…

Methodology · Statistics 2019-10-02 Irene Córdoba , Gherardo Varando , Concha Bielza , Pedro Larrañaga

The optimization with orthogonality has been shown useful in training deep neural networks (DNNs). To impose orthogonality on DNNs, both computational efficiency and stability are important. However, existing methods utilizing Riemannian…

Machine Learning · Computer Science 2022-07-12 Fanchen Bu , Dong Eui Chang

While it is well known that the restricted isometry property (RIP) guarantees uniform sparse recovery from noisy linear measurements, uniform recovery of structured signals from nonlinear observations remains much less understood. This…

Information Theory · Computer Science 2026-04-23 Pedro Abdalla , Radu Balan , Junren Chen

In this paper we study the problem of recovering a low-rank matrix from a number of random linear measurements that are corrupted by outliers taking arbitrary values. We consider a nonsmooth nonconvex formulation of the problem, in which we…

Information Theory · Computer Science 2019-07-16 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Rene Vidal

Scientific problems require resolving multi-scale phenomena across different resolutions and learning solution operators in infinite-dimensional function spaces. Neural operators provide a powerful framework for this, using…

Within the tensor singular value decomposition (T-SVD) framework, existing robust low-rank tensor completion approaches have made great achievements in various areas of science and engineering. Nevertheless, these methods involve the T-SVD…

Machine Learning · Computer Science 2023-05-22 Wenjin Qin , Hailin Wang , Feng Zhang , Weijun Ma , Jianjun Wang , Tingwen Huang