English
Related papers

Related papers: Unique sparse decomposition of low rank matrices

200 papers

This note considers the unstructured sparse recovery problems in a general form. Examples include rational approximation, spectral function estimation, Fourier inversion, Laplace inversion, and sparse deconvolution. The main challenges are…

Numerical Analysis · Mathematics 2024-03-11 Lexing Ying

Wisely utilizing the internal and external learning methods is a new challenge in super-resolution problem. To address this issue, we analyze the attributes of two methodologies and find two observations of their recovered details: 1) they…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shuang Wang , Bo Yue , Xuefeng Liang , Peiyuan Ji , Licheng Jiao

We consider the recovery of a low rank $M \times N$ matrix $S$ from its noisy observation $\tilde{S}$ in two different regimes. Under the assumption that $M$ is comparable to $N$, we propose two consistent estimators for $S$. Our analysis…

Statistics Theory · Mathematics 2019-04-24 Xiucai Ding

We address the collective matrix completion problem of jointly recovering a collection of matrices with shared structure from partial (and potentially noisy) observations. To ensure well--posedness of the problem, we impose a joint low rank…

Machine Learning · Statistics 2015-04-09 Suriya Gunasekar , Makoto Yamada , Dawei Yin , Yi Chang

This article studies how to form CUR decompositions of low-rank matrices via primarily random sampling, though deterministic methods due to previous works are illustrated as well. The primary problem is to determine when a column submatrix…

Numerical Analysis · Mathematics 2020-01-10 Keaton Hamm , Longxiu Huang

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

An increasing number of applications is concerned with recovering a sparse matrix from noisy observations. In this paper, we consider the setting where each row of the unknown matrix is sparse. We establish minimax optimal rates of…

Statistics Theory · Mathematics 2015-09-02 O. Klopp , A. B. Tsybakov

We prove a generalization to Jennrich's uniqueness theorem for tensor decompositions in the undercomplete setting. Our uniqueness theorem is based on an alternative definition of the standard tensor decomposition, which we call…

Computational Complexity · Computer Science 2025-10-31 Pascal Koiran , Rafael Oliveira

It is known that the decomposition in low-rank and sparse matrices (\textbf{L+S} for short) can be achieved by several Robust PCA techniques. Besides the low rankness, the local smoothness (\textbf{LSS}) is a vitally essential prior for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jiangjun Peng , Yao Wang , Hongying Zhang , Jianjun Wang , Deyu Meng

Matrix completion is a classical problem that has received recurring interest across a wide range of fields. In this paper, we revisit this problem in an ultra-sparse sampling regime, where each entry of an unknown, $n\times d$ matrix $M$…

Machine Learning · Computer Science 2026-01-21 Hongyang R. Zhang , Zhenshuo Zhang , Huy L. Nguyen , Guanghui Lan

It has been recently shown that incorporating priori knowledge significantly improves the performance of basic compressive sensing based approaches. We have managed to successfully exploit this idea for recovering a matrix as a summation of…

Computer Vision and Pattern Recognition · Computer Science 2014-11-25 Dornoosh Zonoobi , Shahrooz Faghih Roohi , Ashraf A. Kassim

We introduce a novel algorithm that computes the $k$-sparse principal component of a positive semidefinite matrix $A$. Our algorithm is combinatorial and operates by examining a discrete set of special vectors lying in a low-dimensional…

Machine Learning · Statistics 2014-05-09 Dimitris S. Papailiopoulos , Alexandros G. Dimakis , Stavros Korokythakis

Low-rank matrix completion is a problem of immense practical importance. Recent works on the subject often use nuclear norm as a convex surrogate of the rank function. Despite its solid theoretical foundation, the convex version of the…

Computer Vision and Pattern Recognition · Computer Science 2014-10-29 Yu-Xiang Wang , Choon Meng Lee , Loong-Fah Cheong , Kim-Chuan Toh

We study the unlabeled sensing problem that aims to solve a linear system of equations $A x =\pi(y) $ for an unknown permutation $\pi$. For a generic matrix $A$ and a generic vector $y$, we construct a system of polynomial equations whose…

Optimization and Control · Mathematics 2024-05-28 Hao Liang , Jingyu Lu , Manolis C. Tsakiris , Lihong Zhi

The completion of matrices with missing values under the rank constraint is a non-convex optimization problem. A popular convex relaxation is based on minimization of the nuclear norm (sum of singular values) of the matrix. For this…

Optimization and Control · Mathematics 2015-06-11 Konstantin Usevich , Pierre Comon

Suppose a given observation matrix can be decomposed as the sum of a low-rank matrix and a sparse matrix (outliers), and the goal is to recover these individual components from the observed sum. Such additive decompositions have…

Machine Learning · Statistics 2010-12-07 Daniel Hsu , Sham M. Kakade , Tong Zhang

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

In this paper, we suggest a new method for a given tensor to find CP decompositions using a less number of rank $1$ tensors. The main ingredient is the Least Absolute Shrinkage and Selection Operator (LASSO) by considering the decomposition…

Commutative Algebra · Mathematics 2023-05-24 Taehyeong Kim , Jeong-Hoon Ju , Yeongrak Kim

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

In this paper, we analyze the uniqueness of the sparse time frequency decomposition and investigate the efficiency of the nonlinear matching pursuit method. Under the assumption of scale separation, we show that the sparse time frequency…

Information Theory · Computer Science 2015-05-08 Chunguang Liu , Thomas Y. Hou , Zuoqiang Shi