中文
相关论文

相关论文: Guarantees of a Preconditioned Subgradient Algorit…

200 篇论文

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

机器学习 · 统计学 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

Subspace recovery from corrupted and missing data is crucial for various applications in signal processing and information theory. To complete missing values and detect column corruptions, existing robust Matrix Completion (MC) methods…

信息论 · 计算机科学 2016-11-18 Hongyang Zhang , Zhouchen Lin , Chao Zhang

We study the asymmetric matrix factorization problem under a natural nonconvex formulation with arbitrary overparametrization. The model-free setting is considered, with minimal assumption on the rank or singular values of the observed…

机器学习 · 计算机科学 2023-08-22 Liwei Jiang , Yudong Chen , Lijun Ding

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

机器学习 · 计算机科学 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

We improve existing results in the field of compressed sensing and matrix completion when sampled data may be grossly corrupted. We introduce three new theorems. 1) In compressed sensing, we show that if the m \times n sensing matrix has…

信息论 · 计算机科学 2012-01-19 Xiaodong Li

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

机器学习 · 统计学 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos

Many applications require recovering a matrix of minimal rank within an affine constraint set, with matrix completion a notable special case. Because the problem is NP-hard in general, it is common to replace the matrix rank with the…

机器学习 · 计算机科学 2015-07-08 Bo Xin , David Wipf

In this paper, we consider the problem of Robust Matrix Completion (RMC) where the goal is to recover a low-rank matrix by observing a small number of its entries out of which a few can be arbitrarily corrupted. We propose a simple…

机器学习 · 计算机科学 2016-12-09 Yeshwanth Cherapanamjeri , Kartik Gupta , Prateek Jain

Composite optimization problems involve minimizing the composition of a smooth map with a convex function. Such objectives arise in numerous data science and signal processing applications, including phase retrieval, blind deconvolution,…

最优化与控制 · 数学 2025-10-06 Mateo Díaz , Liwei Jiang , Abdel Ghani Labassi

In this paper we consider the problem of recovering a high dimensional data matrix from a set of incomplete and noisy linear measurements. We introduce a new model that can efficiently restrict the degrees of freedom of the problem and is…

信息论 · 计算机科学 2012-11-22 Mohammad Golbabaee , Pierre Vandergheynst

We propose $\textsf{ScaledGD($\lambda$)}$, a preconditioned gradient descent method to tackle the low-rank matrix sensing problem when the true rank is unknown, and when the matrix is possibly ill-conditioned. Using overparametrized factor…

机器学习 · 计算机科学 2026-01-01 Xingyu Xu , Yandi Shen , Yuejie Chi , Cong Ma

In this paper we study the problem of recovering a low-rank matrix from linear measurements. Our algorithm, which we call Procrustes Flow, starts from an initial estimate obtained by a thresholding scheme followed by gradient descent on a…

最优化与控制 · 数学 2016-02-08 Stephen Tu , Ross Boczar , Max Simchowitz , Mahdi Soltanolkotabi , Benjamin Recht

We introduce a new class of measurement matrices for compressed sensing, using low order summaries over binary sequences of a given length. We prove recovery guarantees for three reconstruction algorithms using the proposed measurements,…

信息论 · 计算机科学 2011-03-08 M. Amin Khajehnejad , Juhwan Yoo , Animashree Anandkumar , Babak Hassibi

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a…

数值分析 · 数学 2011-07-19 Massimo Fornasier , Holger Rauhut , Rachel Ward

This paper is devoted to the class of paraconvex functions and presents some of its fundamental properties, characterization, and examples that can be used for their recognition and optimization. Next, the convergence analysis of the…

最优化与控制 · 数学 2026-03-06 Morteza Rahimi , Susan Ghaderi , Yves Moreau , Masoud Ahookhosh

This paper studies the problem of accurately recovering a structured signal from a small number of corrupted sub-Gaussian measurements. We consider three different procedures to reconstruct signal and corruption when different kinds of…

信息论 · 计算机科学 2017-05-23 Jinchi Chen , Yulong Liu

Finding an approximate second-order stationary point (SOSP) is a well-studied and fundamental problem in stochastic nonconvex optimization with many applications in machine learning. However, this problem is poorly understood in the…

最优化与控制 · 数学 2024-03-19 Shuyao Li , Yu Cheng , Ilias Diakonikolas , Jelena Diakonikolas , Rong Ge , Stephen J. Wright

Sparse signal recovery deals with finding the sparsest solution of an under-determined linear system $\vx = \mQ\vs$. In this paper, we propose a novel greedy approach to addressing the challenges from such a problem. Such an approach is…

信息论 · 计算机科学 2026-04-09 Gang Li , Qiuwei Li , Shuang Li , Wu Angela Li

Compressed sensing of simultaneously sparse and low-rank matrices enables recovery of sparse signals from a few linear measurements of their bilinear form. One important question is how many measurements are needed for a stable…

信息论 · 计算机科学 2016-07-01 Kiryung Lee , Yihong Wu , Yoram Bresler

Signal models formed as linear combinations of few atoms from an over-complete dictionary or few frame vectors from a redundant frame have become central to many applications in high dimensional signal processing and data analysis. A core…

信息论 · 计算机科学 2024-08-30 Xuemei Chen , Christian Kümmerle , Rongrong Wang