中文
相关论文

相关论文: Sharp, strong and unique minimizers for low comple…

200 篇论文

Flat minima are strongly associated with improved generalisation in deep neural networks. However, this connection has proven nuanced in recent studies, with both theoretical counterexamples and empirical exceptions emerging in the…

机器学习 · 计算机科学 2026-04-16 Israel Mason-Williams , Gabryel Mason-Williams , Helen Yannakoudakis

In parallel magnetic resonance imaging (pMRI) reconstruction without using estimation of coil sensitivity functions, one group of algorithms reconstruct sensitivity encoded images of the coils first followed by the magnitude only image…

医学物理 · 物理学 2013-11-12 Cishen Zhang , Ifat Al Baqee

This paper is about a curious phenomenon. Suppose we have a data matrix, which is the superposition of a low-rank component and a sparse component. Can we recover each component individually? We prove that under some suitable assumptions,…

信息论 · 计算机科学 2009-12-21 Emmanuel J. Candes , Xiaodong Li , Yi Ma , John Wright

In this paper, we study the problem of recovering two unknown signals from their convolution, which is commonly referred to as blind deconvolution. Reformulation of blind deconvolution as a low-rank recovery problem has led to multiple…

信息论 · 计算机科学 2023-03-20 Julia Kostin , Felix Krahmer , Dominik Stöger

Motivated by robust matrix recovery problems such as Robust Principal Component Analysis, we consider a general optimization problem of minimizing a smooth and strongly convex loss function applied to the sum of two blocks of variables,…

机器学习 · 计算机科学 2019-11-19 Dan Garber , Shoham Sabach , Atara Kaplan

Tremendous efforts have been made to study the theoretical and algorithmic aspects of sparse recovery and low-rank matrix recovery. This paper fills a theoretical gap in matrix recovery: the optimal sample complexity for stable recovery…

信息论 · 计算机科学 2017-12-27 Yanjun Li , Kiryung Lee , Yoram Bresler

Tremendous efforts have been made to study the theoretical and algorithmic aspects of sparse recovery and low-rank matrix recovery. This paper fills a theoretical gap in matrix recovery: the optimal sample complexity for stable recovery…

信息论 · 计算机科学 2018-01-03 Yanjun Li , Kiryung Lee , Yoram Bresler

Most high-dimensional matrix recovery problems are studied under the assumption that the target matrix has certain intrinsic structures. For image data related matrix recovery problems, approximate low-rankness and smoothness are the two…

机器学习 · 统计学 2021-04-08 Long Feng , Junhui Wang

Standard quadratic optimization problems (StQPs) provide a versatile modelling tool in various applications. In this paper, we consider StQPs with a hard sparsity constraint, referred to as sparse StQPs. We focus on various tractable convex…

最优化与控制 · 数学 2023-10-09 Immanuel Bomze , Bo Peng , Yuzhou Qiu , E. Alper Yıldırım

In this manuscript, we analyze the sparse signal recovery (compressive sensing) problem from the perspective of convex optimization by stochastic proximal gradient descent. This view allows us to significantly simplify the recovery analysis…

数据结构与算法 · 计算机科学 2013-04-19 Rong Jin , Tianbao Yang , Shenghuo Zhu

This paper studies tensor-based Robust Principal Component Analysis (RPCA) using atomic-norm regularization. Given the superposition of a sparse and a low-rank tensor, we present conditions under which it is possible to exactly recover the…

最优化与控制 · 数学 2019-01-31 Derek Driggs , Stephen Becker , Jordan Boyd-Graber

We develop sufficient conditions for the existence of the weak sharp minima at infinity property for nonsmooth optimization problems via asymptotic cones and generalized asymptotic functions. Next, we show that these conditions are also…

最优化与控制 · 数学 2024-10-08 Felipe Lara , Nguyen Van Tuyen , Tran Van Nghi

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

机器学习 · 统计学 2015-03-19 Teng Zhang , Gilad Lerman

This paper develops a new class of nonconvex regularizers for low-rank matrix recovery. Many regularizers are motivated as convex relaxations of the matrix rank function. Our new factor group-sparse regularizers are motivated as a…

机器学习 · 计算机科学 2019-11-19 Jicong Fan , Lijun Ding , Yudong Chen , Madeleine Udell

We revisit the problem of robust principal component analysis with features acting as prior side information. To this aim, a novel, elegant, non-convex optimization approach is proposed to decompose a given observation matrix into a…

机器学习 · 统计学 2017-09-15 Niannan Xue , Jiankang Deng , Yannis Panagakis , Stefanos Zafeiriou

In compressed sensing one uses known structures of otherwise unknown signals to recover them from as few linear observations as possible. The structure comes in form of some compressibility including different notions of sparsity and low…

信息论 · 计算机科学 2019-05-29 Martin Kliesch , Stanislaw J. Szarek , Peter Jung

Consider the regularized sparse minimization problem, which involves empirical sums of loss functions for $n$ data points (each of dimension $d$) and a nonconvex sparsity penalty. We prove that finding an…

最优化与控制 · 数学 2017-06-20 Yichen Chen , Dongdong Ge , Mengdi Wang , Zizhuo Wang , Yinyu Ye , Hao Yin

Many inverse problems in signal processing deal with the robust estimation of unknown data from underdetermined linear observations. Low dimensional models, when combined with appropriate regularizers, have been shown to be efficient at…

信息论 · 计算机科学 2016-12-07 Yann Traonmilin , Rémi Gribonval

We present novel analysis and algorithms for solving sparse phase retrieval and sparse principal component analysis (PCA) with convex lifted matrix formulations. The key innovation is a new mixed atomic matrix norm that, when used as…

统计理论 · 数学 2024-04-22 Andrew D. McRae , Justin Romberg , Mark A. Davenport

We design accelerated algorithms with improved rates for several fundamental classes of optimization problems. Our algorithms all build upon techniques related to the analysis of primal-dual extragradient methods via relative Lipschitzness…

最优化与控制 · 数学 2022-02-10 Yujia Jin , Aaron Sidford , Kevin Tian