中文
相关论文

相关论文: Convergence Speed of a Dynamical System for Sparse…

200 篇论文

We propose a new method for robust PCA -- the task of recovering a low-rank matrix from sparse corruptions that are of unknown value and support. Our method involves alternating between projecting appropriate residuals onto the set of…

信息论 · 计算机科学 2014-10-29 Praneeth Netrapalli , U N Niranjan , Sujay Sanghavi , Animashree Anandkumar , Prateek Jain

Online or recursive robust PCA can be posed as a problem of recovering a sparse vector, $S_t$, and a dense vector, $L_t$, which lies in a slowly changing low-dimensional subspace, from $M_t:= S_t + L_t$ on-the-fly as new data comes in. For…

信息论 · 计算机科学 2014-05-26 Jinchun Zhan , Namrata Vaswani , Chenlu Qiu

A constrained L1 minimization method is proposed for estimating a sparse inverse covariance matrix based on a sample of $n$ iid $p$-variate random variables. The resulting estimator is shown to enjoy a number of desirable properties. In…

统计方法学 · 统计学 2011-02-14 Tony Cai , Weidong Liu , Xi Luo

Finding sparse solutions of underdetermined systems of linear equations is a fundamental problem in signal processing and statistics which has become a subject of interest in recent years. In general, these systems have infinitely many…

机器学习 · 统计学 2010-09-21 Arash Ali Amini , Massoud Babaie-Zadeh , Christian Jutten

In this paper, we account for approaches of sparse recovery from large underdetermined linear models with perturbation present in both the measurements and the dictionary matrix. Existing methods have high computation and low efficiency.…

信息论 · 计算机科学 2012-05-02 Xuebing Han , Hao Zhang , Gang Li

The $L_0$-regularized least squares problem (a.k.a. best subsets) is central to sparse statistical learning and has attracted significant attention across the wider statistics, machine learning, and optimization communities. Recent work has…

统计计算 · 统计学 2020-01-28 Hussein Hazimeh , Rahul Mazumder

Compressed sensing has a wide range of applications that include error correction, imaging, radar and many more. Given a sparse signal in a high dimensional space, one wishes to reconstruct that signal accurately and efficiently from a…

数值分析 · 数学 2009-05-28 Deanna Needell

Recently, the decentralized optimization problem is attracting growing attention. Most existing methods are deterministic with high per-iteration cost and have a convergence rate quadratically depending on the problem condition number.…

机器学习 · 统计学 2018-05-28 Zebang Shen , Aryan Mokhtari , Tengfei Zhou , Peilin Zhao , Hui Qian

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

数据结构与算法 · 计算机科学 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

In this paper, we carry out a unified study for $L_1$ over $L_2$ sparsity promoting models, which are widely used in the regime of coherent dictionaries for recovering sparse nonnegative/arbitrary signals. First, we provide a unified…

最优化与控制 · 数学 2023-01-24 Min Tao , Xiao-Ping Zhang

In sparse information recovery, the core problem is to solve the $l_0$-minimization which is NP-hard. On one hand, in order to recover the original sparse solution, there are a lot of papers designing alternative model for…

最优化与控制 · 数学 2020-02-12 Wang Changlong , Zhou Feng , Wang Weichao , Ren Kaiqiang

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

机器学习 · 统计学 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

This work develops a sparse and outlier-insensitive method to fit a one-dimensional subspace that can be used as a replacement for eigenvector methods such as principal component analysis (PCA). The method is insensitive to outlier…

最优化与控制 · 数学 2023-01-26 Xiao Ling , J. Paul Brooks

In this work, we address the problem of identifying sparse continuous-time dynamical systems when the spacing between successive samples (the sampling period) is not constant over time. The proposed approach combines the…

系统与控制 · 计算机科学 2018-03-01 Rui Teixeira Ribeiro , Alexandre Mauroy , Jorge Goncalves

Consider the approximate sparse recovery problem: given Ax, where A is a known m-by-n dimensional matrix and x is an unknown (approximately) sparse n-dimensional vector, recover an approximation to x. The goal is to design the matrix A such…

数据结构与算法 · 计算机科学 2014-11-11 Arnab Bhattacharyya , Vineet Nair

While sparse attention mitigates the computational bottleneck of long-context LLM training, its distributed training process exhibits extreme heterogeneity in both \textit{1)} sequence length and \textit{2)} sparsity sensitivity, leading to…

Conventional algorithms for sparse signal recovery and sparse representation rely on $l_1$-norm regularized variational methods. However, when applied to the reconstruction of $\textit{sparse images}$, i.e., images where only a few pixels…

计算机视觉与模式识别 · 计算机科学 2016-05-09 Sohil Shah , Tom Goldstein , Christoph Studer

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

信息论 · 计算机科学 2015-03-13 V. Saligrama , M. Zhao

In this paper, we consider the "foreach" sparse recovery problem with failure probability $p$. The goal of which is to design a distribution over $m \times N$ matrices $\Phi$ and a decoding algorithm $\algo$ such that for every…

数据结构与算法 · 计算机科学 2013-04-24 Anna C. Gilbert , Hung Q. Ngo , Ely Porat , Atri Rudra , Martin J. Strauss

The ability to detect sparse signals from noisy high-dimensional data is a top priority in modern science and engineering. A sparse solution of the linear system $A \rho = b_0$ can be found efficiently with an $l_1$-norm minimization…

信号处理 · 电气工程与系统科学 2022-06-08 Miguel Moscoso , Alexei Novikov , George Papanicolaou , Chrysoula Tsogka