中文
相关论文

相关论文: Beyond $\ell_1$-norm minimization for sparse signa…

200 篇论文

This paper concerns dictionary learning, i.e., sparse coding, a fundamental representation learning problem. We show that a subgradient descent algorithm, with random initialization, can provably recover orthogonal dictionaries on a natural…

机器学习 · 计算机科学 2019-07-02 Yu Bai , Qijia Jiang , Ju Sun

This paper seeks to bridge the two major algorithmic approaches to sparse signal recovery from an incomplete set of linear measurements -- L_1-minimization methods and iterative methods (Matching Pursuits). We find a simple regularized…

数值分析 · 数学 2008-03-15 Deanna Needell , Roman Vershynin

We propose an iterative algorithm for the minimization of a $\ell_1$-norm penalized least squares functional, under additional linear constraints. The algorithm is fully explicit: it uses only matrix multiplications with the three matrices…

数值分析 · 数学 2012-02-16 Ignace Loris , Caroline Verhoeven

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

数据结构与算法 · 计算机科学 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

Compressive sensing predicts that sufficiently sparse vectors can be recovered from highly incomplete information. Efficient recovery methods such as $\ell_1$-minimization find the sparsest solution to certain systems of equations. Random…

信息论 · 计算机科学 2011-08-17 Ulaş Ayaz , Holger Rauhut

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

信息论 · 计算机科学 2016-09-06 Steffen Limmer , Sławomir Stańczak

Sparse linear regression -- finding an unknown vector from linear measurements -- is now known to be possible with fewer samples than variables, via methods like the LASSO. We consider the multiple sparse linear regression problem, where…

机器学习 · 计算机科学 2012-02-28 Ali Jalali , Pradeep Ravikumar , Sujay Sanghavi

Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an…

数值分析 · 数学 2013-01-01 I. Daubechies , M. Fornasier , I. Loris

An l0-regularized linear regression for a sparse signal reconstruction is implemented based on the quadratic unconstrained binary optimization (QUBO) formulation. In this method, the signal values are quantized and expressed as bit…

信息论 · 计算机科学 2022-03-01 Naoki Ide , Masayuki Ohzeki

We present preconditioned stochastic gradient descent (SGD) algorithms for the $\ell_1$ minimization problem $\min_{x}\|A x - b\|_1$ in the overdetermined case, where there are far more constraints than variables. Specifically, we have $A…

数据结构与算法 · 计算机科学 2018-06-04 David Durfee , Kevin A. Lai , Saurabh Sawlani

Sparse recovery can recover sparse signals from a set of underdetermined linear measurements. Motivated by the need to monitor large-scale networks from a limited number of measurements, this paper addresses the problem of recovering sparse…

信息论 · 计算机科学 2015-03-20 Meng Wang , Weiyu Xu , Enrique Mallada , Ao Tang

Despite the importance of sparsity signal models and the increasing prevalence of high-dimensional streaming data, there are relatively few algorithms for dynamic filtering of time-varying sparse signals. Of the existing algorithms, fewer…

统计理论 · 数学 2016-11-03 Adam Charles , Aurele Balavoine , Christopher Rozell

Broadband wireless channels usually have the sparse nature. Based on the assumption of Gaussian noise model, adaptive filtering algorithms for reconstruction sparse channels were proposed to take advantage of channel sparsity. However,…

信息论 · 计算机科学 2015-02-20 Guan Gui , Li Xu , Wentao Ma , Badong Chen

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

最优化与控制 · 数学 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

In this paper, utilizing techniques in compressed sensing, parallel optimization and deep learning, we propose a model-driven approach to jointly design the common measurement matrix and GROUP LASSO-based jointly sparse signal recovery…

信息论 · 计算机科学 2020-02-10 Shuaichao Li , Wanqing Zhang , Ying Cui

Compressed sensing is an important problem in many fields of science and engineering. It reconstructs signals by finding sparse solutions to underdetermined linear equations. In this work we propose a deterministic and non-parametric…

信号处理 · 电气工程与系统科学 2017-12-19 Mutian Shen , Pan Zhang , Hai-Jun Zhou

Compressed sensing aims at reconstructing sparse signals from significantly reduced number of samples, and a popular reconstruction approach is $\ell_1$-norm minimization. In this correspondence, a method called orthonormal expansion is…

信息论 · 计算机科学 2015-05-30 Zai Yang , Cishen Zhang , Jun Deng , Wenmiao Lu

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

最优化与控制 · 数学 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

最优化与控制 · 数学 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

A new reweighted l1-norm penalized least mean square (LMS) algorithm for sparse channel estimation is proposed and studied in this paper. Since standard LMS algorithm does not take into account the sparsity information about the channel…

信息论 · 计算机科学 2014-05-09 Omid Taheri , Sergiy A. Vorobyov