中文
相关论文

相关论文: Sparse recovery in convex hulls via entropy penali…

200 篇论文

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates…

信号处理 · 电气工程与系统科学 2020-09-22 Xiang Zhang , Lei Yu , Gang Zheng

For the problem of sparse recovery, it is widely accepted that nonconvex minimizations are better than $\ell_1$ penalty in enhancing the sparsity of solution. However, to date, the theory verifying that nonconvex penalties outperform (or…

最优化与控制 · 数学 2019-02-15 Hoang Tran , Clayton Webster

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

最优化与控制 · 数学 2023-11-03 Angelia Nedich , Tatiana Tatarenko

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

最优化与控制 · 数学 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

机器学习 · 计算机科学 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

In this work we propose and analyze a novel approach for group sparse recovery. It is based on regularized least squares with an $\ell^0(\ell^2)$ penalty, which penalizes the number of nonzero groups. One distinct feature of the approach is…

信息论 · 计算机科学 2016-12-21 Yuling Jiao , Bangti Jin , Xiliang Lu

Sparse signal recovery from under-determined systems presents significant challenges when using conventional L_0 and L_1 penalties, primarily due to computational complexity and estimation bias. This paper introduces a truncated Huber…

数值分析 · 数学 2025-04-08 Li Yang , Serena Morigi , Michael K. Ng , You-wei Wen

We consider both $\ell _{0}$-penalized and $\ell _{0}$-constrained quantile regression estimators. For the $\ell _{0}$-penalized estimator, we derive an exponential inequality on the tail probability of excess quantile prediction risk and…

统计方法学 · 统计学 2023-03-30 Le-Yu Chen , Sokbae Lee

We propose a new class of nonconvex penalty functions, based on data depth functions, for multitask sparse penalized regression. These penalties quantify the relative position of rows of the coefficient matrix from a fixed distribution…

统计方法学 · 统计学 2018-05-08 Subhabrata Majumdar , Snigdhansu Chatterjee

In this paper we theoretically study exact recovery of sparse vectors from compressed measurements by minimizing a general nonconvex function that can be decomposed into the sum of single variable functions belonging to a class of smooth…

信息论 · 计算机科学 2020-10-21 Samrat Mukhopadhyay

This paper considers the problem of reconstructing sparse or compressible signals from one-bit quantized measurements. We study a new method that uses a log-sum penalty function, also referred to as the Gaussian entropy, for sparse signal…

信息论 · 计算机科学 2012-10-17 Jun Fang , Yanning Shen , Hongbin Li

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

统计理论 · 数学 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao

This paper develops a convex approach for sparse one-dimensional deconvolution that improves upon L1-norm regularization, the standard convex approach. We propose a sparsity-inducing non-separable non-convex bivariate penalty function for…

最优化与控制 · 数学 2016-04-19 Ivan W. Selesnick , Iker Bayram

We consider the compressed sensing problem, where the object $x_0 \in \bR^N$ is to be recovered from incomplete measurements $y = Ax_0 + z$; here the sensing matrix $A$ is an $n \times N$ random matrix with iid Gaussian entries and $n < N$.…

信息论 · 计算机科学 2011-03-25 David Donoho , Iain Johnstone , Arian Maleki , Andrea Montanari

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

信息论 · 计算机科学 2011-11-08 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

We introduce a \emph{batch} version of sparse recovery, where the goal is to report a sequence of vectors $A_1',\ldots,A_m' \in \mathbb{R}^n$ that estimate unknown signals $A_1,\ldots,A_m \in \mathbb{R}^n$ using a few linear measurements,…

数据结构与算法 · 计算机科学 2018-07-24 Alexandr Andoni , Lior Kamma , Robert Krauthgamer , Eric Price

In this paper we study the compressed sensing problem of recovering a sparse signal from a system of underdetermined linear equations when we have prior information about the probability of each entry of the unknown signal being nonzero. In…

信息论 · 计算机科学 2009-01-20 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

Many popular statistical models, such as factor and random effects models, give arise a certain type of covariance structures that is a summation of low rank and sparse matrices. This paper introduces a penalized approximation framework to…

统计方法学 · 统计学 2015-03-19 Xi Luo

We present a new approach to solve the sparse approximation or best subset selection problem, namely find a $k$-sparse vector ${\bf x}\in\mathbb{R}^d$ that minimizes the $\ell_2$ residual $\lVert A{\bf x}-{\bf y} \rVert_2$. We consider a…

机器学习 · 计算机科学 2021-06-21 Tal Amir , Ronen Basri , Boaz Nadler

In the blind deconvolution problem, we observe the convolution of an unknown filter and unknown signal and attempt to reconstruct the filter and signal. The problem seems impossible in general, since there are seemingly many more unknowns…

信息论 · 计算机科学 2021-06-15 Qingyun Sun , David Donoho