中文
相关论文

相关论文: Is the 1-norm the best convex sparse regularizatio…

200 篇论文

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

信息论 · 计算机科学 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

We propose to learn non-convex regularizers with a prescribed upper bound on their weak-convexity modulus. Such regularizers give rise to variational denoisers that minimize a convex energy. They rely on few parameters (less than 15,000)…

图像与视频处理 · 电气工程与系统科学 2023-12-21 Alexis Goujon , Sebastian Neumayer , Michael Unser

The L1 norm regularized least squares method is often used for finding sparse approximate solutions and is widely used in 1-D signal restoration. Basis pursuit denoising (BPD) performs noise reduction in this way. However, the shortcoming…

计算机视觉与模式识别 · 计算机科学 2020-01-30 Nantheera Anantrasirichai , Rencheng Zheng , Ivan Selesnick , Alin Achim

The curse of dimensionality is a recognized challenge in nonparametric estimation. This paper develops a new L0-norm regularization approach to the convex quantile and expectile regressions for subset variable selection. We show how to use…

统计方法学 · 统计学 2021-07-08 Sheng Dai

Convex optimization with sparsity-promoting convex regularization is a standard approach for estimating sparse signals in noise. In order to promote sparsity more strongly than convex regularization, it is also standard practice to employ…

计算机视觉与模式识别 · 计算机科学 2015-06-17 Po-Yu Chen , Ivan W. Selesnick

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

机器学习 · 计算机科学 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

We present a convex formulation of dictionary learning for sparse signal decomposition. Convexity is obtained by replacing the usual explicit upper bound on the dictionary size by a convex rank-reducing term similar to the trace norm. In…

机器学习 · 计算机科学 2008-12-11 Francis Bach , Julien Mairal , Jean Ponce

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates…

信号处理 · 电气工程与系统科学 2020-09-22 Xiang Zhang , Lei Yu , Gang Zheng

In this paper, we show the important roles of sharp minima and strong minima for robust recovery. We also obtain several characterizations of sharp minima for convex regularized optimization problems. Our characterizations are quantitative…

最优化与控制 · 数学 2021-11-11 Jalal Fadili , Tran T. A. Nghia , Trinh T. T. Tran

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

信息论 · 计算机科学 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu

We propose a convex and fast signal reconstruction method for block sparsity under arbitrary linear transform with unknown block structure. The proposed method is a generalization of the similar existing method and can reconstruct signals…

机器学习 · 计算机科学 2024-02-14 Takanobu Furuhashi , Hidekata Hontani , Tatsuya Yokota

Recently, it was discovered that for a given function class $\mathbf{F}$ the error of best linear recovery in the square norm can be bounded above by the Kolmogorov width of $\mathbf{F}$ in the uniform norm. That analysis is based on deep…

数值分析 · 数学 2023-05-17 F. Dai , V. Temlyakov

In this work we consider numerical efficiency and convergence rates for solvers of non-convex multi-penalty formulations when reconstructing sparse signals from noisy linear measurements. We extend an existing approach, based on reduction…

信息论 · 计算机科学 2021-01-15 Zeljko Kereta , Johannes Maly , Valeriya Naumova

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

最优化与控制 · 数学 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

From a numerical analysis perspective, assessing the robustness of l1-minimization is a fundamental issue in compressed sensing and sparse regularization. Yet, the recovery guarantees available in the literature usually depend on a priori…

数值分析 · 数学 2017-05-10 Simone Brugiapaglia , Ben Adcock , Richard K. Archibald

Recovering a low-rank tensor from incomplete information is a recurring problem in signal processing and machine learning. The most popular convex relaxation of this problem minimizes the sum of the nuclear norms of the unfoldings of the…

机器学习 · 统计学 2013-08-16 Cun Mu , Bo Huang , John Wright , Donald Goldfarb

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

最优化与控制 · 数学 2025-06-16 Long Li , Liang Ding

We consider the nonconvex regularized method for low-rank matrix recovery. Under the assumption on the singular values of the parameter matrix, we provide the recovery bound for any stationary point of the nonconvex method by virtue of…

最优化与控制 · 数学 2024-12-24 Xin Li , Dongya Wu

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

最优化与控制 · 数学 2026-03-20 Dan Garber

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

信息论 · 计算机科学 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi