中文
相关论文

相关论文: Sparse Regularization with the $\ell_0$ Norm

200 篇论文

For the linear inverse problem with sparsity constraints, the $l_0$ regularized problem is NP-hard, and existing approaches either utilize greedy algorithms to find almost-optimal solutions or to approximate the $l_0$ regularization with…

机器学习 · 计算机科学 2024-02-14 Qinghua Tao , Xiangming Xi , Jun Xu , Johan A. K. Suykens

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

最优化与控制 · 数学 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

数值分析 · 数学 2020-12-30 Jeffrey Cornelis , Wim Vanroose

Tomographic reconstruction is an ill-posed inverse problem that calls for regularization. One possibility is to require sparsity of the unknown in an orthonormal wavelet basis. This in turn can be achieved by variational regularization…

数值分析 · 数学 2018-01-17 Zenith Purisha , Juho Rimpeläinen , Tatiana Bubba , Samuli Siltanen

Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when…

机器学习 · 计算机科学 2026-05-29 Huangyu Xu , Jingqin Yang , Qianqian Xu , Jiaye Teng

We present a method for supervised learning of sparsity-promoting regularizers for image denoising. Sparsity-promoting regularization is a key ingredient in solving modern image reconstruction problems; however, the operators underlying…

图像与视频处理 · 电气工程与系统科学 2020-06-11 Michael T. McCann , Saiprasad Ravishankar

The 1-norm was proven to be a good convex regularizer for the recovery of sparse vectors from under-determined linear measurements. It has been shown that with an appropriate measurement operator, a number of measurements of the order of…

信息论 · 计算机科学 2018-12-05 Yann Traonmilin , Samuel Vaiter

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

统计方法学 · 统计学 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

最优化与控制 · 数学 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

Standard deep learning models that employ the categorical cross-entropy loss are known to perform well at image classification tasks. However, many standard models thus obtained often exhibit issues like feature redundancy, low…

计算机视觉与模式识别 · 计算机科学 2020-09-24 Hongjun Choi , Anirudh Som , Pavan Turaga

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization.…

统计理论 · 数学 2023-02-15 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

最优化与控制 · 数学 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

In-network distributed estimation of sparse parameter vectors via diffusion LMS strategies has been studied and investigated in recent years. In all the existing works, some convex regularization approach has been used at each node of the…

机器学习 · 计算机科学 2016-11-15 Bijit Kumar Das , Mrityunjoy Chakraborty , Jerónimo Arenas-García

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

人工智能 · 计算机科学 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

最优化与控制 · 数学 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

Recovering nonlinearly degraded signal in the presence of noise is a challenging problem. In this work, this problem is tackled by minimizing the sum of a non convex least-squares fit criterion and a penalty term. We assume that the…

信号处理 · 电气工程与系统科学 2019-02-27 Marc Castella , Jean-Christophe Pesquet , Arthur Marmin

Sparsity-regularized synthetic aperture radar (SAR) imaging framework has shown its remarkable performance to generate a feature enhanced high resolution image, in which a sparsity-inducing regularizer is involved by exploiting the sparsity…

计算机视觉与模式识别 · 计算机科学 2018-05-09 Biao Hou , Zaidao Wen , Licheng Jiao , Qian Wu

Recovering corrupted images is one of the most challenging problems in image processing. Among various restoration tasks, blind image deblurring has been extensively studied due to its practical importance and inherent difficulty. In this…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Heng Zhang , Reza Parvaz , Rui Yang

Classical approach to regularization is to design norms enhancing smoothness or sparsity and then to use this norm or some power of this norm as a regularization function. The choice of the regularization function (for instance a power…

统计理论 · 数学 2018-05-21 Raphaël Deswarte , Guillaume Lecué

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

最优化与控制 · 数学 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran