中文
相关论文

相关论文: Sparse Regularization with the $\ell_0$ Norm

200 篇论文

The goal of Sparse Convex Optimization is to optimize a convex function $f$ under a sparsity constraint $s\leq s^*\gamma$, where $s^*$ is the target number of non-zero entries in a feasible solution (sparsity) and $\gamma\geq 1$ is an…

机器学习 · 计算机科学 2020-06-26 Kyriakos Axiotis , Maxim Sviridenko

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

机器学习 · 计算机科学 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

In this work, we consider a class of linear ill-posed problems with operators that map from the sequence space $ \ell_r $ ($r \ge 1$) into a Banach space and in addition satisfy a conditional stability estimate in the scale of sequence…

数值分析 · 数学 2025-10-21 Robert Plato , Bernd Hofmann

In the past decade, sparse and low-rank recovery have drawn much attention in many areas such as signal/image processing, statistics, bioinformatics and machine learning. To achieve sparsity and/or low-rankness inducing, the $\ell_1$ norm…

信息论 · 计算机科学 2019-06-07 Fei Wen , Lei Chu , Peilin Liu , Robert C. Qiu

Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm…

系统与控制 · 电气工程与系统科学 2023-03-20 Mingzhou Yin , Mehmet Tolga Akan , Andrea Iannelli , Roy S. Smith

We investigate conditions for the unique recoverability of sparse integer-valued signals from a small number of linear measurements. Both the objective of minimizing the number of nonzero components, the so-called $\ell_0$-norm, as well as…

信息论 · 计算机科学 2019-09-18 Jan-Hendrik Lange , Marc E. Pfetsch , Bianca M. Seib , Andreas M. Tillmann

This paper addresses the problem of sparsity penalized least squares for applications in sparse signal processing, e.g. sparse deconvolution. This paper aims to induce sparsity more strongly than L1 norm regularization, while avoiding…

机器学习 · 计算机科学 2015-06-15 Ivan W. Selesnick , Ilker Bayram

In dynamic MRI, sufficient time resolution can often only be obtained using imaging protocols which produce undersampled data for each image in the time series. This has led to the popularity of compressed sensing (CS) based image…

Feature selection with specific multivariate performance measures is the key to the success of many applications, such as image retrieval and text classification. The existing feature selection methods are usually designed for…

机器学习 · 计算机科学 2015-03-19 Qi Mao , Ivor W. Tsang

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

统计方法学 · 统计学 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

数值分析 · 数学 2025-05-12 Abinash Nayak

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

数据结构与算法 · 计算机科学 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

As a powerful statistical image modeling technique, sparse representation has been successfully used in various image restoration applications. The success of sparse representation owes to the development of l1-norm optimization techniques,…

计算机视觉与模式识别 · 计算机科学 2015-05-20 Weisheng Dong , Lei Zhang , Guangming Shi , Xiaolin Wu

Deep neural networks have become very popular in modeling complex nonlinear processes due to their extraordinary ability to fit arbitrary nonlinear functions from data with minimal expert intervention. However, they are almost always…

The reconstruction of low-rank matrix from its noisy observation finds its usage in many applications. It can be reformulated into a constrained nuclear norm minimization problem, where the bound $\eta$ of the constraint is explicitly given…

最优化与控制 · 数学 2022-04-14 Kexin Li , Hongwei Li , Raymond H. Chan , You-wei Wen

Sparse optimization has seen its advances in recent decades. For scenarios where the true sparsity is unknown, regularization turns out to be a promising solution. Two popular non-convex regularizations are the so-called $L_0$ norm and…

最优化与控制 · 数学 2024-07-08 Shenglong Zhou , Xianchao Xiu , Yingnan Wang , Dingtao Peng

We study array imaging of a sparse scene of point-like sources or scatterers in a homogeneous medium. For source imaging the sensors in the array are receivers that collect measurements of the wave field. For imaging scatterers the array…

数值分析 · 数学 2015-07-03 Liliana Borcea , Ilker Kocyigit

How to extract more and useful information for single image super resolution is an imperative and difficult problem. Learning-based method is a representative method for such task. However, the results are not so stable as there may exist…

图像与视频处理 · 电气工程与系统科学 2020-03-25 Hu Liang , Shengrong Zhao

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

数值分析 · 数学 2016-12-30 Sergey Voronin , Ingrid Daubechies

Convex $\ell_1$ regularization using an infinite dictionary of neurons has been suggested for constructing neural networks with desired approximation guarantees, but can be affected by an arbitrary amount of over-parametrization. This can…

最优化与控制 · 数学 2022-06-01 Konstantin Pieper , Armenak Petrosyan