English
Related papers

Related papers: Image Fusion via Sparse Regularization with Non-Co…

200 papers

Nonconvex penalties are utilized for regularization in high-dimensional statistical learning algorithms primarily because they yield unbiased or nearly unbiased estimators for the parameters in the model. Nonconvex penalties existing in the…

Machine Learning · Statistics 2024-08-19 Majnu John , Sujit Vettam , Yihren Wu

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have…

Other Computer Science · Computer Science 2015-05-28 Nelly Pustelnik , Jean-Christophe Pesquet , Caroline Chaux

Removal of noise from an image is an extensively studied problem in image processing. Indeed, the recent advent of sophisticated and highly effective denoising algorithms lead some to believe that existing methods are touching the ceiling…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yaniv Romano , Michael Elad , Peyman Milanfar

We focus on the minimization of the least square loss function either under a $k$-sparse constraint or with a sparse penalty term. Based on recent results, we reformulate the $\ell_0$ pseudo-norm exactly as a convex minimization problem by…

Optimization and Control · Mathematics 2019-03-07 Arne Bechensteen , Laure Blanc-Féraud , Gilles Aubert

The sparse polynomial approximation of continuous functions has emerged as a prominent area of interest in function approximation theory in recent years. A key challenge within this domain is the accurate estimation of approximation errors.…

Numerical Analysis · Mathematics 2025-06-10 Renzhong Feng , Bowen Zhang

In this paper, a s-difference type regularization for sparse recovery problem is proposed, which is the difference of the normal penalty function R(x) and its corresponding struncated function R (xs). First, we show the equivalent…

Information Theory · Computer Science 2019-05-14 Yuli Sun , Xiang Tan , Xiao Li , Lin Lei , Gangyao Kuang

We study the asymptotics in $L^2$ for complexity penalized least squares regression for the discrete approximation of finite-dimensional signals on continuous domains - e.g. images - by piecewise smooth functions. We introduce a fairly…

Statistics Theory · Mathematics 2013-01-30 Laurent Demaret , Felix Friedrich , Volkmar Liebscher , Gerhard Winkler

Penalty functions or regularization terms that promote structured solutions to optimization problems are of great interest in many fields. Proposed in this work is a nonconvex structured sparsity penalty that promotes one-sparsity within…

Optimization and Control · Mathematics 2020-06-19 Charles Saunders , Vivek K Goyal

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

We propose to minimize a generic differentiable objective with $L_1$ constraint using a simple reparametrization and straightforward stochastic gradient descent. Our proposal is the direct generalization of previous ideas that the $L_1$…

Machine Learning · Computer Science 2023-07-13 Liu Ziyin , Zihao Wang

We consider compressed sensing formulated as a minimization problem of nonconvex sparse penalties, Smoothly Clipped Absolute deviation (SCAD) and Minimax Concave Penalty (MCP). The nonconvexity of these penalties is controlled by…

Machine Learning · Statistics 2021-06-08 Ayaka Sakata , Tomoyuki Obuchi

In this paper, we study norm-based regularization methods for neural networks. We compare existing penalization approaches and introduce two regularization strategies that extend classical ridge- and lasso-type penalties to neural network…

Machine Learning · Statistics 2026-05-04 Muhammad Qasim , Farrukh Javed

Recently, there has been focus on penalized log-likelihood covariance estimation for sparse inverse covariance (precision) matrices. The penalty is responsible for inducing sparsity, and a very common choice is the convex $l_1$ norm.…

Machine Learning · Statistics 2023-07-19 Goran Marjanovic , Alfred O. Hero

Image enhancement approaches often assume that the noise is signal independent, and approximate the degradation model as zero-mean additive Gaussian. However, this assumption does not hold for biomedical imaging systems where sensor-based…

Image and Video Processing · Electrical Eng. & Systems 2023-04-10 Calvin-Khang Ta , Abhishek Aich , Akash Gupta , Amit K. Roy-Chowdhury

The development of computed tomography (CT) image reconstruction methods that significantly reduce patient radiation exposure while maintaining high image quality is an important area of research in low-dose CT (LDCT) imaging. We propose a…

Machine Learning · Statistics 2019-06-14 Xuehang Zheng , Saiprasad Ravishankar , Yong Long , Jeffrey A. Fessler

We consider the problem of recovering fusion frame sparse signals from incomplete measurements. These signals are composed of a small number of nonzero blocks taken from a family of subspaces. First, we show that, by using a-priori…

Information Theory · Computer Science 2014-07-30 Ulaş Ayaz , Sjoerd Dirksen , Holger Rauhut

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

We consider the problem of sparse estimation in a factor analysis model. A traditional estimation procedure in use is the following two-step approach: the model is estimated by maximum likelihood method and then a rotation technique is…

Methodology · Statistics 2013-03-18 Kei Hirose , Michio Yamamoto

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

Machine Learning · Computer Science 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten