English
Related papers

Related papers: Learning sparsity-promoting regularizers for linea…

200 papers

Sparse regularization techniques are well-established in machine learning, yet their application in neural networks remains challenging due to the non-differentiability of penalties like the $L_1$ norm, which is incompatible with stochastic…

Machine Learning · Computer Science 2025-02-10 Chris Kolb , Tobias Weber , Bernd Bischl , David Rügamer

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

We introduce Stochastic Asymptotical Regularization (SAR) methods for the uncertainty quantification of the stable approximate solution of ill-posed linear-operator equations, which are deterministic models for numerous inverse problems in…

Numerical Analysis · Mathematics 2022-12-21 Ye Zhang , Chuchu Chen

Many imaging science tasks can be modeled as a discrete linear inverse problem. Solving linear inverse problems is often challenging, with ill-conditioned operators and potentially non-unique solutions. Embedding prior knowledge, such as…

Numerical Analysis · Mathematics 2023-12-07 Elizabeth Newman , Jack Michael Solomon , Matthias Chung

Solving ill-posed inverse problems necessitates effective regularization strategies to stabilize the inversion process against measurement noise. While classical methods like Tikhonov regularization require heuristic parameter tuning, and…

Machine Learning · Statistics 2026-03-24 Hang-Cheng Dong , Pengcheng Cheng , Shuhuan Li

We aim at the solution of inverse problems in imaging, by combining a penalized sparse representation of image patches with an unconstrained smooth one. This allows for a straightforward interpretation of the reconstruction. We formulate…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Stanislas Ducotterd , Sebastian Neumayer , Michael Unser

In representation learning (RL), how to make the learned representations easy to interpret and less overfitted to training data are two important but challenging issues. To address these problems, we study a new type of regulariza- tion…

Machine Learning · Computer Science 2017-11-28 Pengtao Xie , Hongbao Zhang , Eric P. Xing

The use of L1 regularisation for sparse learning has generated immense research interest, with successful application in such diverse areas as signal acquisition, image coding, genomics and collaborative filtering. While existing work…

Machine Learning · Computer Science 2012-08-20 Shakir Mohamed , Katherine Heller , Zoubin Ghahramani

Feature selection is one of the most decisive tools in understanding data and machine learning models. Among other methods, sparsity induced by $L^{1}$ penalty is one of the simplest and best studied approaches to this problem. Although…

Machine Learning · Computer Science 2020-07-09 Andrii Trelin , Aleš Procházka

We present a method for supervised learning of sparsity-promoting regularizers, a key ingredient in many modern signal reconstruction problems. The parameters of the regularizer are learned to minimize the mean squared error of…

Machine Learning · Computer Science 2021-11-23 Avrajit Ghosh , Michael T. Mccann , Saiprasad Ravishankar

In this work, we study the affine-constrained $\ell_1$ regularizers, which frequently arise in statistical and machine learning problems across a variety of applications, including microbiome compositional data analysis and sparse subspace…

Optimization and Control · Mathematics 2025-10-09 Xudong Li , Meixia Lin , Kim-Chuan Toh

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

Optimization and Control · Mathematics 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

In this paper, we present a practical algorithm based on sparsity regularization to effectively solve nonlinear dynamic inverse problems that are encountered in subsurface model calibration. We use an iteratively reweighted algorithm that…

Numerical Analysis · Computer Science 2009-11-13 Lianlin Li , B. Jafarpour

Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, which are a necessity due to the ill-posedness of inverse problems. Tikhonov-type regularization methods are very popular in…

Numerical Analysis · Mathematics 2021-03-16 Abinash Nayak

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed…

Numerical Analysis · Mathematics 2018-10-23 Wei Wang , Shuai Lu , Bernd Hofmann , Jin Cheng

We consider the maximum likelihood estimation of sparse inverse covariance matrices. We demonstrate that current heuristic approaches primarily encourage robustness, instead of the desired sparsity. We give a novel approach that solves the…

Machine Learning · Statistics 2021-11-08 Dimitris Bertsimas , Jourdain Lamperski , Jean Pauphilet

Variable selection is a fundamental task in statistical data analysis. Sparsity-inducing regularization methods are a popular class of methods that simultaneously perform variable selection and model estimation. The central problem is a…

Machine Learning · Computer Science 2016-03-16 Hongbo Dong , Kun Chen , Jeff Linderoth

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

We study empirical and hierarchical Bayes approaches to the problem of estimating an infinite-dimensional parameter in mildly ill-posed inverse problems. We consider a class of prior distributions indexed by a hyperparameter that quantifies…

Statistics Theory · Mathematics 2013-05-30 B. T. Knapik , B. T. Szabó , A. W. van der Vaart , J. H. van Zanten