English
Related papers

Related papers: Weighting operators for sparsity regularization

200 papers

In this paper we utilise new methods of Calculus of Variations in $L^\infty$ to provide a regularisation strategy to the ill-posed inverse problem of identifying the source of a non-homogeneous linear elliptic equation, satisfying Dirichlet…

Analysis of PDEs · Mathematics 2019-01-17 Nikos Katzourakis

Sparsity is one of the key concepts that allows the recovery of signals that are subsampled at a rate significantly lower than required by the Nyquist-Shannon sampling theorem. Our proposed framework uses arbitrary multiscale transforms,…

Optimization and Control · Mathematics 2017-05-31 Jackie Ma , Maximilian März

We introduce a novel regularization approach for deep learning that incorporates and respects the underlying graphical structure of the neural network. Existing regularization methods often focus on dropping/penalizing weights in a global…

Machine Learning · Statistics 2020-08-18 Edric Tam , David Dunson

We exploit the similarities between Tikhonov regularization and Bayesian hierarchical models to propose a regularization scheme that acts like a distributed Tikhonov regularization where the amount of regularization varies from component to…

Numerical Analysis · Mathematics 2024-04-10 Daniela Calvetti , Erkki Somersalo

We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take…

Numerical Analysis · Mathematics 2023-11-22 Armenak Petrosyan , Konstantin Pieper , Hoang Tran

The recovery of images from the observations that are degraded by a linear operator and further corrupted by Poisson noise is an important task in modern imaging applications such as astronomical and biomedical ones. Gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2015-03-17 Dai-Qiang Chen

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

The aim of this paper is to develop a method to estimate high order FIR and ARX models using least squares with re-weighted nuclear norm regularization. Typically, the choice of the tuning parameter in the reweighting scheme is…

Optimization and Control · Mathematics 2015-07-22 Huong Ha , James S. Welsh , Niclas Blomberg , Cristian R. Rojas , Bo Wahlberg

Among all tissue imaging modalities, photo-acoustic tomography (PAT) has been getting increasing attention in the recent past due to the fact that it has high contrast, high penetrability, and has capability of retrieving high resolution.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Nadaparambil Aravindakshan Rejesh , Muthuvel Arigovindan

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

In this article, we introduce a novel normalization technique for neural network weight matrices, which we term weight conditioning. This approach aims to narrow the gap between the smallest and largest singular values of the weight…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hemanth Saratchandran , Thomas X. Wang , Simon Lucey

We introduce Fiedler regularization, a novel approach for regularizing neural networks that utilizes spectral/graphical information. Existing regularization methods often focus on penalizing weights in a global/uniform manner that ignores…

Machine Learning · Statistics 2023-04-07 Edric Tam , David Dunson

We study the matrix completion problem when the observation pattern is deterministic and possibly non-uniform. We propose a simple and efficient debiased projection scheme for recovery from noisy observations and analyze the error under a…

Information Theory · Computer Science 2019-10-31 Simon Foucart , Deanna Needell , Reese Pathak , Yaniv Plan , Mary Wootters

We solve the analysis sparse coding problem considering a combination of convex and non-convex sparsity promoting penalties. The multi-penalty formulation results in an iterative algorithm involving proximal-averaging. We then unfold the…

In this paper, we investigate regularization of linear inverse problems with irregular noise. In particular, we consider the case that the noise can be preprocessed by certain adjoint embedding operators. By introducing the consequent…

Numerical Analysis · Mathematics 2024-01-30 Xinyan Li , Simon Hubmer , Shuai Lu , Ronny Ramlau

In this paper we provide a convergence analysis of some variational methods alternative to the classical Tikhonov regularization, namely Ivanov regularization (also called method of quasi solutions) with some versions of the discrepancy…

Numerical Analysis · Mathematics 2018-04-18 Barbara Kaltenbacher , Andrej Klassen

Sparse regularization techniques are well-established in machine learning, yet their application in neural networks remains challenging due to the non-differentiability of penalties like the $L_1$ norm, which is incompatible with stochastic…

Machine Learning · Computer Science 2025-02-10 Chris Kolb , Tobias Weber , Bernd Bischl , David Rügamer

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

Numerical Analysis · Mathematics 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

Feature selection is one of the most decisive tools in understanding data and machine learning models. Among other methods, sparsity induced by $L^{1}$ penalty is one of the simplest and best studied approaches to this problem. Although…

Machine Learning · Computer Science 2020-07-09 Andrii Trelin , Aleš Procházka