English
Related papers

Related papers: Weighted sparsity regularization for source identi…

200 papers

We deal with the solution of a generic linear inverse problem in the Hilbert space setting. The exact right hand side is unknown and only accessible through discretised measurements corrupted by white noise with unknown arbitrary…

Numerical Analysis · Mathematics 2023-02-14 Bastian Harrach , Tim Jahn , Roland Potthast

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

Numerical Analysis · Mathematics 2020-12-30 Jeffrey Cornelis , Wim Vanroose

Many real world practical problems can be formulated as $\ell_{0}$-minimization problems with nonnegativity constraints, which seek the sparsest nonnegative signals to underdetermined linear systems. They have been widely applied in signal…

Optimization and Control · Mathematics 2017-08-29 Angang Cui , Haiyang Li , Meng Wen , Jigen Peng

Several regularization methods have recently been introduced which force the latent activations of an autoencoder or deep neural network to conform to either a Gaussian or hyperspherical distribution, or to minimize the implicit rank of the…

Machine Learning · Computer Science 2022-07-04 Xuefeng Li , Alan Blair

Sparsity is a highly desired feature in deep neural networks (DNNs) since it ensures numerical efficiency, improves the interpretability of models (due to the smaller number of relevant features), and robustness. For linear models, it is…

Machine Learning · Computer Science 2024-04-01 Augustina C. Amakor , Konstantin Sonntag , Sebastian Peitz

Partial differential equations are central to describing many physical phenomena. In many applications these phenomena are observed through a sensor network, with the aim of inferring their underlying properties. Leveraging from certain…

Information Theory · Computer Science 2017-11-22 John Murray-Bruce , Pier Luigi Dragotti

Reconstructing lens potentials and lensed sources can easily become an underconstrained problem, even when the degrees of freedom are low, due to degeneracies, particularly when potential perturbations superimposed on a smooth lens are…

Astrophysics of Galaxies · Physics 2022-07-27 Georgios Vernardos , Leon V. E. Koopmans

The optimization problem with sparsity arises in many areas of science and engineering such as compressed sensing, image processing, statistical learning and data sparse approximation. In this paper, we study the dual-density-based…

Optimization and Control · Mathematics 2021-01-08 Jialiang Xu , Yun-Bin Zhao

The sparse optimization problems arise in many areas of science and engineering, such as compressed sensing, image processing, statistical and machine learning. The $\ell_{0}$-minimization problem is one of such optimization problems, which…

Optimization and Control · Mathematics 2019-04-23 Jialiang Xu , Yun-Bin Zhao

In this paper, we introduce a weighted $\ell_2/\ell_1$ minimization to recover block sparse signals with arbitrary prior support information. When partial prior support information is available, a sufficient condition based on the high…

Information Theory · Computer Science 2017-06-30 Wengu Chen , Huanmin Ge

We obtain bounds on estimation error rates for regularization procedures of the form \begin{equation*} \hat f \in {\rm argmin}_{f\in F}\left(\frac{1}{N}\sum_{i=1}^N\left(Y_i-f(X_i)\right)^2+\lambda \Psi(f)\right) \end{equation*} when $\Psi$…

Statistics Theory · Mathematics 2017-01-04 Guillaume Lecué , Shahar Mendelson

We study inexact fixed-point proximity algorithms for solving a class of sparse regularization problems involving the $\ell_0$ norm. Specifically, the $\ell_0$ model has an objective function that is the sum of a convex fidelity term and a…

Optimization and Control · Mathematics 2024-04-30 Ronglong Fang , Yuesheng Xu , Mingsong Yan

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

In this paper, the recursive least squares (RLS) algorithm is considered in the sparse system identification setting. The cost function of RLS algorithm is regularized by a $p$-norm-like ($0 \leq p \leq 1$) constraint of the estimated…

Information Theory · Computer Science 2023-12-12 Shuyang Jiang , Kung Yao

Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when…

Machine Learning · Computer Science 2026-05-29 Huangyu Xu , Jingqin Yang , Qianqian Xu , Jiaye Teng

We present an algorithm for finding sparse solutions of the system of linear equations $\Phi\mathbf{x}=\mathbf{y}$ with rectangular matrices $\Phi$ of size $n\times N$, where $n<N$, when measurement vector $\mathbf{y}$ is corrupted by a…

Numerical Analysis · Mathematics 2013-04-16 Alexander Petukhov , Inna Kozlov

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

We propose a sparse regularization model for inversion of incomplete Fourier transforms and apply it to seismic wavefield modeling. The objective function of the proposed model employs the Moreau envelope of the $\ell_0$ norm under a tight…

Numerical Analysis · Mathematics 2022-06-13 Tingting Wu , Yuesheng Xu

A recurring theme in attempts to break the curse of dimensionality in the numerical approximations of solutions to high-dimensional partial differential equations (PDEs) is to employ some form of sparse tensor approximation. Unfortunately,…

Numerical Analysis · Mathematics 2014-07-24 Wolfgang Dahmen , Ronald DeVore , Lars Grasedyck , Endre Süli

This paper studies the regularity problem for block uniformly elliptic operators in divergence form with complex bounded measurable coefficients. We consider the case where the boundary data belongs to Lebesgue spaces with weights in the…

Classical Analysis and ODEs · Mathematics 2020-10-14 Li Chen , José María Martell , Cruz Prisuelos-Arribas