English
Related papers

Related papers: Flexible sparse regularization

200 papers

The 1-norm was proven to be a good convex regularizer for the recovery of sparse vectors from under-determined linear measurements. It has been shown that with an appropriate measurement operator, a number of measurements of the order of…

Information Theory · Computer Science 2018-12-05 Yann Traonmilin , Samuel Vaiter

Higher Sobolev and H\"older regularity is studied for local weak solutions of the fractional $p$-Laplace equation of order $s$ in the case $p\ge 2$. Depending on the regime considered, i.e. $$0<s\le\tfrac{p-2}{p}\quad \text{or}…

Analysis of PDEs · Mathematics 2024-06-04 Verena Bögelein , Frank Duzaar , Naian Liao , Giovanni Molica Bisci , Raffaella Servadei

We consider the normalized $p$-Poisson problem $$-\Delta^N_p u=f \qquad \text{in}\quad \Omega.$$ The normalized $p$-Laplacian $\Delta_p^{N}u:=|D u|^{2-p}\Delta_p u$ is in non-divergence form and arises for example from stochastic games. We…

Analysis of PDEs · Mathematics 2016-11-16 Amal Attouchi , Mikko Parviainen , Eero Ruosteenoja

For the problem of sparse recovery, it is widely accepted that nonconvex minimizations are better than $\ell_1$ penalty in enhancing the sparsity of solution. However, to date, the theory verifying that nonconvex penalties outperform (or…

Optimization and Control · Mathematics 2019-02-15 Hoang Tran , Clayton Webster

We consider the decomposition of a signal over an overcomplete set of vectors. Minimization of the $\ell^1$-norm of the coefficient vector can often retrieve the sparsest solution (so-called "$\ell^1/\ell^0$-equivalence"), a generally…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Chelsea Weaver , Naoki Saito

In sparse optimization, the $\ell_{1}$ norm is widely adopted for its convexity, yet it often yields solutions with smaller magnitudes than expected. To mitigate this drawback, various non-convex sparse penalties have been proposed. Some…

Optimization and Control · Mathematics 2025-09-25 Natsuki Akaishi , Koki Yamada , Kohei Yatabe

We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take…

Numerical Analysis · Mathematics 2023-11-22 Armenak Petrosyan , Konstantin Pieper , Hoang Tran

Nonsmooth nonconvex optimization problems involving the $\ell^p$ quasi-norm, $p \in (0, 1]$, of a linear map are considered. A monotonically convergent scheme for a regularized version of the original problem is developed and necessary…

Optimization and Control · Mathematics 2017-09-20 Daria Ghilli , Karl Kunisch

In this paper we show the use of the focal underdetermined system solver to recover sparse empirical quadrature rules for parametrized integrals from existing data, consisting of the values of given parametric functions sampled on a…

Numerical Analysis · Mathematics 2021-06-24 Mattia Manucci , Jose Vicente Aguado , Domenico Borzacchiello

The problem of minimizing a polynomial over a set of polynomial inequalities is an NP-hard non-convex problem. Thanks to powerful results from real algebraic geometry, one can convert this problem into a nested sequence of…

Optimization and Control · Mathematics 2022-08-26 Victor Magron , Jie Wang

We consider the ill-posed operator equation $Ax=y$ with an injective and bounded linear operator $A$ mapping between $\ell^2$ and a Hilbert space $Y$, possessing the unique solution \linebreak $x^\dag=\{x^\dag_k\}_{k=1}^\infty$. For the…

Functional Analysis · Mathematics 2017-01-04 De-Han Chen , Bernd Hofmann , Jun Zou

We consider second-order elliptic equations in a half space with leading coefficients measurable in a tangential direction. We prove the $W^2_p$-estimate and solvability for the Dirichlet problem when $p\in (1,2]$, and for the Neumann…

Analysis of PDEs · Mathematics 2013-03-15 Hongjie Dong

This paper is intended to solve the nonconvex $\ell_{p}$-ball constrained nonlinear optimization problems. An iteratively reweighted method is proposed, which solves a sequence of weighted $\ell_{1}$-ball projection subproblems. At each…

Optimization and Control · Mathematics 2024-10-28 Hao Wang , Xiangyu Yang , Wei Jiang

In this paper we characterize sparse solutions for variational problems of the form $\min_{u\in X} \phi(u) + F(\mathcal{A} u)$, where $X$ is a locally convex space, $\mathcal{A}$ is a linear continuous operator that maps into a finite…

Optimization and Control · Mathematics 2019-12-04 Kristian Bredies , Marcello Carioni

We give a short linear--algebraic proof of the inequality \[ \|x\|_1\,\|x\|_\infty \le \frac{1+\sqrt{p}}{2}\,\|x\|_2^2, \] valid for every \(x\in\mathbb{R}^p\). This inequality relates three fundamental norms on finite-dimensional spaces…

Classical Analysis and ODEs · Mathematics 2026-04-03 Jose Antonio Lara Benitez

In recent years, there have been significant advances in efficiently solving $\ell_s$-regression using linear system solvers and $\ell_2$-regression [Adil-Kyng-Peng-Sachdeva, J. ACM'24]. Would efficient smoothed $\ell_p$-norm solvers lead…

Optimization and Control · Mathematics 2026-01-16 Deeksha Adil , Brian Bullins , Arun Jambulapati , Aaron Sidford

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

We consider a class of sparse learning problems in high dimensional feature space regularized by a structured sparsity-inducing norm which incorporates prior knowledge of the group structure of the features. Such problems often pose a…

Optimization and Control · Mathematics 2014-02-11 Zhiwei Qin , Donald Goldfarb

We study an elliptic operator $L:=\mathrm{div}(A\nabla \cdot)$ on the upper half space. It is known that solvability of the Regularity problem in $\dot{W}^{1,p}$ implies solvability of the adjoint Dirichlet problem in $L^{p'}$. Previously,…

Analysis of PDEs · Mathematics 2025-10-03 Martin Ulmer

The literature on sparse recovery often adopts the $l_p$ "norm" $(p\in[0,1])$ as the penalty to induce sparsity of the signal satisfying an underdetermined linear system. The performance of the corresponding $l_p$ minimization problem can…

Information Theory · Computer Science 2015-06-24 Laming Chen , Yuantao Gu