English
Related papers

Related papers: $\ell_{1}^{2}-\eta\ell_{2}^{2}$ sparsity regulariz…

200 papers

We focus on the minimization of the least square loss function either under a $k$-sparse constraint or with a sparse penalty term. Based on recent results, we reformulate the $\ell_0$ pseudo-norm exactly as a convex minimization problem by…

Optimization and Control · Mathematics 2019-03-07 Arne Bechensteen , Laure Blanc-Féraud , Gilles Aubert

We consider nonconstant periodic constrained minimizers of semilinear elliptic equations for integro-differential operators in $\mathbb{R}$. We prove that, after an appropriate translation, each of them is necessarily an even function which…

Analysis of PDEs · Mathematics 2024-04-10 Xavier Cabre , Gyula Csató , Albert Mas

During the past years there has been an explosion of interest in learning methods based on sparsity regularization. In this paper, we discuss a general class of such methods, in which the regularizer can be expressed as the composition of a…

Machine Learning · Computer Science 2013-03-26 Andreas Argyriou , Luca Baldassarre , Charles A. Micchelli , Massimiliano Pontil

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2010-04-06 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

We propose a convex variational principle to find sparse representation of low-lying eigenspace of symmetric matrices. In the context of electronic structure calculation, this corresponds to a sparse density matrix minimization algorithm…

Mathematical Physics · Physics 2014-03-11 Rongjie Lai , Jianfeng Lu , Stanley Osher

In this effort, we propose a convex optimization approach based on weighted $\ell_1$-regularization for reconstructing objects of interest, such as signals or images, that are sparse or compressible in a wavelet basis. We recover the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Joseph Daws , Armenak Petrosyan , Hoang Tran , Clayton G. Webster

We introduce subgradient-based Lavrentiev regularisation of the form \begin{equation*} \mathcal{A}(u) + \alpha \partial \mathcal{R}(u) \ni f^\delta \end{equation*} for linear and nonlinear ill-posed problems with monotone operators…

Optimization and Control · Mathematics 2024-10-01 Markus Grasmair , Fredrik Hildrum

A regularization algorithm using inexact function values and inexact derivatives is proposed and its evaluation complexity analyzed. This algorithm is applicable to unconstrained problems and to problems with inexpensive constraints (that…

Optimization and Control · Mathematics 2019-04-22 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

Classical sparsity promoting methods rely on the l0 norm, which treats all nonzero components as equally significant. In practical inverse problems, however, solutions often exhibit many small amplitude components that have little effect on…

Machine Learning · Computer Science 2026-03-17 Haoyu He , Hao Wang , Jiashan Wang , Hao Zeng

With the capability of accurately representing a functional relationship between the inputs of a physical system's model and output quantities of interest, neural networks have become popular for surrogate modeling in scientific…

Machine Learning · Statistics 2022-04-06 Subhayan De , Alireza Doostan

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

We establish an equivalence between the $\ell_2$-regularized solution path for a convex loss function, and the solution of an ordinary differentiable equation (ODE). Importantly, this equivalence reveals that the solution path can be viewed…

Machine Learning · Statistics 2021-07-08 Yunzhang Zhu , Renxiong Liu

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

Methodology · Statistics 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

In the context of compressed sensing, the nonconvex $\ell_q$ minimization with $0<q<1$ has been studied in recent years. In this paper, by generalizing the sharp bound for $\ell_1$ minimization of Cai and Zhang, we show that the condition…

Information Theory · Computer Science 2015-06-17 Chao-Bing Song , Shu-Tao Xia

This paper studies $\ell_1$ regularization with high-dimensional features for support vector machines with a built-in reject option (meaning that the decision of classifying an observation can be withheld at a cost lower than that of…

Statistics Theory · Mathematics 2012-01-06 Marten Wegkamp , Ming Yuan

In this paper we discuss the numerical solution of elliptic distributed optimal control problems with state or control constraints when the control is considered in the energy norm. As in the unconstrained case we can relate the…

Numerical Analysis · Mathematics 2023-06-28 Peter Gangl , Richard Löscher , Olaf Steinbach

It is well known that $\ell_1$ minimization can be used to recover sufficiently sparse unknown signals from compressed linear measurements. In fact, exact thresholds on the sparsity, as a function of the ratio between the system dimensions,…

Information Theory · Computer Science 2011-11-08 M. Amin Khajehnejad , Weiyu Xu , A. Salman Avestimehr , Babak Hassibi

In this paper we look at a particular problem related to under-determined linear systems of equations with sparse solutions. $\ell_1$-minimization is a fairly successful polynomial technique that can in certain statistical scenarios find…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

This paper considers a large class of linear operator equations, including linear boundary value problems for partial differential equations, and treats them as linear recovery problems for objects from their data. Well-posedness of the…

Numerical Analysis · Mathematics 2014-03-17 Robert Schaback