English
Related papers

Related papers: Convergence rates in $\mathbf{\ell^1}$-regularizat…

200 papers

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

We consider linear and obstacle problems driven by a nonlocal integral operator, for which nonlocal interactions are restricted to a ball of finite radius. These type of operators are used to model anomalous diffusion and, for a special…

Numerical Analysis · Mathematics 2018-04-30 Olena Burkovska , Max Gunzburger

Measuring the error by an l^1-norm, we analyze under sparsity assumptions an l^0-regularization approach, where the penalty in the Tikhonov functional is complemented by a general stabilizing convex functional. In this context, ill-posed…

Numerical Analysis · Mathematics 2018-10-23 Wei Wang , Shuai Lu , Bernd Hofmann , Jin Cheng

This paper studies the sparsistency and rates of convergence for estimating sparse covariance and precision matrices based on penalized likelihood with nonconvex penalty functions. Here, sparsistency refers to the property that all…

Statistics Theory · Mathematics 2009-11-20 Clifford Lam , Jianqing Fan

We obtain bounds on estimation error rates for regularization procedures of the form \begin{equation*} \hat f \in {\rm argmin}_{f\in F}\left(\frac{1}{N}\sum_{i=1}^N\left(Y_i-f(X_i)\right)^2+\lambda \Psi(f)\right) \end{equation*} when $\Psi$…

Statistics Theory · Mathematics 2017-01-04 Guillaume Lecué , Shahar Mendelson

A general deterministic analysis to state the necessary conditions with a coefficient determination for the variational source condition to hold is provided. Of particular interest in terms of the choice of the regularization parameter, it…

Numerical Analysis · Mathematics 2016-07-19 Erdem Altuntac

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

In this paper, we deal with nonlinear ill-posed problems involving monotone operators and consider Lavrentiev's regularization method. This approach, in contrast to Tikhonov's regularization method, does not make use of the adjoint of the…

Numerical Analysis · Mathematics 2016-04-20 Bernd Hofmann , Barbara Kaltenbacher , Elena Resmerita

In this paper, we investigate an inverse random source problem concerned with recovering the strength of a random, uncorrelated acoustic source from correlation measurements of emitted time-harmonic acoustic waves. Such problems arise in…

Numerical Analysis · Mathematics 2026-02-25 Philipp Mickan , Thorsten Hohage

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

Analysis sparsity is a common prior in inverse problem or machine learning including special cases such as Total Variation regularization, Edge Lasso and Fused Lasso. We study the geometry of the solution set (a polyhedron) of the analysis…

Optimization and Control · Mathematics 2022-04-14 Xavier Dupuis , Samuel Vaiter

We demonstrate that the primal-dual witness proof method may be used to establish variable selection consistency and $\ell_\infty$-bounds for sparse regression problems, even when the loss function and/or regularizer are nonconvex. Using…

Statistics Theory · Mathematics 2014-12-19 Po-Ling Loh , Martin J. Wainwright

We consider the sparse optimization problem with nonlinear constraints and an objective function, which is given by the sum of a general smooth mapping and an additional term defined by the $ \ell_0 $-quasi-norm. This term is used to obtain…

Optimization and Control · Mathematics 2022-10-19 Christian Kanzow , Alexandra Schwarz , Felix Weiß

The linear functional strategy for the regularization of inverse problems is considered. For selecting the regularization parameter therein, we propose the heuristic quasi-optimality principle and some modifications including the smoothness…

Numerical Analysis · Mathematics 2018-05-23 Stefan Kindermann , Sergiy Pereverzyev , Andrey Pilipenko

The most widely used form of convolutional sparse coding uses an $\ell_1$ regularization term. While this approach has been successful in a variety of applications, a limitation of the $\ell_1$ penalty is that it is homogeneous across the…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Brendt Wohlberg

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

As a tractable approach, regularization is frequently adopted in sparse optimization. This gives rise to the regularized optimization, aiming at minimizing the $\ell_0$ norm or its continuous surrogates that characterize the sparsity. From…

Optimization and Control · Mathematics 2021-11-17 Shenglong Zhou , Lili Pan , Naihua Xiu

This paper addresses Tikhonov like regularization methods with convex penalty functionals for solving nonlinear ill-posed operator equations formulated in Banach or, more general, topological spaces. We present an approach for proving…

Numerical Analysis · Mathematics 2009-06-19 Jens Geissler , Bernd Hofmann

The main purpose of this paper is to study the problem of determining initial condition of nonlinear parabolic equation from noisy observations of the final condition. We introduce a regularized method to establish an approximate solution.…

Analysis of PDEs · Mathematics 2017-11-30 Erkan Nane , Nguyen Huy Tuan