English
Related papers

Related papers: Injectivity and weak*-to-weak continuity suffice f…

200 papers

In this paper, we focus on the local convergence rate analysis of the proximal iteratively reweighted $\ell_1$ algorithms for solving $\ell_p$ regularization problems, which are widely applied for inducing sparse solutions. We show that if…

Optimization and Control · Mathematics 2021-01-12 Hao Wang , Hao Zeng , Jiashan Wang

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

Optimization and Control · Mathematics 2026-03-20 Dan Garber

In the context of compressed sensing, the nonconvex $\ell_q$ minimization with $0<q<1$ has been studied in recent years. In this paper, by generalizing the sharp bound for $\ell_1$ minimization of Cai and Zhang, we show that the condition…

Information Theory · Computer Science 2015-06-17 Chao-Bing Song , Shu-Tao Xia

As a tractable approach, regularization is frequently adopted in sparse optimization. This gives rise to the regularized optimization, aiming at minimizing the $\ell_0$ norm or its continuous surrogates that characterize the sparsity. From…

Optimization and Control · Mathematics 2021-11-17 Shenglong Zhou , Lili Pan , Naihua Xiu

In the literature on singular perturbation (Lavrentiev regularization) for the stable approximate solution of operator equations with monotone operators in the Hilbert space the phenomena of conditional stability and local well-posedness…

Numerical Analysis · Mathematics 2016-11-23 Radu Ioan Bot , Bernd Hofmann

The article addresses the convergence of implicit and semi-implicit, fully discrete approximations of a class of nonlinear parabolic evolution problems. Such schemes are popular in the numerical solution of evolutions defined with the…

Numerical Analysis · Mathematics 2019-02-22 Sören Bartels , Michael Růžička

Lasso, or $\ell^1$ regularized least squares, has been explored extensively for its remarkable sparsity properties. It is shown in this paper that the solution to Lasso, in addition to its sparsity, has robustness properties: it is the…

Information Theory · Computer Science 2008-11-13 Huan Xu , Constantine Caramanis , Shie Mannor

In this paper we consider the rate of convergence of solutions of a scalar ordinary differential equation which is a perturbed version of an autonomous equation with a globally stable equilibrium. Under weak assumptions on the nonlinear…

Classical Analysis and ODEs · Mathematics 2016-07-12 John A. D. Appleby , Denis D. Patterson

Compressed sensing (CS) is a powerful tool for reducing the amount of data to be collected while maintaining high spatial resolution. Such techniques work well in practice and at the same time are supported by solid theory. Standard CS…

Information Theory · Computer Science 2022-12-28 Andrea Ebner , Markus Haltmeier

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

In this paper, we discuss the statistical properties of the $\ell_q$ optimization methods $(0<q\leq 1)$, including the $\ell_q$ minimization method and the $\ell_q$ regularization method, for estimating a sparse parameter from noisy…

Machine Learning · Statistics 2019-11-14 Xin Li , Yaohua Hu , Chong Li , Xiaoqi Yang , Tianzi Jiang

This paper investigates the theoretical guarantees of L1-analysis regularization when solving linear inverse problems. Most of previous works in the literature have mainly focused on the sparse synthesis prior where the sparsity is measured…

Information Theory · Computer Science 2012-10-03 Samuel Vaiter , Gabriel Peyré , Charles Dossal , Jalal Fadili

We first establish strong convergence rates for multiscale systems driven by $\alpha$-stable processes, with analyses constructed in two distinct scaling regimes. When addressing weak convergence rates of this system, we derive four…

Probability · Mathematics 2026-03-03 Kun Yin

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic…

Statistics Theory · Mathematics 2013-02-28 Anatoli Juditsky , Fatma Kılınç Karzan , Arkadi Nemirovski , Boris Polyak

In this paper we prove convergence to a steady state as $t\to\infty$ for solutions to the subdiffusion equation \[ \partial_t^\alpha u - \mathbb{L} u = q(x)u - p(x)f(u) + r \] with the exponential ($\alpha=1$) or power law…

Analysis of PDEs · Mathematics 2026-02-02 Barbara Kaltenbacher

We examine the rate of convergence of the Lasso estimator of lower dimensional components of the high-dimensional parameter. Under bounds on the $\ell_1$-norm on the worst possible sub-direction these rates are of order $\sqrt {|J| \log p /…

Statistics Theory · Mathematics 2014-03-28 Sara van de Geer

We prove rate of convergence results for singular perturbations of Hamilton-Jacobi equations in unbounded spaces where the fast operator is linear, uniformly elliptic and has an Ornstein-Uhlenbeck-type drift. The slow operator is a fully…

Analysis of PDEs · Mathematics 2022-01-13 Daria Ghilli , Claudio Marchi

Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when…

Machine Learning · Computer Science 2026-05-29 Huangyu Xu , Jingqin Yang , Qianqian Xu , Jiaye Teng

This paper considers sparsity in linear regression under the restriction that the regression weights sum to one. We propose an approach that combines $\ell_0$- and $\ell_1$-regularization. We compute its solution by adapting a recent…

Methodology · Statistics 2019-07-11 Nick Koning , Paul Bekker