English
Related papers

Related papers: The Kurdyka-\L{}ojasiewicz inequality as regularit…

200 papers

Algebraic convergences rates of (iterated) Tikhonov regularization for linear inverse problems in Hilbert spaces are characterized by the membership of the exact solution to intermediate spaces produced by the K-method of real…

Numerical Analysis · Mathematics 2015-09-30 Roman Andreev

The goal of this paper is to give the necessary and sufficient condition for Banach function spaces on which Young's inequality holds. As an application, we consider the maximal regularity estimate of heat equations for Besov spaces…

Functional Analysis · Mathematics 2025-09-08 Toru Nogayama

We study the linear convergence rates of the proximal gradient method for composite functions satisfying two classes of Polyak-{\L}ojasiewicz (PL) inequality: the PL inequality, the variant of PL inequality defined by the proximal map-based…

Optimization and Control · Mathematics 2025-07-01 Qingyuan Kong , Rujun Jiang , Yihan He

We consider a class of $\ell_1$-regularized optimization problems and the associated smooth "over-parameterized" optimization problems built upon the Hadamard parametrization, or equivalently, the Hadamard difference parametrization (HDP).…

Optimization and Control · Mathematics 2024-06-18 Wenqing Ouyang , Yuncheng Liu , Ting Kei Pong , Hao Wang

In this paper, we derive a new linear convergence rate for the gradient method with fixed step lengths for non-convex smooth optimization problems satisfying the Polyak-Lojasiewicz (PL) inequality. We establish that the PL inequality is a…

Optimization and Control · Mathematics 2022-04-05 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

Identifiability, and the closely related idea of partial smoothness, unify classical active set methods and more general notions of solution structure. Diverse optimization algorithms generate iterates in discrete time that are eventually…

Optimization and Control · Mathematics 2024-06-24 Adrian Lewis , Tonghua Tian

In this paper, we consider a class of nonsmooth sum-of-ratios fractional optimization problems with block structure. This model class is ubiquitous and encompasses several important nonsmooth optimization problems in the literature. We…

Optimization and Control · Mathematics 2023-05-22 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

In recent years, a series of convergence rates conditions for regularization methods has been developed. Mainly, the motivations for developing novel conditions came from the desire to carry over convergence rates results from the Hilbert…

Functional Analysis · Mathematics 2014-09-29 Roman Andreev , Peter Elbau , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

The Hardy-Littlewood-P\'{o}lya inequality of majorization is extended to the framework of ordered Banach spaces. Several applications illustrating our main results are also included.

Functional Analysis · Mathematics 2021-04-26 Constantin P. Niculescu

Convergence rates in spectral regularization methods quantify the approximation error in inverse problems as a function of the noise level or the number of sampling points. Classical strong convergence rate results typically rely on source…

Numerical Analysis · Mathematics 2025-12-05 Sabrina Guastavino , Gabriele Santin , Francesco Marchetti , Federico Benvenuto

We shall study in this paper the Lipschitz type stabilities and convergence rates of Tikhonov regularization for the recovery of the radiativities in elliptic and parabolic systems with Dirichlet boundary conditions. The Lipschitz type…

Analysis of PDEs · Mathematics 2020-08-26 De-Han Chen , Daijun Jiang , Jun Zou

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

Estimating entropy and mutual information consistently is important for many machine learning applications. The Kozachenko-Leonenko (KL) estimator (Kozachenko & Leonenko, 1987) is a widely used nonparametric estimator for the entropy of…

Statistics Theory · Mathematics 2016-07-22 Shashank Singh , Barnabás Póczos

We consider the strongly convergent modified versions of the Krasnosel'ski\u{\i}-Mann, the forward-backward and the Douglas-Rachford algorithms with Tikhonov regularization terms, introduced by Radu Bo\c{t}, Ern\"{o} Csetnek and Dennis…

Functional Analysis · Mathematics 2021-01-05 Bruno Dinis , Pedro Pinto

We show that a vector-valued Kahn--Kalai--Linial inequality holds in every Banach space of Rademacher type 2. We also show that for any nondecreasing function $h\geq 0$ with $0<\int_{1}^{\infty}\frac{h(t)}{t^{2}}\mathrm{dt}<\infty$ we have…

Probability · Mathematics 2024-05-01 Paata Ivanisvili , Yonathan Stone

This paper considers the problem of establishing $L^p$-improving inequalities for Radon-like operators in intermediate dimensions (i.e., for averages overs submanifolds which are neither curves nor hypersurfaces). Due to limitations in…

Classical Analysis and ODEs · Mathematics 2020-08-06 Philip T. Gressman

This paper focuses on a class of zero-norm composite optimization problems. For this class of nonconvex nonsmooth problems, we establish the Kurdyka-Lojasiewicz property of exponent being a half for its objective function under a suitable…

Optimization and Control · Mathematics 2021-01-26 Yuqia Wu , Shaohua Pan , Shujun Bi

We study the Tikhonov regularization for ill-posed non-linear operator equations in Hilbert scales. Our focus is on the interplay between the smoothness-promoting properties of the penalty and the smoothness inherent in the solution. The…

Numerical Analysis · Mathematics 2018-01-17 Bernd Hofmann , Peter Mathé

This paper investigates the convergence rate for Tikhonov regularization of the problem of identifying the coefficient $a \in L^{\infty}(\Omega)$ in the Robin-boundary equation $-\mathrm{div}(a\nabla u)-bu=f,~ x \in \Omega \subset \mathbb…

Analysis of PDEs · Mathematics 2024-03-18 Huimin Huang , Wensheng Zhang