English
Related papers

Related papers: Flexible Krylov methods for $\ell_p$ regularizatio…

200 papers

In this paper, we focus on the local convergence rate analysis of the proximal iteratively reweighted $\ell_1$ algorithms for solving $\ell_p$ regularization problems, which are widely applied for inducing sparse solutions. We show that if…

Optimization and Control · Mathematics 2021-01-12 Hao Wang , Hao Zeng , Jiashan Wang

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

A wide range of applications necessitates solving large-scale ill-posed problems contaminated by noise. Krylov subspace regularization methods are particularly advantageous in this context, as they rely solely on matrix-vector…

Numerical Analysis · Mathematics 2025-06-25 Eva Mikušová , Iveta Hnětynková

Constrained least squares problems arise in a variety of applications, and many iterative methods are already available to compute their solutions. This paper proposes a new efficient approach to solve nonnegative linear least squares…

Numerical Analysis · Mathematics 2017-01-09 Silvia Gazzola , Yves Wiaux

Tikhonov regularization is one of the most commonly used methods of regularization of ill-posed problems. In the setting of finite element solutions of elliptic partial differential control problems, Tikhonov regularization amounts to…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Peter Hansbo , Mats Larson

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie

Solving equilibrium problems under constraints is an important problem in optimization and optimal control. In this context an important practical challenge is the efficient incorporation of constraints. We develop a continuous-time method…

Optimization and Control · Mathematics 2024-03-21 Siqi Qu , Mathias Staudigl

Iterative Krylov projection methods have become widely used for solving large-scale linear inverse problems. However, methods based on orthogonality include the computation of inner-products, which become costly when the number of…

Numerical Analysis · Mathematics 2025-02-06 Malena Sabaté Landman , Ariana N. Brown , Julianne Chung , James G. Nagy

A primary computational problem in kernel regression is solution of a dense linear system with the $N\times N$ kernel matrix. Because a direct solution has an O($N^3$) cost, iterative Krylov methods are often used with fast matrix-vector…

Numerical Analysis · Computer Science 2014-08-07 Balaji Vasan Srinivasan , Qi Hu , Nail A. Gumerov , Raghu Murtugudde , Ramani Duraiswami

The Tikhonov regularization of linear ill-posed problems with an $\ell^1$ penalty is considered. We recall results for linear convergence rates and results on exact recovery of the support. Moreover, we derive conditions for exact support…

Functional Analysis · Mathematics 2015-05-18 Dirk A. Lorenz , Stefan Schiffler , Dennis Trede

We consider an effective new method for solving trust-region and norm-regularization problems that arise as subproblems in many optimization applications. We show that the solutions to such subproblems effectively lie in a…

Numerical Analysis · Mathematics 2026-03-03 Hussam Al Daas , Nicholas I. M. Gould

We present a new inner-outer iterative algorithm for edge enhancement in imaging problems. At each outer iteration, we formulate a Tikhonov-regularized problem where the penalization is expressed in the 2-norm and involves a regularization…

Numerical Analysis · Mathematics 2020-12-30 Silvia Gazzola , Misha E. Kilmer , James G. Nagy , Oguz Semerici , Eric L. Miller

For linear inverse problems with a large number of unknown parameters, uncertainty quantification remains a challenging task. In this work, we use Krylov subspace methods to approximate the posterior covariance matrix and describe efficient…

Numerical Analysis · Mathematics 2019-05-22 Arvind K. Saibaba , Julianne Chung , Katrina Petroske

Advanced Krylov subspace methods are investigated for the solution of large sparse linear systems arising from stiff adjoint-based aerodynamic shape optimization problems. A special attention is paid to the flexible inner-outer GMRES…

Numerical Analysis · Mathematics 2024-04-30 Mehdi Jadoui , Christophe Blondeau , Emeric Martin , Florent Renac , François-Xavier Roux

Context. Numerical solutions to transfer problems of polarized radiation in solar and stellar atmospheres commonly rely on stationary iterative methods, which often perform poorly when applied to large problems. In recent times, stationary…

Numerical Analysis · Mathematics 2021-12-08 Pietro Benedusi , Gioele Janett , Luca Belluzzi , Rolf Krause

We propose a sparse reconstruction framework for solving inverse problems. Opposed to existing sparse regularization techniques that are based on frame representations, we train an encoder-decoder network by including an $\ell^1$-penalty.…

Numerical Analysis · Mathematics 2019-08-07 Daniel Obmann , Johannes Schwab , Markus Haltmeier

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

Adaptive cubic regularization methods for solving nonconvex problems need the efficient computation of the trial step, involving the minimization of a cubic model. We propose a new approach in which this model is minimized in a low…

Optimization and Control · Mathematics 2024-12-02 Stefania Bellavia , Davide Palitta , Margherita Porcelli , Valeria Simoncini

Several generalizations of the traditional Tikhonov-Phillips regularization method have been proposed during the last two decades. Many of these generalizations are based upon inducing stability throughout the use of different penalizers…

Functional Analysis · Mathematics 2014-03-25 Gisela L. Mazzieri , Ruben D. Spies , Karina G. Temperini

In this paper, we discuss how a suitable family of tensor kernels can be used to efficiently solve nonparametric extensions of $\ell^p$ regularized learning methods. Our main contribution is proposing a fast dual algorithm, and showing that…

Machine Learning · Statistics 2017-10-19 Saverio Salzo , Johan A. K. Suykens , Lorenzo Rosasco