English
Related papers

Related papers: Flexible Krylov methods for $\ell_p$ regularizatio…

200 papers

The solution of sequences of shifted linear systems is a classic problem in numerical linear algebra, and a variety of efficient methods have been proposed over the years. Nevertheless, there still exist challenging scenarios witnessing a…

Numerical Analysis · Mathematics 2026-01-28 Hussam Al Daas , Davide Palitta

We make some remarks on a variant of the classical Tikhonov regularization in optimal control under PDEs which allows for a certain flexibility in dealing with non-linearities and state restrictions, in the sense that differential…

Optimization and Control · Mathematics 2019-04-02 Pablo Pedregal

Regularization of ill-posed linear inverse problems via $\ell_1$ penalization has been proposed for cases where the solution is known to be (almost) sparse. One way to obtain the minimizer of such an $\ell_1$ penalized functional is via an…

Numerical Analysis · Mathematics 2013-01-01 I. Daubechies , M. Fornasier , I. Loris

The Tikhonov-Phillips method is widely used for regularizing ill-posed inverse problems mainly due to the simplicity of its formulation as an optimization problem. The use of different penalizers in the functionals associated to the…

Functional Analysis · Mathematics 2011-08-23 Gisela L. Mazzieri , Ruben D. Spies , Karina G. Temperini

We propose a novel algorithm based on inexact GMRES methods for linear response calculations in density functional theory. Such calculations require iteratively solving a nested linear problem $\mathcal{E} \delta\rho = b$ to obtain the…

Numerical Analysis · Mathematics 2025-10-30 Michael F. Herbst , Bonan Sun

The hybrid LSMR algorithm is proposed for large-scale general-form regularization. It is based on a Krylov subspace projection method where the matrix $A$ is first projected onto a subspace, typically a Krylov subspace, which is implemented…

Numerical Analysis · Mathematics 2024-09-17 Yanfei Yang

We consider the efficient minimization of a nonlinear, strictly convex functional with $\ell_1$-penalty term. Such minimization problems appear in a wide range of applications like Tikhonov regularization of (non)linear inverse problems…

Optimization and Control · Mathematics 2016-04-12 Esther Hans , Thorsten Raasch

This article presents a method for solving large-scale linear inverse problems regular- ized with a nonlinear, edge-preserving penalty term such as the total variation or Perona-Malik. In the proposed scheme, the nonlinearity is handled…

Numerical Analysis · Mathematics 2013-09-02 Simon R. Arridge , Marta M. Betcke , Lauri Harhanen

In this paper we discuss a deterministic form of ensemble Kalman inversion as a regularization method for linear inverse problems. By interpreting ensemble Kalman inversion as a low-rank approximation of Tikhonov regularization, we are able…

Numerical Analysis · Mathematics 2023-10-31 Fabian Parzer , Otmar Scherzer

In the numerical treatment of large-scale Sylvester and Lyapunov equations, projection methods require solving a reduced problem to check convergence. As the approximation space expands, this solution takes an increasing portion of the…

Numerical Analysis · Mathematics 2017-02-03 Davide Palitta , Valeria Simoncini

Iterative solvers for large-scale linear systems such as Krylov subspace methods can diverge when the linear system is ill-conditioned, thus significantly reducing the applicability of these iterative methods in practice for…

Numerical Analysis · Mathematics 2025-07-24 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

P-splines are penalized B-splines, in which finite order differences in coefficients are typically penalized with an $\ell_2$ norm. P-splines can be used for semiparametric regression and can include random effects to account for…

Methodology · Statistics 2018-11-01 Brian D. Segal , Michael R. Elliott , Thomas Braun , Hui Jiang

We propose a fast algorithm for computing the entire ridge regression regularization path in nearly linear time. Our method constructs a basis on which the solution of ridge regression can be computed instantly for any value of the…

Optimization and Control · Mathematics 2022-10-25 Yifei Wang , Mert Pilanci

With the steady advance of high performance computing systems featuring smaller and smaller hardware components, the systems and algorithms used for numerical simulations increasingly contend with disruptions caused by hardware failures and…

Numerical Analysis · Mathematics 2022-02-09 Mike Gillard , Tommaso Benacchio

Many applications in science and engineering require the solution of large linear discrete ill-posed problems that are obtained by the discretization of a Fredholm integral equation of the first kind in several space-dimensions. The matrix…

Numerical Analysis · Mathematics 2017-05-19 Laura Dykes , Guangxin Huang , Silvia Noschese , Lothar Reichel

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

Optimization and Control · Mathematics 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang

Optimization problems over permutation matrices appear widely in facility layout, chip design, scheduling, pattern recognition, computer vision, graph matching, etc. Since this problem is NP-hard due to the combinatorial nature of…

Optimization and Control · Mathematics 2016-09-01 Bo Jiang , Ya-Feng Liu , Zaiwen Wen

Boundary element methods produce dense linear systems that can be accelerated via multipole expansions. Solved with Krylov methods, this implies computing the matrix-vector products within each iteration with some error, at an accuracy…

Numerical Analysis · Mathematics 2016-10-04 Tingyu Wang , Simon K. Layton , Lorena A. Barba

We propose an adaptive randomized truncation estimator for Krylov subspace methods that optimizes the trade-off between the solution variance and the computational cost, while remaining unbiased. The estimator solves a constrained…

Numerical Analysis · Mathematics 2025-04-08 Qi Luo , Florian Schäfer