English
Related papers

Related papers: Regularization of linear inverse problems by ratio…

200 papers

We consider an effective new method for solving trust-region and norm-regularization problems that arise as subproblems in many optimization applications. We show that the solutions to such subproblems effectively lie in a…

Numerical Analysis · Mathematics 2026-03-03 Hussam Al Daas , Nicholas I. M. Gould

We investigate regularized algorithms combining with projection for least-squares regression problem over a Hilbert space, covering nonparametric regression over a reproducing kernel Hilbert space. We prove convergence results with respect…

Machine Learning · Statistics 2018-10-09 Junhong Lin , Volkan Cevher

$\ell_1$ regularization is used to preserve edges or enforce sparsity in a solution to an inverse problem. We investigate the Split Bregman and the Majorization-Minimization iterative methods that turn this non-smooth minimization problem…

Numerical Analysis · Mathematics 2024-12-16 Brian Sweeney , Rosemary Renaut , Malena Español

This paper investigates using the conjugate gradient iterative solver for ill-posed problems. We show that preconditioner and Tikhonov-regularization work in conjunction. In particular when they employ the same symmetric positive…

Numerical Analysis · Mathematics 2025-12-12 Ahmed Chabib , Jean-Francois Witz , Vincent Magnier , Pierre Gosselet

Ensemble Kalman inversion is a parallelizable methodology for solving inverse or parameter estimation problems. Although it is based on ideas from Kalman filtering, it may be viewed as a derivative-free optimization method. In its most…

Numerical Analysis · Mathematics 2024-12-20 Neil K. Chada , Andrew M. Stuart , Xin T. Tong

In this paper we develop a procedure to deal with a family of parameter-dependent ill-posed problems, for which the exact solution in general does not exist. The original problems are relaxed by considering corresponding approximate ones,…

Analysis of PDEs · Mathematics 2022-06-29 Martin Lazar , Enrique Zuazua

We present an overview of randomized orthogonalization techniques that construct a well-conditioned basis whose sketch is orthonormal. Randomized orthogonalization has recently emerged as a powerful paradigm for reducing the computational…

Numerical Analysis · Mathematics 2025-12-18 Jean-Guillaume de Damas , Laura Grigori , Igor Simunec , Edouard Timsit

Rational Krylov subspaces have become a reference tool in dimension reduction procedures for several application problems. When data matrices are symmetric, a short-term recurrence can be used to generate an associated orthonormal basis. In…

Numerical Analysis · Mathematics 2021-12-21 Davide Palitta , Stefano Pozza , Valeria Simoncini

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

Numerical Analysis · Mathematics 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

The paper presents two variants of a Krylov-Simplex iterative method that combines Krylov and simplex iterations to minimize the residual $r = b-Ax$. The first method minimizes $\|r\|_\infty$, i.e. maximum of the absolute residuals. The…

Numerical Analysis · Mathematics 2021-01-28 Wim Vanroose , Jeffrey Cornelis

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

From the viewpoint of inverse problem, the optimization of drug release based on the multi-laminated drug controlled release devices has been regarded as the solution problem of the diffusion equation initial value inverse problem. In view…

Numerical Analysis · Mathematics 2019-04-15 Xinming Zhang , Ling Ma

For many applications involving a sequence of linear systems with slowly changing system matrices, subspace recycling, which exploits relationships among systems and reuses search space information, can achieve huge gains in iterations…

Numerical Analysis · Mathematics 2023-06-28 Misha E. Kilmer , Eric de Sturler

The problem of numerical differentiation can be thought of as an inverse problem by considering it as solving a Volterra equation. It is well known that such inverse integral problems are ill-posed and one requires regularization methods to…

Numerical Analysis · Mathematics 2020-04-15 Abinash Nayak

We propose a first-order method to solve the cubic regularization subproblem (CRS) based on a novel reformulation. The reformulation is a constrained convex optimization problem whose feasible region admits an easily computable projection.…

Optimization and Control · Mathematics 2021-06-03 Rujun Jiang , Man-Chung Yue , Zhishuo Zhou

We address the inverse problem of cosmic large-scale structure reconstruction from a Bayesian perspective. For a linear data model, a number of known and novel reconstruction schemes, which differ in terms of the underlying signal prior,…

Astrophysics · Physics 2009-11-06 F. S. Kitaura , T. A. Ensslin

The Golub-Kahan-Tikhonov method is a popular solution technique for large linear discrete ill-posed problems. This method first applies partial Golub-Kahan bidiagonalization to reduce the size of the given problem and then uses Tikhonov…

Numerical Analysis · Mathematics 2026-03-10 Davide Bianchi , Marco Donatelli , Davide Furchì , Lothar Reichel

The discretization of least-squares problems for linear ill-posed operator equations in Hilbert spaces is considered. The main subject of this article concerns conditions for convergence of the associated discretized minimum-norm…

Numerical Analysis · Mathematics 2016-02-10 Stefan Kindermann

The rational Krylov subspace method (RKSM) and the low-rank alternating directions implicit (LR-ADI) iteration are established numerical tools for computing low-rank solution factors of large-scale Lyapunov equations. In order to generate…

Numerical Analysis · Mathematics 2019-05-07 Patrick Kürschner , Melina A. Freitag

We study Tikhonov regularization for certain classes of non-linear ill-posed operator equations in Hilbert space. Emphasis is on the case where the solution smoothness fails to have a finite penalty value, as in the preceding study…

Numerical Analysis · Mathematics 2019-04-04 Bernd Hofmann , Peter Mathé