English
Related papers

Related papers: Convergence rates for Tikhonov regularization on c…

200 papers

In this paper we provide a convergence analysis of some variational methods alternative to the classical Tikhonov regularization, namely Ivanov regularization (also called method of quasi solutions) with some versions of the discrepancy…

Numerical Analysis · Mathematics 2018-04-18 Barbara Kaltenbacher , Andrej Klassen

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We consider a regularization concept for the solution of ill--posed operator equations, where the operator is composed of a continuous and a discontinuous operator. A particular application is level set regularization, where we develop a…

Numerical Analysis · Mathematics 2020-11-16 F. Frühauf , O. Scherzer , A. Leitao

Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that the original signal can be approximated linearly by optimal…

Optimization and Control · Mathematics 2025-05-30 Tran T. A. Nghia , Huy N. Pham , Nghia V. Vo

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

We consider the stable approximation of sparse solutions to non-linear operator equations by means of Tikhonov regularization with a subquadratic penalty term. Imposing certain assumptions, which for a linear operator are equivalent to the…

Functional Analysis · Mathematics 2009-12-06 Markus Grasmair , Markus Haltmeier , Otmar Scherzer

In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

In this short note, we formulate the convergence rates of the well known Tikhonov regularization scheme for solving the nonlinear ill-posed problems in Banach spaces. For deriving the convergence rates, we employ the novel smoothness…

Numerical Analysis · Mathematics 2022-11-30 Gaurav Mittal , Ankik Kumar Giri

Given a compact linear operator $\K$, the (pseudo) inverse $\K^\dagger$ is usually substituted by a family of regularizing operators $\R_\alpha$ which depends on $\K$ itself. Naturally, in the actual computation we are forced to approximate…

Numerical Analysis · Mathematics 2021-06-22 Davide Bianchi , Marco Donatelli

We study filter based regularization methods for linear ill-posed problems between Hilbert spaces. We derive optimal order conditions under a-priori choice rules for the regularization parameter. Such analysis is applied to the fractional…

Numerical Analysis · Mathematics 2014-05-09 Davide Bianchi , Marco Donatelli , Stefano Serra-Capizzano

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

The paper proposes a novel regularization procedure for machine learning. The proposed high-order regularization (HR) provides new insight into regularization, which is widely used to train a neural network that can be utilized to…

Machine Learning · Computer Science 2025-05-14 Xinghua Liu , Ming Cao

We study the application of Tikhonov regularization to ill-posed nonlinear operator equations. The objective of this work is to prove low order convergence rates for the discrepancy principle under low order source conditions of logarithmic…

Numerical Analysis · Mathematics 2023-05-02 Chantal Klinkhammer , Robert Plato

With the rapid growth of data, how to extract effective information from data is one of the most fundamental problems. In this paper, based on Tikhonov regularization, we propose an effective method for reconstructing the function and its…

Numerical Analysis · Mathematics 2021-05-04 Jiantang Zhang , Jin Cheng , Min Zhong

Inverse problems arise in a number of domains such as medical imaging, remote sensing, and many more, relying on the use of advanced signal and image processing approaches -- such as sparsity-driven techniques -- to determine their…

Machine Learning · Computer Science 2019-02-01 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

It is well-known in practice, that L^1 data fitting leads to improved robustness compared to standard L^2 data fitting. However, it is unclear whether resulting algorithms will perform as well in case of regular data without outliers. In…

Numerical Analysis · Mathematics 2026-01-16 Kristina Bätz , Frank Werner

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

This paper deals with a Tikhonov regularized second-order inertial dynamical system that incorporates time scaling, asymptotically vanishing damping and Hessian-driven damping for solving convex optimization problems. Under appropriate…

Optimization and Control · Mathematics 2026-04-30 Xiangkai Sun , Guoxiang Tian , Huan Zhang

Adaptive cubic regularization methods for solving nonconvex problems need the efficient computation of the trial step, involving the minimization of a cubic model. We propose a new approach in which this model is minimized in a low…

Optimization and Control · Mathematics 2024-12-02 Stefania Bellavia , Davide Palitta , Margherita Porcelli , Valeria Simoncini

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili