English
Related papers

Related papers: Convergence rates for Tikhonov regularization on c…

200 papers

In this work, we propose a high-order regularization method to solve the ill-conditioned problems in robot localization. Numerical solutions to robot localization problems are often unstable when the problems are ill-conditioned. A typical…

Robotics · Computer Science 2025-05-07 Xinghua Liu , Ming Cao

Regularization plays a pivotal role in ill-posed machine learning and inverse problems. However, the fundamental comparative analysis of various regularization norms remains open. We establish a small noise analysis framework to assess the…

Machine Learning · Statistics 2024-09-05 Quanjun Lang , Fei Lu

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

We investigate the strong convergence properties of a proximal-gradient inertial algorithm with two Tikhonov regularization terms in connection to the minimization problem of the sum of a convex lower semi-continuous function $f$ and a…

Optimization and Control · Mathematics 2024-07-16 Szilárd Csaba László

Proper regularization is critical for speeding up training, improving generalization performance, and learning compact models that are cost efficient. We propose and analyze regularized gradient descent algorithms for learning shallow…

Machine Learning · Computer Science 2018-06-08 Samet Oymak

We propose aNETT (augmented NETwork Tikhonov) regularization as a novel data-driven reconstruction framework for solving inverse problems. An encoder-decoder type network defines a regularizer consisting of a penalty term that enforces…

Numerical Analysis · Mathematics 2021-02-09 Daniel Obmann , Linh Nguyen , Johannes Schwab , Markus Haltmeier

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

We investigate the convergence theory of several known as well as new heuristic parameter choice rules for convex Tikhonov regularisation. The success of such methods is dependent on whether certain restrictions on the noise are satisfied.…

Numerical Analysis · Mathematics 2021-04-14 Stefan Kindermann , Kemal Raik

The solution of inverse problems is crucial in various fields such as medicine, biology, and engineering, where one seeks to find a solution from noisy observations. These problems often exhibit non-uniqueness and ill-posedness, resulting…

Numerical Analysis · Mathematics 2024-10-21 Markus Haltmeier , Richard Kowar , Markus Tiefenthaler

Tikhonov regularization is a common technique used when solving poorly behaved optimization problems. Often, and with good reason, this technique is applied by practitioners in an ad hoc fashion. In this note, we systematically illustrate…

Optimization and Control · Mathematics 2022-12-16 J. Adriazola

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

Solving ill-posed inverse problems necessitates effective regularization strategies to stabilize the inversion process against measurement noise. While classical methods like Tikhonov regularization require heuristic parameter tuning, and…

Machine Learning · Statistics 2026-03-24 Hang-Cheng Dong , Pengcheng Cheng , Shuhuan Li

We investigate a level-set type method for solving ill-posed problems, with the assumption that the solutions are piecewise, but not necessarily constant functions with unknown level sets and unknown level values. In order to get stable…

Numerical Analysis · Mathematics 2012-10-30 Adriano De Cezaro

We present a new inner-outer iterative algorithm for edge enhancement in imaging problems. At each outer iteration, we formulate a Tikhonov-regularized problem where the penalization is expressed in the 2-norm and involves a regularization…

Numerical Analysis · Mathematics 2020-12-30 Silvia Gazzola , Misha E. Kilmer , James G. Nagy , Oguz Semerici , Eric L. Miller

Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the…

Numerical Analysis · Mathematics 2022-04-13 Thomas Mach , Lothar Reichel , Marc Van Barel

To solve convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one…

Optimization and Control · Mathematics 2025-06-05 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch

It is well known that Tikhonov regularization is one of the most commonly used methods for solving ill-posed problems. One of the most widely applied approaches is based on constructing a new dataset whose sample size is greater than the…

Optimization and Control · Mathematics 2020-12-11 Ning Zhang

Computing the regularized solution of Bayesian linear inverse problems as well as the corresponding regularization parameter is highly desirable in many applications. This paper proposes a novel iterative method, termed the Projected Newton…

Numerical Analysis · Mathematics 2025-04-08 Haibo Li