English
Related papers

Related papers: Convergence rates for Tikhonov regularization on c…

200 papers

In this paper we study a Tikhonov-type method for ill-posed nonlinear operator equations $\gdag = F(\udag)$ where $\gdag$ is an integrable, non-negative function. We assume that data are drawn from a Poisson process with density $t\gdag$…

Numerical Analysis · Mathematics 2015-04-01 Frank Werner , Thorsten Hohage

Machine learning models suffer from overfitting, which is caused by a lack of labeled data. To tackle this problem, we proposed a framework of regularization methods, called density-fixing, that can be used commonly for supervised and…

Machine Learning · Computer Science 2020-09-08 Masanari Kimura , Ryohei Izawa

This paper deals with a second order dynamical system with a Tikhonov regularization term in connection to the minimization problem of a convex Fr\'echet differentiable function. The fact that beside the asymptotically vanishing damping we…

Optimization and Control · Mathematics 2024-01-08 Szilárd Csaba László

We study the behaviour of Tikhonov regularisation on topological spaces with multiple regularisation terms. The main result of the paper shows that multi-parameter regularisation is well-posed in the sense that the results depend…

Numerical Analysis · Mathematics 2011-09-05 Markus Grasmair

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

Regularizing Deep Neural Networks (DNNs) is essential for improving generalizability and preventing overfitting. Fixed penalty methods, though common, lack adaptability and suffer from hyperparameter sensitivity. In this paper, we propose a…

Machine Learning · Computer Science 2023-10-26 Diogo Lavado , Cláudia Soares , Alessandra Micheletti

We consider regularization methods based on the coupling of Tikhonov regularization and projection strategies. From the resulting constraint regularization method we obtain level set methods in a straight forward way. Moreover, we show that…

Optimization and Control · Mathematics 2020-11-17 A. Leitao , O. Scherzer

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

In a Hilbertian framework, for the minimization of a general convex differentiable function $f$, we introduce new inertial dynamics and algorithms that generate trajectories and iterates that converge fastly towards the minimizer of $f$…

Optimization and Control · Mathematics 2021-04-27 Hedy Attouch , Szilard Laszlo

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

Conditional stability estimates are a popular tool for the regularization of ill-posed problems. A drawback in particular under nonlinear operators is that additional regularization is needed for obtaining stable approximate solutions if…

Numerical Analysis · Mathematics 2019-05-29 Daniel Gerth , Bernd Hofmann , Christopher Hofmann

Plug-and-play (PnP) denoising is a popular iterative framework for solving imaging inverse problems using off-the-shelf image denoisers. Their empirical success has motivated a line of research that seeks to understand the convergence of…

Numerical Analysis · Mathematics 2023-07-19 Andreas Hauptmann , Subhadip Mukherjee , Carola-Bibiane Schönlieb , Ferdia Sherry

Iterative regularization is a classic idea in regularization theory, that has recently become popular in machine learning. On the one hand, it allows to design efficient algorithms controlling at the same time numerical and statistical…

Machine Learning · Statistics 2024-10-10 Vassilis Apidopoulos , Tomaso Poggio , Lorenzo Rosasco , Silvia Villa

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

We consider joint Tikhonov- and Lavrentiev-regularization of control problems with pointwise control- and state-constraints. We derive error estimates for the error which is introduced by the Tikhonov regularization. With the help of this…

Optimization and Control · Mathematics 2010-10-26 Dirk A. Lorenz , Arnd Rösch

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

We investigate the modeling and the numerical solution of machine learning problems with prediction functions which are linear combinations of elements of a possibly infinite-dimensional dictionary. We propose a novel flexible composite…

Statistics Theory · Mathematics 2015-12-03 Patrick L. Combettes , Saverio Salzo , Silvia Villa

Inverse problems are fundamental in fields like medical imaging, geophysics, and computerized tomography, aiming to recover unknown quantities from observed data. However, these problems often lack stability due to noise and…

Numerical Analysis · Mathematics 2024-06-26 Andrea Ebner , Matthias Schwab , Markus Haltmeier