English
Related papers

Related papers: Optimal Regularization Parameters for General-Form…

200 papers

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

We make some remarks on a variant of the classical Tikhonov regularization in optimal control under PDEs which allows for a certain flexibility in dealing with non-linearities and state restrictions, in the sense that differential…

Optimization and Control · Mathematics 2019-04-02 Pablo Pedregal

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

In this paper we consider the training of single hidden layer neural networks by pseudoinversion, which, in spite of its popularity, is sometimes affected by numerical instability issues. Regularization is known to be effective in such…

Neural and Evolutionary Computing · Computer Science 2015-08-26 Rossella Cancelliere , Mario Gai , Patrick Gallinari , Luca Rubini

From the viewpoint of inverse problem, the optimization of drug release based on the multi-laminated drug controlled release devices has been regarded as the solution problem of the diffusion equation initial value inverse problem. In view…

Numerical Analysis · Mathematics 2019-04-15 Xinming Zhang , Ling Ma

We present a new inner-outer iterative algorithm for edge enhancement in imaging problems. At each outer iteration, we formulate a Tikhonov-regularized problem where the penalization is expressed in the 2-norm and involves a regularization…

Numerical Analysis · Mathematics 2020-12-30 Silvia Gazzola , Misha E. Kilmer , James G. Nagy , Oguz Semerici , Eric L. Miller

In this work, we consider ill-posed inverse problems in which the forward operator is continuous and weakly closed, and the sought solution belongs to a weakly closed constraint set. We propose a regularization method based on minimizing…

Numerical Analysis · Mathematics 2025-05-27 Barbara Palumbo , Paolo Massa , Federico Benvenuto

A main drawback of classical Tikhonov regularization is that often the parameters required to apply theoretical results, e.g., the smoothness of the sought-after solution and the noise level, are unknown in practice. In this paper we…

Numerical Analysis · Mathematics 2021-01-01 Daniel Gerth , Ronny Ramlau

In a Hilbert space, we propose a class of general mixed-order primal-dual dynamical systems with Tikhonov regularization for a convex optimization problem with linear equality constraints. The proposed dynamical system is characterized by…

Optimization and Control · Mathematics 2025-07-31 Honglu Li , Rong Hu , Xin He , Yibin Xiao

We consider joint Tikhonov- and Lavrentiev-regularization of control problems with pointwise control- and state-constraints. We derive error estimates for the error which is introduced by the Tikhonov regularization. With the help of this…

Optimization and Control · Mathematics 2010-10-26 Dirk A. Lorenz , Arnd Rösch

We study gradient-based regularization methods for neural networks. We mainly focus on two regularization methods: the total variation and the Tikhonov regularization. Applying these methods is equivalent to using neural networks to solve…

Machine Learning · Computer Science 2022-11-09 Lingfeng Li , Xue-Cheng Tai , Jiang Yang

$\ell_1$ regularization is used to preserve edges or enforce sparsity in a solution to an inverse problem. We investigate the Split Bregman and the Majorization-Minimization iterative methods that turn this non-smooth minimization problem…

Numerical Analysis · Mathematics 2024-12-16 Brian Sweeney , Rosemary Renaut , Malena Español

In this paper, we are concerned with efficiently solving the sequences of regularized linear least squares problems associated with employing Tikhonov-type regularization with regularization operators designed to enforce edge recovery. An…

Numerical Analysis · Mathematics 2023-06-29 Matthias Bolten , Scott P. MacLachlan , Misha E. Kilmer

This paper considers large-scale linear ill-posed inverse problems whose solutions can be represented as sums of smooth and piecewise constant components. To solve such problems we consider regularizers consisting of two terms that must be…

Numerical Analysis · Mathematics 2022-06-30 Ali Gholami , Silvia Gazzola

In this paper, we consider an inverse problem to determine a source term in a parabolic equation, where the data are obtained at a certain time. In general, this problem is ill-posed, therefore the Tikhonov regularization method is proposed…

Analysis of PDEs · Mathematics 2015-12-10 Nguyen Huy Tuan , Nguyen Van Thinh , Vo Anh Khoa , Tran Thanh Binh

Most of the literature on the solution of linear ill-posed operator equations, or their discretization, focuses only on the infinite-dimensional setting or only on the solution of the algebraic linear system of equations obtained by…

Numerical Analysis · Mathematics 2018-12-05 Ronny Ramlau , Lothar Reichel

The total least squares problem with the general Tikhonov regularization can be reformulated as a one-dimensional parametric minimization problem (PM), where each parameterized function evaluation corresponds to solving an n-dimensional…

Optimization and Control · Mathematics 2018-10-30 Yong Xia , Longfei Wang , Meijia Yang

It is common to have to process signals or images whose values are cyclic and can be represented as points on the complex circle, like wrapped phases, angles, orientations, or color hues. We consider a Tikhonov-type regularization model to…

Optimization and Control · Mathematics 2022-06-08 Laurent Condat

Many applications in science and engineering require the solution of large linear discrete ill-posed problems that are obtained by the discretization of a Fredholm integral equation of the first kind in several space-dimensions. The matrix…

Numerical Analysis · Mathematics 2017-05-19 Laura Dykes , Guangxin Huang , Silvia Noschese , Lothar Reichel

The theory of spectral filtering is a remarkable tool to understand the statistical properties of learning with kernels. For least squares, it allows to derive various regularization schemes that yield faster convergence rates of the excess…

Machine Learning · Computer Science 2021-11-11 Gaspard Beugnot , Julien Mairal , Alessandro Rudi