English
Related papers

Related papers: Automatic balancing parameter selection for Tikhon…

200 papers

Despite recent advances in regularisation theory, the issue of parameter selection still remains a challenge for most applications. In a recent work the framework of statistical learning was used to approximate the optimal Tikhonov…

Machine Learning · Statistics 2019-05-30 Ernesto de Vito , Zeljko Kereta , Valeria Naumova

This paper introduces a novel variational Bayesian method that integrates Tucker decomposition for efficient high-dimensional inverse problem solving. The method reduces computational complexity by transforming variational inference from a…

Machine Learning · Computer Science 2026-03-18 Qing-Mei Yang , Da-Qing Zhang

Tikhonov regularization with square-norm penalty for linear forward operators has been studied extensively in the literature. However, the results on convergence theory are based on technical proofs and difficult to interpret. It is also…

Numerical Analysis · Mathematics 2021-07-07 Daniel Gerth

1D Total Variation (TV) denoising, considering the data fidelity and the Total Variation (TV) regularization, proposes a good restored signal preserving shape edges. The main issue is how to choose the weight $\lambda$ balancing those two…

Signal Processing · Electrical Eng. & Systems 2020-12-18 Zhanhao Liu , Marion Perrodin , Thomas Chambrion , Radu Stoica

We provide a modified augmented Lagrange method coupled with a Tikhonov regularization for solving ill-posed state-constrained elliptic optimal control problems with sparse controls. We consider a linear quadratic optimal control problem…

Optimization and Control · Mathematics 2017-08-14 Veronika Karl , Frank Pörner

Total Generalized Variation (TGV) has recently been introduced as penalty functional for modelling images with edges as well as smooth variations. It can be interpreted as a "sparse" penalization of optimal balancing from the first up to…

Numerical Analysis · Mathematics 2020-05-21 Kristian Bredies , Tuomo Valkonen

In this article, the problem of identifying the source term in transport processes given by a complete parabolic equation is studied mathematically from noisy measurements taken at an arbitrary fixed time. The problem is solved analytically…

Analysis of PDEs · Mathematics 2024-08-12 Guillermo Federico Umbricht , Diana Rubio

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

In the present paper we propose two new algorithms of tensor completion for three-order tensors. The proposed methods consist in minimizing the average rank of the underlying tensor using its approximate function namely the tensor nuclear…

Numerical Analysis · Mathematics 2021-02-23 A. H. Bentbib , A. El Hachimi , K. Jbilou , A. Ratnani

Regularization plays a pivotal role in ill-posed machine learning and inverse problems. However, the fundamental comparative analysis of various regularization norms remains open. We establish a small noise analysis framework to assess the…

Machine Learning · Statistics 2024-09-05 Quanjun Lang , Fei Lu

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We study filter based regularization methods for linear ill-posed problems between Hilbert spaces. We derive optimal order conditions under a-priori choice rules for the regularization parameter. Such analysis is applied to the fractional…

Numerical Analysis · Mathematics 2014-05-09 Davide Bianchi , Marco Donatelli , Stefano Serra-Capizzano

We investigate iterated Tikhonov methods coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization method. In the…

Numerical Analysis · Mathematics 2020-12-23 J. Baumeister , A. De Cezaro , A. Leitao

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

Finding a good regularization parameter for Tikhonov regularization problems is a though yet often asked question. One approach is to use leave-one-out cross-validation scores to indicate the goodness of fit. This utilizes only the noisy…

Numerical Analysis · Mathematics 2021-05-31 Felix Bartel , Ralf Hielscher , Daniel Potts

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

This paper presents an error analysis of classical and learned Tikhonov regularization schemes for inverse problems. We first demonstrate, both theoretically and numerically, that using a fixed regularization parameter across varying noise…

Numerical Analysis · Mathematics 2026-04-02 Arne Behrens , Meira Iske , Ming Jiang , Peter Maass , Sebastian Neumayer

The alternating direction method of multipliers (ADMM) is widely used to solve large-scale linearly constrained optimization problems, convex or nonconvex, in many engineering fields. However there is a general lack of theoretical…

Optimization and Control · Mathematics 2015-12-01 Mingyi Hong , Zhi-Quan Luo , Meisam Razaviyayn

We describe a method to discretize optimization problems arising in the regularization of linear inverse problem having compact forward operator defined on 3-D valed measures, compactly supported on a fixed set. The criterion is a quadratic…

Optimization and Control · Mathematics 2025-05-05 L Baratchart , D P Hardin , C Villalobos-Guillén

This paper introduces a novel approach to learning sparsity-promoting regularizers for solving linear inverse problems. We develop a bilevel optimization framework to select an optimal synthesis operator, denoted as $B$, which regularizes…

Machine Learning · Statistics 2026-03-03 Giovanni S. Alberti , Ernesto De Vito , Tapio Helin , Matti Lassas , Luca Ratti , Matteo Santacesaria