English
Related papers

Related papers: Lagrange duality for the Morozov principle

200 papers

We study filter based regularization methods for linear ill-posed problems between Hilbert spaces. We derive optimal order conditions under a-priori choice rules for the regularization parameter. Such analysis is applied to the fractional…

Numerical Analysis · Mathematics 2014-05-09 Davide Bianchi , Marco Donatelli , Stefano Serra-Capizzano

This paper studies a machine learning regression problem as a multivariate approximation problem using the framework of the theory of random functions. An ab initio derivation of a regression method is proposed, starting from postulates of…

Machine Learning · Computer Science 2025-12-16 Yuriy N. Bakhvalov

Additive or multiplicative stationary noise recently became an important issue in applied fields such as microscopy or satellite imaging. Relatively few works address the design of dedicated denoising methods compared to the usual white…

Computer Vision and Pattern Recognition · Computer Science 2013-07-18 Jérôme Fehrenbach , Pierre Weiss

In this paper, we study the Fenchel-Rockafellar duality and the Lagrange duality in the general frame work of vector spaces without topological structures. We utilize the geometric approach, inspired from its successful application by B. S.…

Optimization and Control · Mathematics 2025-10-07 Dang Van Cuong , Tuyen Tran

The joint bidiagonalization process of a matrix pair $\{A,L\}$ can be used to develop iterative regularization algorithms for large scale ill-posed problems in general-form Tikhonov regularization…

Numerical Analysis · Mathematics 2020-12-29 Haibo Li

The paper is dedicated to the study of strong duality for a problem of linear copositive programming. Based on the recently introduced concept of the set of normalized immobile indices, an extended dual problem is deduced. The dual problem…

Optimization and Control · Mathematics 2020-04-24 Olga Kostyukova , Tatiana Tchemisova

Classically, data interpolation with a parametrized model class is possible as long as the number of parameters is larger than the number of equations to be satisfied. A puzzling phenomenon in deep learning is that models are trained with…

Machine Learning · Computer Science 2022-12-27 Sébastien Bubeck , Mark Sellke

In a stochastic noise setting the Lepskij balancing principle for choosing the regularization parameter in the regularization of inverse problems is depending on a parameter $\tau$ which in the currently known proofs is depending on the…

Numerical Analysis · Mathematics 2010-08-05 Frank Bauer

A stabilized Lagrange multiplier method for second order elliptic interface problems is presented in the framework of mortar method. The requirement of LBB (Ladyzhenskaya-Babu\v{s}ka-Brezzi) condition for mortar method is alleviated by…

Numerical Analysis · Mathematics 2017-05-31 Sanjib Kumar Acharya , Ajit Patel

This paper introduces a new strategy for setting the regularization parameter when solving large-scale discrete ill-posed linear problems by means of the Arnoldi-Tikhonov method. This new rule is essentially based on the discrepancy…

Numerical Analysis · Mathematics 2013-07-02 Silvia Gazzola , Paolo Novati , Maria Rosaria Russo

We examine two central regularization strategies for monotone variational inequalities, the first a direct regularization of the operative monotone mapping, and the second via regularization of the associated dual gap function. A key link…

Optimization and Control · Mathematics 2018-01-24 C. Charitha , Joydeep Dutta , D. Russell Luke

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise…

Numerical Analysis · Mathematics 2020-06-24 Federico Benvenuto , Bangti Jin

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

In this paper, the concept of matrix splitting is introduced to solve a large sparse ill-posed linear system via Tikhonov's regularization. In the regularization process, we convert the ill-posed system to a well-posed system. The…

Numerical Analysis · Mathematics 2020-04-15 Ashish Kumar Nandi , Jajati Keshari Sahoo

Various approaches to stochastic processes exist, noting that key properties such as measurability and continuity are not trivially satisfied. We introduce a new theory for Gaussian processes using improper linear functionals. Using a…

Statistics Theory · Mathematics 2020-10-15 Niels Lundtorp Olsen

Interpolation techniques play a central role in Astronomy, where one often needs to smooth irregularly sampled data into a smooth map. In a previous article (Lombardi & Schneider 2001), we have considered a widely used smoothing technique…

Astrophysics · Physics 2009-11-07 Marco Lombardi , Peter Schneider

In this article, we study the well-posedness theory for solutions of the stochastic heat equations with logarithmic nonlinearity perturbed by multiplicative Levy noise. By using Aldous tightness criteria and Jakubowski version of the…

Analysis of PDEs · Mathematics 2024-09-09 Kavin R , Ananta K Majee

Distributionally robust optimization has been shown to offer a principled way to regularize learning models. In this paper, we find that Tikhonov regularization is distributionally robust in an optimal transport sense (i.e., if an adversary…

Optimization and Control · Mathematics 2022-10-05 Jiajin Li , Sirui Lin , Jose Blanchet , Viet Anh Nguyen

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell

We build a solvability theory of elliptic boundary-value problems in normed Sobolev spaces of generalized smoothness for any integrability exponent $p>1$. The smoothness is given by a number parameter and a supplementary function parameter…

Analysis of PDEs · Mathematics 2025-10-01 Anna Anop , Aleksandr Murach