English
Related papers

Related papers: Regularization of linear and nonlinear ill-posed p…

200 papers

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral…

Functional Analysis · Mathematics 2021-02-09 Christian Clason

Regularization-based approaches for injecting constraints in Machine Learning (ML) were introduced to improve a predictive model via expert knowledge. We tackle the issue of finding the right balance between the loss (the accuracy of the…

Machine Learning · Computer Science 2020-05-22 Michele Lombardi , Federico Baldo , Andrea Borghesi , Michela Milano

We adapt the alternating linearization method for proximal decomposition to structured regularization problems, in particular, to the generalized lasso problems. The method is related to two well-known operator splitting methods, the…

Computation · Statistics 2014-03-25 Xiaodong Lin , Minh Pham , Andrzej Ruszczynski

In this paper, we find a regularized approximate solution for an inverse problem for the Burgers' equation. The solution of the inverse problem for the Burgers' equation is ill-posed, i.e., the solution does not depend continuously on the…

Analysis of PDEs · Mathematics 2017-02-28 Erkan Nane , Nguyen Hoang Tuan , Nguyen Huy Tuan

Machine learning models suffer from overfitting, which is caused by a lack of labeled data. To tackle this problem, we proposed a framework of regularization methods, called density-fixing, that can be used commonly for supervised and…

Machine Learning · Computer Science 2020-09-08 Masanari Kimura , Ryohei Izawa

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

Solving inverse problems \(Ax = y\) is central to a variety of practically important fields such as medical imaging, remote sensing, and non-destructive testing. The most successful and theoretically best-understood method is convex…

Numerical Analysis · Mathematics 2025-09-23 Daniel Obmann , Gyeongha Hwang , Markus Haltmeier

We consider the monotone inclusion problems in real Hilbert spaces. Proximal splitting algorithms are very popular technique to solve it and generally achieve weak convergence under mild assumptions. Researchers assume the strong conditions…

Optimization and Control · Mathematics 2022-05-05 Avinash Dixit , D. R. Sahu , Pankaj Gautam , T. Som

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

In this work we consider, in a Banach space framework, the regularization of linear ill-posed problems. Our focus is on the recovery of solutions that have a logarithmic source representation. Such cases typically occur in exponentially…

Numerical Analysis · Mathematics 2025-09-09 Robert Plato

Estimating equations arise in a wide range of statistical applications, including longitudinal and clustered data analysis, survival analysis, econometrics, and semiparametric inference. In high-dimensional settings, adding…

Computation · Statistics 2026-05-27 Weihua Shi , Yixuan Li , Yi Lian , Archer Y. Yang , Yue Zhao

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

This paper is concerned with the solution of large-scale linear discrete ill-posed problems with error-contaminated data. Tikhonov regularization is a popular approach to determine meaningful approximate solutions of such problems. The…

Numerical Analysis · Mathematics 2016-02-11 Guangxin Huang , Silvia Noschese , Lothar Reichel

In this paper, we apply randomized algorithms to approximate the total least squares (TLS) solution of the problem $Ax\approx b$ in the large-scale discrete ill-posed problems. A regularization technique, based on the multiplicative…

Numerical Analysis · Mathematics 2018-08-09 Liping Zhang , Yimin Wei

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

Machine Learning · Computer Science 2022-02-17 Abinash Nayak

In this paper, we investigate regularization of linear inverse problems with irregular noise. In particular, we consider the case that the noise can be preprocessed by certain adjoint embedding operators. By introducing the consequent…

Numerical Analysis · Mathematics 2024-01-30 Xinyan Li , Simon Hubmer , Shuai Lu , Ronny Ramlau

We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no…

Numerical Analysis · Mathematics 2022-12-13 Sarah Eberle , Bastian Harrach

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh