English
Related papers

Related papers: Regularization of statistical inverse problems and…

200 papers

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

These lecture notes for a graduate class present the regularization theory for linear and nonlinear ill-posed operator equations in Hilbert spaces. Covered are the general framework of regularization methods and their analysis via spectral…

Functional Analysis · Mathematics 2021-02-09 Christian Clason

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

In this paper we propose a new statistical stopping rule for constrained maximum likelihood iterative algorithms applied to ill-posed inverse problems. To this aim we extend the definition of Tikhonov regularization in a statistical…

Numerical Analysis · Mathematics 2012-12-14 Federico Benvenuto , Michele Piana

Tikhonov regularization involves minimizing the combination of a data discrepancy term and a regularizing term, and is the standard approach for solving inverse problems. The use of non-convex regularizers, such as those defined by trained…

Optimization and Control · Mathematics 2023-02-20 Daniel Obmann , Markus Haltmeier

The classical approach to inverse problems is based on the optimization of a misfit function. Despite its computational appeal, such an approach suffers from many shortcomings, e.g., non-uniqueness of solutions, modeling prior knowledge,…

Machine Learning · Statistics 2014-10-22 Panagiotis Tsilifis , Ilias Bilionis , Ioannis Katsounaros , Nicholas Zabaras

We study a class of ordinary differential equations with a non-Lipschitz point singularity, which admit non-unique solutions through this point. As a selection criterion, we introduce stochastic regularizations depending on the parameter…

Dynamical Systems · Mathematics 2024-11-20 Theodore D. Drivas , Alexei A. Mailybaev , Artem Raibekas

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

Inverse problems in statistical physics are motivated by the challenges of `big data' in different fields, in particular high-throughput experiments in biology. In inverse problems, the usual procedure of statistical physics needs to be…

Disordered Systems and Neural Networks · Physics 2017-11-07 H. Chau Nguyen , Riccardo Zecchina , Johannes Berg

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

In this paper we deal with linear inverse problems and convergence rates for Tikhonov regularization. We consider regularization in a scale of Banach spaces, namely the scale of Besov spaces. We show that regularization in Banach scales…

Functional Analysis · Mathematics 2009-11-13 Dirk Lorenz , Dennis Trede

The main features of the statistical approach to inverse problems are described on the example of a linear model with additive noise. The approach does not use any Bayesian hypothesis regarding an unknown object; instead, the standard…

Methodology · Statistics 2017-05-05 V. Yu. Terebizh

Bayesian inference paradigms are regarded as powerful tools for solution of inverse problems. However, when applied to inverse problems in physical sciences, Bayesian formulations suffer from a number of inconsistencies that are often…

Methodology · Statistics 2024-11-21 Klaus Mosegaard

The statistical inverse problem of estimating the probability distribution of an infinite-dimensional unknown given its noisy indirect observation is studied in the Bayesian framework. In practice, one often considers only…

Statistics Theory · Mathematics 2017-11-21 Sari Lasanen

Over the last decade, a series of applied mathematics papers have explored a type of inverse problem--called by a variety of names including "inverse sensitivity", "pushforward based inference", "consistent Bayesian inference", or…

Methodology · Statistics 2022-11-30 Peter W. Marcy , Rebecca E. Morrison

The need to blend observational data and mathematical models arises in many applications and leads naturally to inverse problems. Parameters appearing in the model, such as constitutive tensors, initial conditions, boundary conditions, and…

Statistics Theory · Mathematics 2010-09-16 J. Nolen , G. A. Pavliotis , A. M. Stuart

Many researchers have applied classical statistical decision theory to evaluate treatment choices and learn optimal policies. However, because this framework is based solely on realized outcomes under chosen decisions and ignores…

Statistics Theory · Mathematics 2025-10-21 Benedikt Koch , Kosuke Imai

We prove a general theorem on the stochastic convergence of appropriately renormalized models arising from nonlinear stochastic PDEs. The theory of regularity structures gives a fairly automated framework for studying these problems but…

Probability · Mathematics 2018-01-23 Ajay Chandra , Martin Hairer

We exploit the similarities between Tikhonov regularization and Bayesian hierarchical models to propose a regularization scheme that acts like a distributed Tikhonov regularization where the amount of regularization varies from component to…

Numerical Analysis · Mathematics 2024-04-10 Daniela Calvetti , Erkki Somersalo