English
Related papers

Related papers: Regularization of statistical inverse problems and…

200 papers

We consider a statistical inverse learning problem, where we observe the image of a function $f$ through a linear operator $A$ at i.i.d. random design points $X_i$, superposed with an additive noise. The distribution of the design points is…

Machine Learning · Statistics 2016-04-15 Gilles Blanchard , Nicole Mücke

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

In this paper, we consider a class of matrix functions, which contains regularization matrices of Mirzoev and Shkalikov for differential operators with distribution coefficients of order $n \ge 2$. We show that every matrix function of this…

Spectral Theory · Mathematics 2023-08-10 Natalia P. Bondarenko

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Margaret Duff , Neill D. F. Campbell , Matthias J. Ehrhardt

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

We obtain regularity conditions of a new type of problems of the calculus of variations with second-order derivatives. As a corollary, we get non-occurrence of the Lavrentiev phenomenon. Our main result asserts that autonomous integral…

Optimization and Control · Mathematics 2008-02-23 Moulay Rchid Sidi Ammi , Delfim F. M. Torres

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

A way of constructing a nonlinear filter close to the optimal Kolmogorov - Wiener filter is proposed within the framework of the statistical approach to inverse problems. Quasi-optimal filtering, which has no Bayesian assumptions, produces…

Mathematical Physics · Physics 2009-11-10 V. Yu. Terebizh

I argue that regularizing terms in standard regression methods not only help against overfitting finite data, but sometimes also yield better causal models in the infinite sample regime. I first consider a multi-dimensional variable…

Machine Learning · Statistics 2019-07-01 Dominik Janzing

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

The Tikhonov regularization of linear ill-posed problems with an $\ell^1$ penalty is considered. We recall results for linear convergence rates and results on exact recovery of the support. Moreover, we derive conditions for exact support…

Functional Analysis · Mathematics 2015-05-18 Dirk A. Lorenz , Stefan Schiffler , Dennis Trede

In applied probability, the normal approximation is often used for the distribution of data with assumed additive structure. This tradition is based on the central limit theorem for sums of (independent) random variables. However, it is…

Probability · Mathematics 2020-10-27 Alexandra Dorofeeva , Victor Korolev , Alexander Zeifman

We obtain new regularity conditions for problems of calculus of variations with higher-order derivatives. As a corollary, we get non-occurrence of the Lavrentiev phenomenon. Our main regularity result asserts that autonomous integral…

Optimization and Control · Mathematics 2008-07-19 Moulay Rchid Sidi Ammi , Delfim F. M. Torres

A fundamental problem of statistical data analysis, distribution density estimation by experimental data, is considered. A new method with optimal asymptotic behavior, the root density estimator, is developed. The method proposed may be…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Yu. I. Bogdanov

In the consistent histories formulation of quantum theory, the probabilistic predictions and retrodictions made from observed data depend on the choice of a consistent set. We show that this freedom allows the formalism to retrodict…

General Relativity and Quantum Cosmology · Physics 2010-11-19 Adrian Kent

Many recent successful (deep) reinforcement learning algorithms make use of regularization, generally based on entropy or Kullback-Leibler divergence. We propose a general theory of regularized Markov Decision Processes that generalizes…

Machine Learning · Computer Science 2019-06-05 Matthieu Geist , Bruno Scherrer , Olivier Pietquin

We consider a modified Tikhonov-type functional for the solution of ill-posed nonlinear inverse problems. Motivated by applications in the field of production engineering, we allow small deviations in the solution, which are modeled through…

Numerical Analysis · Mathematics 2020-07-14 Iwona Piotrowska-Kurczewski , Georgia Sfakianaki

We study linear inverse problems under the premise that the forward operator is not at hand but given indirectly through some input-output training pairs. We demonstrate that regularization by projection and variational regularization can…

Numerical Analysis · Mathematics 2020-12-30 Andrea Aspri , Yury Korolev , Otmar Scherzer

We formulate, and present a numerical method for solving, an inverse problem for inferring parameters of a deterministic model from stochastic observational data (quantities of interest). The solution, given as a probability measure, is…

Numerical Analysis · Mathematics 2021-05-04 T. Butler , J. D. Jakeman , T. Wildey