English
Related papers

Related papers: Convex regularization in statistical inverse learn…

200 papers

Regularisation allows one to handle ill-posed inverse problems. Here we focus on discrete unfolding problems. The properties of the results are characterised by the consistency between measurements and unfolding result and by the posterior…

Data Analysis, Statistics and Probability · Physics 2023-09-07 Michael Schmelling

We investigate the strong convergence properties of a Nesterov type algorithm with two Tikhonov regularization terms in connection to the minimization problem of a smooth convex function $f.$ We show that the generated sequences converge…

Optimization and Control · Mathematics 2023-08-10 Mikhail Karapetyants , Szilárd Csaba László

In this work we establish the equivalence of algorithmic regularization and explicit convex penalization for generic convex losses. We introduce a geometric condition for the optimization path of a convex function, and show that if such a…

Optimization and Control · Mathematics 2019-09-10 Qian Qian , Xiaoyuan Qian

The Inverse Problem for the estimation of a point-wise approximation error occurring at the discretization and solving of the system of partial differential equations is addressed. The set of the differences between the numerical solutions…

Numerical Analysis · Mathematics 2021-01-05 Aleksey Alekseev , Alexander Bondarev

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

Machine Learning · Computer Science 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

This paper deals with feature selection procedures for spatial point processes intensity estimation. We consider regularized versions of estimating equations based on Campbell theorem derived from two classical functions: Poisson likelihood…

Methodology · Statistics 2018-07-12 Achmad Choiruddin , Jean-François Coeurjolly , Frédérique Letué

Tikhonov regularization is one of the most commonly used methods of regularization of ill-posed problems. In the setting of finite element solutions of elliptic partial differential control problems, Tikhonov regularization amounts to…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Peter Hansbo , Mats Larson

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

In this paper we consider a stochastic heavy-ball method for solving linear ill-posed inverse problems. With suitable choices of the step-sizes and the momentum coefficients, we establish the regularization property of the method under {\it…

Numerical Analysis · Mathematics 2024-06-25 Qinian Jin , Yanjun Liu

We consider a class of nonconvex nonsmooth multicomposite optimization problems where the objective function consists of a Tikhonov regularizer and a composition of multiple nonconvex nonsmooth component functions. Such optimization…

Optimization and Control · Mathematics 2026-03-13 Lingzi Jin , Xiao Wang , Xiaojun Chen

We adopt Bayesian approach to consider the inverse problem of estimate a function from noisy observations. One important component of this approach is the prior measure. Total variation prior has been proved with no discretization invariant…

Statistics Theory · Mathematics 2026-02-09 Junxiong Jia , Jigen Peng , Jinghuai Gao

For a convex class of functions $F$, a regularization functions $\Psi(\cdot)$ and given the random data $(X_i, Y_i)_{i=1}^N$, we study estimation properties of regularization procedures of the form \begin{equation*} \hat f \in {\rm…

Statistics Theory · Mathematics 2016-08-30 Guillaume Lecué , Shahar Mendelson

This paper studies a machine learning regression problem as a multivariate approximation problem using the framework of the theory of random functions. An ab initio derivation of a regression method is proposed, starting from postulates of…

Machine Learning · Computer Science 2025-12-16 Yuriy N. Bakhvalov

Poisson distributed measurements in inverse problems often stem from Poisson point processes that are observed through discretized or finite-resolution detectors, one of the most prominent examples being positron emission tomography (PET).…

Statistics Theory · Mathematics 2024-07-25 Marco Mauritz , Benedikt Wirth

In this paper we deal with linear inverse problems and convergence rates for Tikhonov regularization. We consider regularization in a scale of Banach spaces, namely the scale of Besov spaces. We show that regularization in Banach scales…

Functional Analysis · Mathematics 2009-11-13 Dirk Lorenz , Dennis Trede

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

Inverse problems consist of recovering a signal from a collection of noisy measurements. These problems can often be cast as feasibility problems; however, additional regularization is typically necessary to ensure accurate and stable…

Machine Learning · Computer Science 2021-04-30 Howard Heaton , Samy Wu Fung , Aviv Gibali , Wotao Yin

Neural networks have emerged as effective tools for solving ill-posed inverse problems. In many scientific applications, however, observational training data are insufficient, and learned inverse operators must instead be trained on…

Numerical Analysis · Mathematics 2026-05-26 Sandra R. Babyale , Jodi Mead

In this paper, we discuss the construction, analysis and implementation of a novel iterative regularization scheme with general convex penalty term for nonlinear inverse problems in Banach spaces based on the homotopy perturbation…

Numerical Analysis · Mathematics 2018-01-10 Jing Wang , Wei Wang , Bo Han

In a separable Hilbert space, we study the minimization problem of a convex smooth function with Lipschitz continuous gradient whose evaluations are corrupted by random noise. To this end, we associate a stochastic inertial system that…

Optimization and Control · Mathematics 2025-12-18 Chiara Schindler