English
Related papers

Related papers: Stochastic asymptotical regularization for nonline…

200 papers

The new version of a posteriori choice (NVAC) of the regularization parameter in the classical Tikhonov regularization method is considered. Lemmas and theorems on the error and the asymptotic convergence rate of the regularized solution…

Functional Analysis · Mathematics 2015-09-28 V. S. Sizikov

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We consider the method of quasi-solutions (also referred to as Ivanov regularization) for the regularization of linear ill-posed problems in non-reflexive Banach spaces. Using the equivalence to a metric projection onto the image of the…

Optimization and Control · Mathematics 2018-10-09 Christian Clason , Andrej Klassen

Stochastic variance reduced gradient (SVRG) is a popular variance reduction technique for accelerating stochastic gradient descent (SGD). We provide a first analysis of the method for solving a class of linear inverse problems in the lens…

Numerical Analysis · Mathematics 2022-01-19 Bangti Jin , Zehui Zhou , Jun Zou

Recently, inverse problems have attracted more and more attention in computational mathematics and become increasingly important in engineering applications. After the discretization, many of inverse problems are reduced to linear systems.…

Numerical Analysis · Mathematics 2022-04-07 Gong Rongfang , Huang Qin

The problem of object restoration in the case of spatially incoherent illumination is considered. A regularized solution to the inverse problem is obtained through a probabilistic approach, and a numerical algorithm based on the statistical…

Optics · Physics 2009-11-13 Enrico De Micheli , Giovanni Alberto Viano

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

Numerous interesting properties in nonlinear systems analysis can be written as polynomial optimization problems with nonconvex sum-of-squares problems. To solve those problems efficiently, we propose a sequential approach of local…

Optimization and Control · Mathematics 2023-10-03 Torbjørn Cunis , Benoît Legat

In this paper, we present the asymptotic distribution of M-estimators for parameters in non-stationary AR(p) processes. The innovations are assumed to be in the domain of attraction of a stable law with index $0<\alpha\le2$. In particular,…

Applications · Statistics 2016-12-13 Maryam Sohrabi , Mahmoud Zarepour

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

Inverse problems are characterized by their inherent non-uniqueness and sensitivity with respect to data perturbations. Their stable solution requires the application of regularization methods including variational and iterative…

Numerical Analysis · Mathematics 2023-10-17 Aviv Gibali , Markus Haltmeier

In this paper, we study the stochastic convergence of regularized solutions for backward heat conduction problems. These problems are recognized as ill-posed due to the exponential decay of eigenvalues associated with the forward problems.…

Numerical Analysis · Mathematics 2023-11-08 Zhongjian Wang , Wenlong Zhang , Zhiwen Zhang

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

Regularization techniques for the numerical solution of inverse scattering problems in two space dimensions are discussed. Assuming that the boundary of a scatterer is its most prominent feature, we exploit as model the class of…

Functional Analysis · Mathematics 2016-05-05 Gitta Kutyniok , Volker Mehrmann , Philipp Petersen

Sharpness-Aware Minimization (SAM) has proven highly effective in improving model generalization in machine learning tasks. However, SAM employs a fixed hyperparameter associated with the regularization to characterize the sharpness of the…

Machine Learning · Computer Science 2024-12-24 Jinping Zou , Xiaoge Deng , Tao Sun

Asymptotic stationarity and regularity conditions turned out to be quite useful to study the qualitative properties of numerical solution methods for standard nonlinear and complementarity-constrained programs. In this paper, we first…

Optimization and Control · Mathematics 2021-09-02 Patrick Mehlitz

This paper deals with Lavrentiev regularization for solving linear ill-posed problems, mostly with respect to accretive operators on Hilbert spaces. We present converse and saturation results which are an important part in regularization…

Numerical Analysis · Mathematics 2016-07-19 Robert Plato

In this work, we develop efficient solvers for linear inverse problems based on randomized singular value decomposition (RSVD). This is achieved by combining RSVD with classical regularization methods, e.g., truncated singular value…

Numerical Analysis · Mathematics 2019-09-05 Kazufumi Ito , Bangti Jin

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

In this paper we present a method for the regularized solution of nonlinear inverse problems, based on Ivanov regularization (also called method of quasi solutions or constrained least squares regularization). This leads to the minimization…

Numerical Analysis · Mathematics 2015-09-11 Barbara Kaltenbacher , Franz Rendl , Elena Resmerita