English
Related papers

Related papers: Stochastic asymptotical regularization for nonline…

200 papers

This paper discusses the properties of certain risk estimators recently proposed to choose regularization parameters in ill-posed problems. A simple approach is Stein's unbiased risk estimator (SURE), which estimates the risk in the data…

Many physical problems can be formulated as operator equations of the form Au = f. If these operator equations are ill-posed, we then resort to finding the approximate solutions numerically. Ill-posed problems can be found in the fields of…

Numerical Analysis · Mathematics 2016-11-11 Suresh B. Srinivasamurthy

Stochastic approximation (SA) is a powerful class of iterative algorithms for nonlinear root-finding that can be used for minimizing a loss function, $L(\boldsymbol{\theta})$, with respect to a parameter vector $\boldsymbol{\theta}$, when…

Optimization and Control · Mathematics 2017-07-24 Karla Hernández Cuevas

Alternative iterative methods for a nonexpansive mapping in a Banach space are proposed and proved to be convergent to a common solution to a fixed point problem and a variational inequality. We give rates of asymptotic regularity for such…

Functional Analysis · Mathematics 2009-06-01 Vittorio Colao , Laurentiu Leustean , Genaro Lopez , Victoria Martin-Marquez

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

Ill-posed inverse problems are common in astronomy, and their solutions are unstable with respect to noise in the data. Solutions of such problems are typically found using two classes of methods: parametrization and fitting the data…

Instrumentation and Methods for Astrophysics · Physics 2021-12-17 Damir Gasymov , Ivan Katkov

We study regularization of ill-posed equations involving multiplication operators when the multiplier function is positive almost everywhere and zero is an accumulation point of the range of this function. Such equations naturally arise…

Statistics Theory · Mathematics 2019-08-19 Peter Mathé , M. Thamban Nair , Bernd Hofmann

Building on the well-known total-variation (TV), this paper develops a general regularization technique based on nonlinear isotropic diffusion (NID) for inverse problems with piecewise smooth solutions. The novelty of our approach is to be…

Numerical Analysis · Mathematics 2021-08-25 Bernadette N. Hahn , Gael Rigaud , Richard Schmähl

A comprehensive convergence and stability analysis of some probabilistic numerical methods designed to solve Cauchy-type inverse problems is performed in this study. Such inverse problems aim at solving an elliptic partial differential…

Numerical Analysis · Mathematics 2025-08-12 Iulian Cîmpean , Andreea Grecu , Liviu Marin

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung

Stochastic composition optimization draws much attention recently and has been successful in many emerging applications of machine learning, statistical analysis, and reinforcement learning. In this paper, we focus on the composition…

Machine Learning · Computer Science 2018-01-01 Zhouyuan Huo , Bin Gu , Ji Liu , Heng Huang

This paper aims to develop and analyze a numerical scheme for solving the backward problem of semilinear subdiffusion equations. We establish the existence, uniqueness, and conditional stability of the solution to the inverse problem by…

Numerical Analysis · Mathematics 2025-05-07 Xu Wu , Jiang Yang , Zhi Zhou

To address the challenges of reliable statistical inference in high-dimensional models, we introduce the Synthetic-data Regularized Estimator (SRE). Unlike traditional regularization methods, the SRE regularizes the complex target model via…

Statistics Theory · Mathematics 2025-03-18 Weihao Li , Dongming Huang

In this work, we are devoted to the reconstruction of an unknown initial value from the terminal data. The asymptotic and root-distribution properties of Mittag-Leffler functions are used to establish stability of the backward problem.…

Numerical Analysis · Mathematics 2025-06-24 Dakang Cen , Zhiyuan Li , Wenlong Zhang

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

Regularized regression problems are ubiquitous in statistical modeling, signal processing, and machine learning. Sparse regression in particular has been instrumental in scientific model discovery, including compressed sensing applications,…

Machine Learning · Statistics 2018-11-09 Peng Zheng , Travis Askham , Steven L. Brunton , J. Nathan Kutz , Aleksandr Y. Aravkin

Sharpness-Aware Minimization (SAM) has emerged as a powerful method for improving generalization in machine learning models by minimizing the sharpness of the loss landscape. However, despite its success, several important questions…

Optimization and Control · Mathematics 2025-03-05 Dimitris Oikonomou , Nicolas Loizou

Ill-posed linear inverse problems appear frequently in various signal processing applications. It can be very useful to have theoretical characterizations that quantify the level of ill-posedness for a given inverse problem and the degree…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Justin P. Haldar

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

In this paper, we consider linear ill-posed problems in Hilbert spaces and their regularization via frame decompositions, which are generalizations of the singular-value decomposition. In particular, we prove convergence for a general class…

Numerical Analysis · Mathematics 2022-11-04 Simon Hubmer , Ronny Ramlau , Lukas Weissinger