English
Related papers

Related papers: Stochastic convergence of regularized solutions fo…

200 papers

A major challenge in single particle reconstruction from cryo-electron microscopy is to establish a reliable ab-initio three-dimensional model using two-dimensional projection images with unknown orientations. Common-lines based methods…

Machine Learning · Computer Science 2013-04-11 Lanhui Wang , Amit Singer , Zaiwen Wen

Large dimensional least-squares and regularised least-squares problems are expensive to solve. There exist many approximate techniques, some deterministic (like conjugate gradient), some stochastic (like stochastic gradient descent). Among…

Signal Processing · Electrical Eng. & Systems 2021-10-18 Yusuf Pilavcı , Pierre-Olivier Amblard , Simon Barthelmé , Nicolas Tremblay

We adapt the quasi-monotone method from [2] for composite convex minimization in the stochastic setting. For the proposed numerical scheme we derive the optimal convergence rate in terms of the last iterate, rather than on average as it is…

Optimization and Control · Mathematics 2021-07-09 Vyacheslav Kungurtsev , Vladimir Shikhman

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

In this article, we consider the Tikhonov regularization of an optimal control problem of semilinear partial differential equations with box constraints on the control. We derive a-priori regularization error estimates for the control under…

Optimization and Control · Mathematics 2017-05-04 Frank Pörner , Daniel Wachsmuth

We propose a new randomized algorithm for solving L2-regularized least-squares problems based on sketching. We consider two of the most popular random embeddings, namely, Gaussian embeddings and the Subsampled Randomized Hadamard Transform…

Machine Learning · Computer Science 2020-10-26 Jonathan Lacotte , Mert Pilanci

We study inverse problems F(f) = g with perturbed right hand side g^{obs} corrupted by so-called impulsive noise, i.e. noise which is concentrated on a small subset of the domain of definition of g. It is well known that Tikhonov-type…

Numerical Analysis · Mathematics 2015-04-01 Thorsten Hohage , Frank Werner

We introduce Stochastic Asymptotical Regularization (SAR) methods for the uncertainty quantification of the stable approximate solution of ill-posed linear-operator equations, which are deterministic models for numerous inverse problems in…

Numerical Analysis · Mathematics 2022-12-21 Ye Zhang , Chuchu Chen

Regularization techniques for the numerical solution of inverse scattering problems in two space dimensions are discussed. Assuming that the boundary of a scatterer is its most prominent feature, we exploit as model the class of…

Functional Analysis · Mathematics 2016-05-05 Gitta Kutyniok , Volker Mehrmann , Philipp Petersen

In this paper, we develop a framework for the discretization of a mixed formulation of quasi-reversibility solutions to ill-posed problems with respect to Poisson's equations. By carefully choosing test and trial spaces a formulation that…

Numerical Analysis · Mathematics 2024-10-01 Erik Burman , Mingfei Lu

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

In this paper, we study an explicit Tikhonov-regularized inertial gradient algorithm for smooth convex minimization with Lipschitz continuous gradient. The method is derived via an explicit time discretization of a damped inertial system…

Optimization and Control · Mathematics 2026-02-02 Samir Adly , Vinh Thanh Ho , Huu Nhan Nguyen

Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, which are a necessity due to the ill-posedness of inverse problems. Tikhonov-type regularization methods are very popular in…

Numerical Analysis · Mathematics 2021-03-16 Abinash Nayak

So-called functional error estimators provide a valuable tool for reliably estimating the discretization error for a sum of two convex functions. We apply this concept to Tikhonov regularization for the solution of inverse problems for…

Numerical Analysis · Mathematics 2017-02-13 Christian Clason , Barbara Kaltenbacher , Daniel Wachsmuth

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Projected gradient descent…

Optimization and Control · Mathematics 2022-09-07 Trung Vu , Raviv Raich

For approximately solving linear ill-posed problems in Hilbert spaces, we investigate the regularization properties of the aggregation method and the RatCG method. These recent algorithms use previously calculated solutions of Tikhonov…

Numerical Analysis · Mathematics 2026-01-16 Stefan Kindermann

When solving rank-deficient or discrete ill-posed problems by regularization methods, the choice of the regularization parameter is crucial. It is also of interest, the regularization norm used in the selection of the solution. In this…

Numerical Analysis · Mathematics 2024-10-30 Ibrahima Dione

This paper proposes a stochastic variant of a classic algorithm---the cubic-regularized Newton method [Nesterov and Polyak 2006]. The proposed algorithm efficiently escapes saddle points and finds approximate local minima for general…

Machine Learning · Computer Science 2017-12-07 Nilesh Tripuraneni , Mitchell Stern , Chi Jin , Jeffrey Regier , Michael I. Jordan

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian