English
Related papers

Related papers: Convergence properties of gradient methods for bli…

200 papers

We describe and experimentally validate an algorithm to reconstruct an unknown extended object from through-focus measured image intensities blurred by unknown aberrations. It is shown that the method can recover diffraction-limited image…

Optics · Physics 2015-10-29 Yifeng Shao , Niek Doelman , Silvania F. Pereira , H. Paul Urbach

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to…

Instrumentation and Methods for Astrophysics · Physics 2023-07-26 A. Asensio Ramos , S. Esteban Pozuelo , C. Kuckein

We present eMAGPIE (extended Multilevel-Adaptive-Guided Ptychographic Iterative Engine), a stochastic multigrid method for blind ptychographic phase retrieval that jointly recovers the object and the probe. We recast the task as the…

Numerical Analysis · Mathematics 2025-11-04 Borong Zhang , Junjing Deng , Yi Jiang , Zichao Wendy Di

We develop a new proximal-gradient method for minimizing the sum of a differentiable, possibly nonconvex, function plus a convex, possibly non differentiable, function. The key features of the proposed method are the definition of a…

Numerical Analysis · Mathematics 2016-05-13 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato

In this book chapter, we briefly describe the main components that constitute the gradient descent method and its accelerated and stochastic variants. We aim at explaining these components from a mathematical point of view, including…

Optimization and Control · Mathematics 2022-12-20 Quoc Tran-Dinh , Marten van Dijk

We generalize stochastic subgradient descent methods to situations in which we do not receive independent samples from the distribution over which we optimize, but instead receive samples that are coupled over time. We show that as long as…

Optimization and Control · Mathematics 2012-08-02 John C. Duchi , Alekh Agarwal , Mikael Johansson , Michael I. Jordan

Accurate quantum tomography is a vital tool in both fundamental and applied quantum science. It is a task that involves processing a noisy measurement record in order to construct a reliable estimate of an unknown quantum state, and is…

Quantum Physics · Physics 2017-01-02 Eliot Bolduc , George Knee , Erik Gauger , Jonathan Leach

Gradient methods are frequently used in large scale image deblurring problems since they avoid the onerous computation of the Hessian matrix of the objective function. Second order information is typically sought by a clever choice of the…

Numerical Analysis · Mathematics 2015-11-19 Federica Porta , Marco Prato , Luca Zanni

We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient…

Optimization and Control · Mathematics 2021-05-26 Martin Benning , Marta M. Betcke , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb

The aim of this paper is to deepen the convergence analysis of the scaled gradient projection (SGP) method, proposed by Bonettini et al. in a recent paper for constrained smooth optimization. The main feature of SGP is the presence of a…

Numerical Analysis · Mathematics 2015-09-10 Silvia Bonettini , Marco Prato

Ill-posed linear inverse problems appear in many scientific setups, and are typically addressed by solving optimization problems, which are composed of data fidelity and prior terms. Recently, several works have considered a back-projection…

Optimization and Control · Mathematics 2021-08-10 Tom Tirer , Raja Giryes

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken

The implementation of computational sensing strategies often faces calibration problems typically solved by means of multiple, accurately chosen training signals, an approach that can be resource-consuming and cumbersome. Conversely, blind…

Information Theory · Computer Science 2017-02-17 Valerio Cambareri , Laurent Jacques

For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous nonsmooth theory is challenging. Even when the objective is…

Optimization and Control · Mathematics 2023-01-19 X. Y. Han , Adrian S. Lewis

While deep learning-based methods for blind face restoration have achieved unprecedented success, they still suffer from two major limitations. First, most of them deteriorate when facing complex degradations out of their training data.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zongsheng Yue , Chen Change Loy

When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same…

Numerical Analysis · Mathematics 2025-01-23 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely…

Machine Learning · Statistics 2023-02-14 A. Duncan , N. Nuesken , L. Szpruch

Diffraction-limited imaging in epi-fluorescence microscopy remains a challenge when sample aberrations are present or when the region of interest rests deep within an inhomogeneous medium. Adaptive optics is an attractive solution albeit…

We investigate possibilities to speed up iterative algorithms for non-blind image deconvolution. We focus on algorithms in which convolution with the point-spread function to be deconvolved is used in each iteration, and aim at accelerating…

Computer Vision and Pattern Recognition · Computer Science 2013-04-29 Martin Welk , Martin Erler

In this work we investigate the practicality of stochastic gradient descent and recently introduced variants with variance-reduction techniques in imaging inverse problems. Such algorithms have been shown in the machine learning literature…

Optimization and Control · Mathematics 2021-01-26 Junqi Tang , Karen Egiazarian , Mohammad Golbabaee , Mike Davies