English
Related papers

Related papers: An Integrated Constrained Gradient Descent (iCGD) …

200 papers

We consider blind ptychography, an imaging technique which aims to reconstruct an object of interest from a set of its diffraction patterns, each obtained by a local illumination. As the distribution of the light within the illuminated…

Numerical Analysis · Mathematics 2023-06-16 Oleh Melnyk

A detailed analysis of ptychography for 3D phase reconstructions of thick specimens is performed. We introduce multi-focus ptychography, which incorporates a 4D-STEM defocus series to enhance the quality of 3D reconstructions along the beam…

This paper presents a novel algorithm that leverages Stochastic Gradient Descent strategies in conjunction with Random Features to augment the scalability of Conic Particle Gradient Descent (CPGD) specifically tailored for solving sparse…

Optimization and Control · Mathematics 2025-09-05 Yohann De Castro , Sébastien Gadat , Clément Marteau

In this paper we introduce a novel certified shape optimization strategy - named Certified Descent Algorithm (CDA) - to account for the numerical error introduced by the Finite Element approximation of the shape gradient. We present a…

Numerical Analysis · Mathematics 2018-05-28 Matteo Giacomini , Olivier Pantz , Karim Trabelsi

There introduce Particle Optimized Gradient Descent (POGD), an algorithm based on the gradient descent but integrates the particle swarm optimization (PSO) principle to achieve the iteration. From the experiments, this algorithm has…

Machine Learning · Computer Science 2022-10-20 Feihu Han , Sida Xing , Sui Yang Khoo

Sparsity regularized loss minimization problems play an important role in various fields including machine learning, data mining, and modern statistics. Proximal gradient descent method and coordinate descent method are the most popular…

Machine Learning · Computer Science 2023-11-13 Runxue Bao , Bin Gu , Heng Huang

Projected gradient methods are widely used for constrained optimization. A key application is for partial differential equations (PDEs), where the objective functional represents physical energy and the linear constraints enforce…

Optimization and Control · Mathematics 2025-06-05 Ruchi Guo , Jun Zou

Traditional CNN models are trained and tested on relatively low resolution images (<300 px), and cannot be directly operated on large-scale images due to compute and memory constraints. We propose Patch Gradient Descent (PatchGD), an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Deepak K. Gupta , Gowreesh Mago , Arnav Chavan , Dilip K. Prasad

Line-search methods are commonly used to solve optimization problems. The simplest line search method is steepest descent where one always moves in the direction of the negative gradient. Newton's method on the other hand is a second-order…

Optimization and Control · Mathematics 2025-08-15 Shikhar Saxena , Tejas Bodas , Arti Yardi

Modern image and video compression codes employ elaborate structures existing in such signals to encode them into few number of bits. Compressed sensing recovery algorithms on the other hand use such signals' structures to recover them from…

Information Theory · Computer Science 2017-04-10 Sajjad Beygi , Shirin Jalali , Arian Maleki , Urbashi Mitra

Electron ptychography enables dose-efficient atomic-resolution imaging, but conventional reconstruction algorithms suffer from noise sensitivity, slow convergence, and extensive manual hyperparameter tuning for regularization, especially in…

Image and Video Processing · Electrical Eng. & Systems 2025-11-12 Arthur R. C. McCray , Stephanie M. Ribet , Georgios Varnavides , Colin Ophus

Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure. One reason lies in the insufficient training due to the asynchronous gradient…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Li'an Zhuo , Baochang Zhang , Linlin Yang , Hanlin Chen , Qixiang Ye , David Doermann , Guodong Guo , Rongrong Ji

Many crucial tasks of image processing and computer vision are formulated as inverse problems. Thus, it is of great importance to design fast and robust algorithms to solve these problems. In this paper, we focus on generalized projected…

Image and Video Processing · Electrical Eng. & Systems 2025-12-09 Ali Joundi , Yann Traonmilin , Alasdair Newson

Projected Gradient Descent (PGD) methods offer a simple and scalable approach to topology optimization (TO), yet they often struggle with nonlinear and multi-constraint problems due to the complexity of active-set detection. This paper…

Computational Engineering, Finance, and Science · Computer Science 2025-11-19 Amin Heyrani Nobari , Faez Ahmed

Many problems encountered in science and engineering can be formulated as estimating a low-rank object (e.g., matrices and tensors) from incomplete, and possibly corrupted, linear measurements. Through the lens of matrix and tensor…

Machine Learning · Computer Science 2023-10-11 Cong Ma , Xingyu Xu , Tian Tong , Yuejie Chi

High-fidelity simulations, such as computational fluid dynamics and finite element analysis, are essential for modeling complex engineering systems but are often prohibitively expensive for tasks including parametric studies, optimization,…

Machine Learning · Computer Science 2026-05-07 Melika Baghi , Xiao Liu , Kamran Paynabar

The optimization algorithms are crucial in training physics-informed neural networks (PINNs), as unsuitable methods may lead to poor solutions. Compared to the common gradient descent (GD) algorithm, implicit gradient descent (IGD)…

Machine Learning · Computer Science 2025-08-04 Xianliang Xu , Ting Du , Wang Kong , Bin Shan , Ye Li , Zhongyi Huang

Stochastically controlled stochastic gradient (SCSG) methods have been proved to converge efficiently to first-order stationary points which, however, can be saddle points in nonconvex optimization. It has been observed that a stochastic…

Optimization and Control · Mathematics 2021-04-26 Guannan Liang , Qianqian Tong , Chunjiang Zhu , Jinbo Bi

Iterative algorithms have many advantages for linear tomographic image reconstruction when compared to back-projection based methods. However, iterative methods tend to have significantly higher computational complexity. To overcome this,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-29 Yushan Gao , Ander Biguri , Thomas Blumensath

Ptychography is an emerging imaging technique that is able to provide wavelength-limited spatial resolution from specimen with extended lateral dimensions. As a scanning microscopy method, a typical two-dimensional image requires a number…