English
Related papers

Related papers: A matrix-free Levenberg-Marquardt algorithm for ef…

200 papers

Ptychography is a lensless imaging technique, which considers reconstruction from a set of far-field diffraction patterns obtained by illuminating small overlapping regions of the specimen. In many cases, a distribution of light inside the…

Numerical Analysis · Mathematics 2022-10-05 Frank Filbir , Oleh Melnyk

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

Machine Learning · Computer Science 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

This paper presents a new algorithm, Accelerated Wirtinger Flow (AWF), for ptychographic image reconstruction from phaseless diffraction pattern measurements. AWF is based on combining Nesterov's acceleration approach with Wirtinger…

Image and Video Processing · Electrical Eng. & Systems 2018-06-29 Rui Xu , Mahdi Soltanolkotabi , Justin P. Haldar , Walter Unglaub , Joshua Zusman , Anthony F. J. Levi , Richard M. Leahy

We develop a method for optimization in shape spaces, i.e., sets of surfaces modulo re-parametrization. Unlike previously proposed gradient flows, we achieve superlinear convergence rates through a subtle approximation of the shape Hessian,…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 J. Balzer , S. Soatto

First-order algorithms have been popular for solving convex and non-convex optimization problems. A key assumption for the majority of these algorithms is that the gradient of the objective function is globally Lipschitz continuous, but…

Optimization and Control · Mathematics 2024-02-07 Junyu Zhang , Mingyi Hong

Iterative projection algorithms are successfully being used as a substitute of lenses to recombine, numerically rather than optically, light scattered by illuminated objects. Images obtained computationally allow aberration-free…

Optics · Physics 2007-05-23 S. Marchesini

The well-known phase problem which means image reconstruction from only spectrum magnitude without using any spectrum phase information is considered basically in application to VLBI mapping of compact extragalactic radio sources (active…

Instrumentation and Methods for Astrophysics · Physics 2012-11-13 A. T. Bajkova

This work develops a provably accurate fully-decentralized alternating projected gradient descent (GD) algorithm for recovering a low rank (LR) matrix from mutually independent projections of each of its columns, in a fast and…

Information Theory · Computer Science 2025-08-27 Shana Moothedath , Namrata Vaswani

Efficient estimation of high-dimensional matrices-including covariance and precision matrices-is a cornerstone of modern multivariate statistics. Most existing studies have focused primarily on the theoretical properties of the estimators…

Machine Learning · Computer Science 2026-03-31 Wan Tian , Hui Yang , Zhouhui Lian , Lingyue Zhang , Yijie Peng

We provide a unifying framework for $\mathcal{L}_2$-optimal reduced-order modeling for linear time-invariant dynamical systems and stationary parametric problems. Using parameter-separable forms of the reduced-model quantities, we derive…

Numerical Analysis · Mathematics 2022-10-17 Petar Mlinarić , Serkan Gugercin

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

Recent progress in robust statistical learning has mainly tackled convex problems, like mean estimation or linear regression, with non-convex challenges receiving less attention. Phase retrieval exemplifies such a non-convex problem,…

Machine Learning · Statistics 2024-10-15 Alex Buna , Patrick Rebeschini

The diffusion models (DMs) have demonstrated the remarkable capability of generating images via learning the noised score function of data distribution. Current DM sampling techniques typically rely on first-order Langevin dynamics at each…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Fangyikang Wang , Hubery Yin , Lei Qian , Yinan Li , Shaobin Zhuang , Huminhao Zhu , Yilin Zhang , Yanlong Tang , Chao Zhang , Hanbin Zhao , Hui Qian , Chen Li

The geometric high-order regularization methods such as mean curvature and Gaussian curvature, have been intensively studied during the last decades due to their abilities in preserving geometric properties including image edges, corners,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Zhenwei Zhang , Ke Chen , Ke Tang , Yuping Duan

The alternating direction method of multipliers (ADMM) has recently sparked interest as a flexible and efficient optimization tool for imaging inverse problems, namely deconvolution and reconstruction under non-smooth convex regularization.…

Optimization and Control · Mathematics 2015-06-11 Mariana S. C. Almeida , Mário A. T. Figueiredo

A linear and thus convex phase retrieval algorithm for the application in phaseless near-field far-field transformations is presented. The formulation exploits locally known phase relations among sets of measurement samples, which can in…

Signal Processing · Electrical Eng. & Systems 2022-06-24 Alexander Paulus , Jonas Kornprobst , Josef Knapp , Thomas F. Eibert

We develop two iterative algorithms for solving the low rank phase retrieval (LRPR) problem. LRPR refers to recovering a low-rank matrix $\X$ from magnitude-only (phaseless) measurements of random linear projections of its columns. Both…

Information Theory · Computer Science 2017-08-02 Namrata Vaswani , Seyedehsara Nayer , Yonina C. Eldar

22. Shortening acquisition time and reducing the motion-artifact are two of the most critical issues in MRI. As a promising solution, high-quality MRI image restoration provides a new approach to achieve higher resolution without costing…

Image and Video Processing · Electrical Eng. & Systems 2021-02-02 Hao Li , Jianan Liu

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

Information Theory · Computer Science 2015-10-28 Sohail Bahmani , Justin Romberg

Consider composite nonconvex optimization problems where the objective function consists of a smooth nonconvex term (with Lipschitz-continuous gradient) and a convex (possibly nonsmooth) term. Existing parameter-free methods for such…

Optimization and Control · Mathematics 2025-10-08 Zilong Ye , Shiqian Ma , Junfeng Yang , Danqing Zhou