English
Related papers

Related papers: Convergence of the randomized Kaczmarz method for …

200 papers

The Sparse Kaczmarz method is a famous and widely used iterative method for solving the regularized basis pursuit problem. A general scheme of the surrogate hyperplane sparse Kaczmarz method is proposed. In particular, a class of…

Numerical Analysis · Mathematics 2024-06-24 Ze Wang , Jun-Feng Yin , Ji-Chen Zhao

While characterization of coherent wavefields is essential to laser, x-ray and electron imaging, sensors measure the squared magnitude of the field, rather than the field itself. Holography or phase retrieval must be used to characterize…

Image and Video Processing · Electrical Eng. & Systems 2020-12-10 David J. Brady , Timothy J. Schulz , Chengyu Wang

In recent literature, a general two step procedure has been formulated for solving the problem of phase retrieval. First, a spectral technique is used to obtain a constant-error initial estimate, following which, the estimate is refined to…

Machine Learning · Statistics 2023-07-10 Yan Shuo Tan , Roman Vershynin

We consider dictionary learning and blind calibration for signals and matrices created from a random ensemble. We study the mean-squared error in the limit of large signal dimension using the replica method and unveil the appearance of…

Information Theory · Computer Science 2014-02-04 Florent Krzakala , Marc Mézard , Lenka Zdeborová

We consider a phase retrieval problem, where we want to reconstruct a $n$-dimensional vector from its phaseless scalar products with $m$ sensing vectors, independently sampled from complex normal distributions. We show that, with a suitable…

Statistics Theory · Mathematics 2019-04-17 Irène Waldspurger

Phase retrieval deals with the estimation of complex-valued signals solely from the magnitudes of linear measurements. While there has been a recent explosion in the development of phase retrieval algorithms, the lack of a common interface…

Optimization and Control · Mathematics 2017-12-01 Rohan Chandra , Ziyuan Zhong , Justin Hontz , Val McCulloch , Christoph Studer , Tom Goldstein

Consider a scenario in which an unknown signal is transformed by a known linear operator, and then the pointwise absolute value of the unknown output function is reported. This scenario appears in several applications, and the goal is to…

Information Theory · Computer Science 2014-03-10 Dustin G. Mixon

Companion paper [118] developed a powerful \emph{Random duality theory} (RDT) based analytical program to statistically characterize performance of \emph{descending} phase retrieval algorithms (dPR) (these include all variants of gradient…

Machine Learning · Statistics 2025-06-24 Mihailo Stojnic

The generalized phase retrieval problem over compact groups aims to recover a set of matrices -- representing an unknown signal -- from their associated Gram matrices. This framework generalizes the classical phase retrieval problem, which…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Tal Amir , Tamir Bendory , Nadav Dym , Dan Edidin

In many signal processing problems arising in practical applications, we wish to reconstruct an unknown signal from its phaseless measurements with respect to a frame. This inverse problem is known as the phase retrieval problem. For each…

Information Theory · Computer Science 2023-07-04 Palina Salanevich

Quantile-based randomized Kaczmarz (QRK) was recently introduced to efficiently solve sparsely corrupted linear systems $\mathbf{A} \mathbf{x}^*+\mathbf{\epsilon} = \mathbf{b}$ [SIAM J. Matrix Anal. Appl., 43(2), 605-637], where…

Numerical Analysis · Mathematics 2025-07-22 Jian-Feng Cai , Junren Chen , Anna Ma , Tong Wu

This paper investigates phase retrieval using the Reshaped Wirtinger Flow (RWF) algorithm, focusing on recovering target vector $\vx \in \R^n$ from magnitude measurements \(y_i = \left| \langle \va_i, \vx \rangle \right|, \; i = 1, \ldots,…

Optimization and Control · Mathematics 2025-07-22 Linbin Li , Haiyang Peng , Yong Xia , Meng Huang

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

We present the first phase retrieval algorithm guaranteed to solve the multidimensional phase retrieval problem in polynomial arithmetic complexity without prior information. The method successfully terminates in O(N log(N)) operations for…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Cole Brabec , Sivan Trajtenberg-Mills , Luca Daniel , Dirk Englund

The randomized Kaczmarz ($\RK$) algorithm is a simple but powerful approach for solving consistent linear systems $Ax=b$. This paper proposes an accelerated randomized Kaczmarz ($\ARK$) algorithm with better convergence than the standard…

Numerical Analysis · Mathematics 2014-06-10 Ji Liu , Stephen J. Wright

Due to the ever growing amounts of data leveraged for machine learning and scientific computing, it is increasingly important to develop algorithms that sample only a small portion of the data at a time. In the case of linear least-squares,…

Machine Learning · Computer Science 2025-12-18 Gil Goldshlager , Jiang Hu , Lin Lin

Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination,…

Numerical Analysis · Mathematics 2025-06-24 Chai Wah Wu , Mark S. Squillante , Vasileios Kalantzis , Lior Horesh

We study nonconvex optimization for phase retrieval and the more general problem of semidefinite low-rank matrix sensing; in particular, we focus on the global nonconvex landscape of overparametrized versions of the nonsmooth amplitude…

Optimization and Control · Mathematics 2025-11-25 Andrew D. McRae

The Kaczmarz method is an iterative numerical method for solving large and sparse rectangular systems of linear equations. Gearhart, Koshy and Tam have developed an acceleration technique for the Kaczmarz method that minimizes the distance…

Numerical Analysis · Mathematics 2022-01-26 Janosch Rieger

Large-scale linear systems, $Ax=b$, frequently arise in practice and demand effective iterative solvers. Often, these systems are noisy due to operational errors or faulty data-collection processes. In the past decade, the randomized…

Numerical Analysis · Mathematics 2024-08-26 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma