English
Related papers

Related papers: Linear Convergence of An Iterative Phase Retrieval…

200 papers

Developing large-scale distributed methods that are robust to the presence of adversarial or corrupted workers is an important part of making such methods practical for real-world problems. Here, we propose an iterative approach that is…

Machine Learning · Computer Science 2022-03-02 Xia Li , Longxiu Huang , Deanna Needell

We study nonconvex optimization for phase retrieval and the more general problem of semidefinite low-rank matrix sensing; in particular, we focus on the global nonconvex landscape of overparametrized versions of the nonsmooth amplitude…

Optimization and Control · Mathematics 2025-11-25 Andrew D. McRae

We study algorithms for solving quadratic systems of equations based on optimization methods over polytopes. Our work is inspired by a recently proposed convex formulation of the phase retrieval problem, which estimates the unknown signal…

Information Theory · Computer Science 2018-05-25 Oussama Dhifallah , Christos Thrampoulidis , Yue M. Lu

Randomized linear system solvers have become popular as they have the potential to reduce floating point complexity while still achieving desirable convergence rates. One particularly promising class of methods, random sketching solvers,…

Numerical Analysis · Mathematics 2020-12-23 Vivak Patel , Mohammad Jahangoshahi , Daniel Adrian Maldonado

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell

We study the low-rank phase retrieval problem, where we try to recover a $d_1\times d_2$ low-rank matrix from a series of phaseless linear measurements. This is a fourth-order inverse problem, as we are trying to recover factors of matrix…

Information Theory · Computer Science 2020-07-07 Kiryung Lee , Sohail Bahmani , Yonina Eldar , Justin Romberg

The problem of phase retrieval is revisited and studied from a fresh perspective. In particular, we establish a connection between the phase retrieval problem and the sensor network localization problem, which allows us to utilize the vast…

Optimization and Control · Mathematics 2018-03-22 Sherry Xue-Ying Ni , Man-Chung Yue , Kam-Fung Cheung , Anthony Man-Cho So

The generalized Gearhart-Koshy acceleration is a recent exact affine search technique designed for the method of cyclic projections onto hyperplanes, i.e., the Kaczmarz method. However, its convergence properties, particularly the linear…

Numerical Analysis · Mathematics 2026-04-08 Yijie Wang , Yonghan Sun , Deren Han , Jiaxin Xie

We address the phase retrieval problem with errors in the sensing vectors. A number of recent methods for phase retrieval are based on least squares (LS) formulations which assume errors in the quadratic measurements. We extend this…

Signal Processing · Electrical Eng. & Systems 2022-02-02 Sidharth Gupta , Ivan Dokmanić

We propose two new algebraic reconstruction techniques based on Kaczmarz's method that produce a regularized solution to noisy tomography problems. Tomography problems exhibit semi-convergence when iterative methods are employed, and the…

Numerical Analysis · Mathematics 2021-01-29 Bart S. van Lith , Per Christian Hansen , Michiel E. Hochstenbach

We present a variety of projection-based linear regression algorithms with a focus on modern machine-learning models and their algorithmic performance. We study the role of the relaxation parameter in generalized Kaczmarz algorithms and…

Machine Learning · Statistics 2025-11-12 Halyun Jeong , Palle E. T. Jorgensen , Hyun-Kyoung Kwon , Myung-Sin Song

In this paper, we analyze the convergence behavior of the randomized extended Kaczmarz (REK) method for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). The analysis…

Numerical Analysis · Mathematics 2021-05-12 Yanjun Zhang , Hanyu Li

In this paper, for solving inconsistent matrix equations we propose a dual-space residual-based randomized extended Kaczmarz method and its version with Nesterov momentum. Without the full column rank assumptions on coefficient matrices, we…

Numerical Analysis · Mathematics 2026-04-08 Wendi Bao , Jing Li , Lili Xing , Weiguo Li , Jichao Wang

Fourier phase retrieval is a classical problem that deals with the recovery of an image from the amplitude measurements of its Fourier coefficients. Conventional methods solve this problem via iterative (alternating) minimization by…

Image and Video Processing · Electrical Eng. & Systems 2020-07-30 Rakib Hyder , Zikui Cai , M. Salman Asif

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

The nonlinear Kaczmarz method was recently proposed to solve the system of nonlinear equations. In this paper, we first discuss two greedy selection rules, i.e., the maximum residual and maximum distance rules, for the nonlinear Kaczmarz…

Numerical Analysis · Mathematics 2022-09-14 Yanjun Zhang , Hanyu Li , Ling Tang

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian

Exploring the idea of phase retrieval has been intriguing researchers for decades, due to its appearance in a wide range of applications. The task of a phase retrieval algorithm is typically to recover a signal from linear phaseless…

Machine Learning · Statistics 2020-12-22 Naveed Naimipour , Shahin Khobahi , Mojtaba Soltanalian

In this paper, we analyze the greedy randomized Kaczmarz (GRK) method proposed in Bai and Wu (SIAM J. Sci. Comput., 40(1):A592--A606, 2018) for solving linear systems. We develop more precise greedy probability criteria to effectively…

Numerical Analysis · Mathematics 2023-11-15 Yansheng Su , Deren Han , Yun Zeng , Jiaxin Xie

We develop a fast phase retrieval method which can utilize a large class of local phaseless correlation-based measurements in order to recover a given signal ${\bf x} \in \mathbb{C}^d$ (up to an unknown global phase) in near-linear…

Numerical Analysis · Mathematics 2016-07-12 Mark Iwen , Aditya Viswanathan , Yang Wang