English
Related papers

Related papers: Linear convergence of randomized Kaczmarz method f…

200 papers

In the phase retrieval problem, an unknown vector is to be recovered given quadratic measurements. This problem has received considerable attention in recent times. In this paper, we present an algorithm to solve a nonconvex formulation of…

Information Theory · Computer Science 2016-06-13 Ritesh Kolte , Ayfer Özgür

A recently proposed convex formulation of the phase retrieval problem estimates the unknown signal by solving a simple linear program. This new scheme, known as PhaseMax, is computationally efficient compared to standard convex relaxation…

Information Theory · Computer Science 2017-10-17 Oussama Dhifallah , Christos Thrampoulidis , Yue M. Lu

The randomized Kaczmarz (RK) method is a well-known approach for solving linear least-squares problems with a large number of rows. RK accesses and processes just one row at a time, leading to exponentially fast convergence for consistent…

Numerical Analysis · Mathematics 2025-04-11 Ethan N. Epperly , Gil Goldshlager , Robert J. Webber

In this paper, we consider the standard forms of two kinds of Kaczmarz-Tanabe type methods, one is derived from the Kaczmarz method and the other is derived from the symmetric Kaczmarz method. As a famous image reconstruction method in…

Numerical Analysis · Mathematics 2023-05-23 Chuan-gang Kang

Phase retrieval refers to algorithmic methods for recovering a signal from its phaseless measurements. Local search algorithms that work directly on the non-convex formulation of the problem have been very popular recently. Due to the…

Information Theory · Computer Science 2020-03-06 Rishabh Dudeja , Milad Bakhshizadeh , Junjie Ma , Arian Maleki

We describe an asynchronous parallel variant of the randomized Kaczmarz (RK) algorithm for solving the linear system $Ax=b$. The analysis shows linear convergence and indicates that nearly linear speedup can be expected if the number of…

Numerical Analysis · Mathematics 2014-06-10 Ji Liu , Stephen J. Wright , Srikrishna Sridhar

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi

We consider the task of recovering two real or complex $m$-vectors from phaseless Fourier measurements of their circular convolution. Our method is a novel convex relaxation that is based on a lifted matrix recovery formulation that allows…

Information Theory · Computer Science 2019-05-14 Ali Ahmed , Alireza Aghasi , Paul Hand

In this technical report we present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image…

Numerical Analysis · Mathematics 2012-04-03 Deanna Needell , Rachel Ward

The randomized block Kaczmarz (RBK) method is a widely utilized iterative scheme for solving large-scale linear systems. However, the theoretical analysis and practical effectiveness of this method heavily rely on a good row paving of the…

Numerical Analysis · Mathematics 2025-03-19 Ruike Xiang , Jiaxin Xie , Qiye Zhang

In this paper, we investigate phase retrieval algorithm for the single particle X-ray imaging data. We present a variance-reduced randomized Kaczmarz (VR-RK) algorithm for phase retrieval. The VR-RK algorithm is inspired by the randomized…

Quantitative Methods · Quantitative Biology 2022-07-12 Y. Xian , H. Liu , X. Tai , Y. Wang

Randomized iterative methods, such as the Kaczmarz method and its variants, have gained growing attention due to their simplicity and efficiency in solving large-scale linear systems. Meanwhile, absolute value equations (AVE) have attracted…

Numerical Analysis · Mathematics 2025-05-13 Jiaxin Xie , Hou-Duo Qi , Deren Han

Due to the ever growing amounts of data leveraged for machine learning and scientific computing, it is increasingly important to develop algorithms that sample only a small portion of the data at a time. In the case of linear least-squares,…

Machine Learning · Computer Science 2025-12-18 Gil Goldshlager , Jiang Hu , Lin Lin

Large-scale linear systems, $Ax=b$, frequently arise in practice and demand effective iterative solvers. Often, these systems are noisy due to operational errors or faulty data-collection processes. In the past decade, the randomized…

Numerical Analysis · Mathematics 2024-08-26 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

In this paper, several Kaczmarz-type numerical methods for solving the matrix equation $AX=B$ and $XA=C$ are proposed, where the coefficient matrix $A$ may be full rank or rank deficient. These methods are iterative methods without matrix…

Numerical Analysis · Mathematics 2023-06-01 Weiguo Li , Wendi Bao , Lili Xing , Zhiwei Guo

We present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image processing. The Kaczmarz method…

Numerical Analysis · Mathematics 2012-10-10 Deanna Needell , Rachel Ward

Tensor recovery has recently arisen in a lot of application fields, such as transportation, medical imaging and remote sensing. Under the assumption that signals possess sparse and/or low-rank structures, many tensor recovery methods have…

Optimization and Control · Mathematics 2021-02-16 Xuemei Chen , Jing Qin

In this paper, we study the phase retrieval problem in the situation where the vector to be recovered has an a priori structure that can encoded into a regularization term. This regularizer is intended to promote solutions conforming to…

Optimization and Control · Mathematics 2024-07-24 Jean-Jacques Godeme , Jalal Fadili

The recovery of a signal from the intensity measurements with some entries being known in advance is termed as {\em affine phase retrieval}. In this paper, we prove that a natural least squares formulation for the affine phase retrieval is…

Information Theory · Computer Science 2022-04-21 Meng Huang , Zhiqiang Xu

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh