English
Related papers

Related papers: On Subsampled Quantile Randomized Kaczmarz

200 papers

We study the problem of modeling univariate distributions via their quantile functions. We introduce a flexible family of distributions whose quantile function is a linear combination of basis quantiles. Because the model is linear in its…

Methodology · Statistics 2026-02-05 Cheng Peng , Yizhou Li , Stan Uryasev

The randomized row method is a popular representative of the iterative algorithm because of its efficiency in solving the overdetermined and consistent systems of linear equations. In this paper, we present an extended randomized multiple…

Numerical Analysis · Mathematics 2024-11-06 Nian-Ci Wu , Chengzhi Liu , Yatian Wang , Qian Zuo

The randomized Kaczmarz methods are a popular and effective family of iterative methods for solving large-scale linear systems of equations, which have also been applied to linear feasibility problems. In this work, we propose a new block…

Optimization and Control · Mathematics 2024-06-19 Minxin Zhang , Jamie Haddock , Deanna Needell

We consider the general problem of recovering a high-dimensional signal from noisy quantized measurements. Quantization, especially coarse quantization such as 1-bit sign measurements, leads to severe information loss and thus a good prior…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Xiangming Meng , Yoshiyuki Kabashima

This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left…

Information Theory · Computer Science 2017-10-10 Mohamed A. Suliman , Ayed M. Alrashdi , Tarig Ballal , Tareq Y. Al-Naffouri

In this paper, for solving inconsistent matrix equations we propose a dual-space residual-based randomized extended Kaczmarz method and its version with Nesterov momentum. Without the full column rank assumptions on coefficient matrices, we…

Numerical Analysis · Mathematics 2026-04-08 Wendi Bao , Jing Li , Lili Xing , Weiguo Li , Jichao Wang

We consider the problem of minimizing a $d$-dimensional Lipschitz convex function using a stochastic gradient oracle. We introduce and motivate a setting where the noise of the stochastic gradient is isotropic in that it is bounded in every…

Optimization and Control · Mathematics 2025-10-24 Annie Marsden , Liam O'Carroll , Aaron Sidford , Chenyi Zhang

The paper studies identification of linear systems with multiplicative noise from multiple-trajectory data. An algorithm based on the least-squares method and multiple-trajectory data is proposed for joint estimation of the nominal system…

Systems and Control · Electrical Eng. & Systems 2022-06-07 Yu Xing , Benjamin Gravell , Xingkang He , Karl Henrik Johansson , Tyler Summers

Recently the use of Noisy Intermediate Scale Quantum (NISQ) devices for machine learning tasks has been proposed. The propositions often perform poorly due to various restrictions. However, the quantum devices should perform well in…

Quantum Physics · Physics 2019-07-12 Przemysław Sadowski

Quantization can be used to form new vectors/matrices with shared values close to the original. In recent years, the popularity of scalar quantization for value-sharing applications has been soaring as it has been found huge utilities in…

Machine Learning · Computer Science 2019-12-11 Chen Wang , Xiaomei Yang , Shaomin Fei , Kai Zhou , Xiaofeng Gong , Miao Du , Ruisen Luo

In [Steinerberger, Q. Appl. Math., 79:3, 419-429, 2021] and [Shao, SIAM J. Matrix Anal. Appl. 44(1), 212-239, 2023], two new types of Kaczmarz algorithms, which share some similarities, for consistent linear systems were proposed. These two…

Numerical Analysis · Mathematics 2024-07-30 Changpeng Shao

A greedy randomized nonlinear Bregman-Kaczmarz method by sampling the working index with residual information is developed for the solution of the constrained nonlinear system of equations. Theoretical analyses prove the convergence of the…

Numerical Analysis · Mathematics 2024-06-25 Aqin Xiao , Junfeng Yin

Quantile regression (QR) is becoming increasingly popular due to its relevance in many scientific investigations. There is a great amount of work about linear and nonlinear QR models. Specifically, nonparametric estimation of the…

Methodology · Statistics 2020-01-13 Eliana Christou

An iterative method LSMR is presented for solving linear systems $Ax=b$ and least-squares problem $\min \norm{Ax-b}_2$, with $A$ being sparse or a fast linear operator. LSMR is based on the Golub-Kahan bidiagonalization process. It is…

Mathematical Software · Computer Science 2012-01-25 David Fong , Michael Saunders

Stochastic iterative methods are useful in a variety of large-scale numerical linear algebraic, machine learning, and statistical problems, in part due to their low-memory footprint. They are frequently used in a variety of applications,…

Numerical Analysis · Mathematics 2025-11-27 Toby Anderson , Max Collins , Jamie Haddock , Jackie Lok , Elizaveta Rebrova

We establish an improved classical algorithm for solving linear systems in a model analogous to the QRAM that is used by quantum linear solvers. Precisely, for the linear system $A\x = \b$, we show that there is a classical algorithm that…

Quantum Physics · Physics 2023-04-18 Changpeng Shao , Ashley Montanaro

Efficient estimation of wideband spectrum is of great importance for applications such as cognitive radio. Recently, sub-Nyquist sampling schemes based on compressed sensing have been proposed to greatly reduce the sampling rate. However,…

Signal Processing · Electrical Eng. & Systems 2018-05-23 Haoyu Fu , Yuejie Chi

In this paper, we analyze the convergence behavior of the randomized extended Kaczmarz (REK) method for all types of linear systems (consistent or inconsistent, overdetermined or underdetermined, full-rank or rank-deficient). The analysis…

Numerical Analysis · Mathematics 2021-05-12 Yanjun Zhang , Hanyu Li

Adaptive sampling theory has shown that, with proper assumptions on the signal class, algorithms exist to reconstruct a signal in $\mathbb{R}^{d}$ with an optimal number of samples. We generalize this problem to the case of spatial signals,…

Machine Learning · Statistics 2017-02-20 John Lipor , Brandon Wong , Donald Scavia , Branko Kerkez , Laura Balzano

In this note we compare the randomized extended Kaczmarz (EK) algorithm and randomized coordinate descent (CD) for solving the full-rank overdetermined linear least-squares problem and prove that CD needs less operations for satisfying the…

Numerical Analysis · Mathematics 2014-09-02 Bogdan Dumitrescu