English
Related papers

Related papers: A sparse Kaczmarz solver and a linearized Bregman …

200 papers

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

Methodology · Statistics 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd

An iterative method LSMR is presented for solving linear systems $Ax=b$ and least-squares problem $\min \norm{Ax-b}_2$, with $A$ being sparse or a fast linear operator. LSMR is based on the Golub-Kahan bidiagonalization process. It is…

Mathematical Software · Computer Science 2012-01-25 David Fong , Michael Saunders

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Tensors serve as a crucial tool in the representation and analysis of complex, multi-dimensional data. As data volumes continue to expand, there is an increasing demand for developing optimization algorithms that can directly operate on…

Optimization and Control · Mathematics 2024-05-15 Katherine Henneberger , Jing Qin

The Kaczmarz method is a popular iterative scheme for solving large-scale linear systems. The randomized Kaczmarz method (RK) greatly improves the convergence rate of the Kaczmarz method, by using the rows of the coefficient matrix in…

Numerical Analysis · Mathematics 2020-12-01 Yutong Jiang , Gang Wu , Long Jiang

The Kaczmarz method is an iterative numerical method for solving large and sparse rectangular systems of linear equations. Gearhart, Koshy and Tam have developed an acceleration technique for the Kaczmarz method that minimizes the distance…

Numerical Analysis · Mathematics 2022-01-26 Janosch Rieger

Growing set of optimization and regression techniques, based upon sparse representations of signals, to build models from data sets has received widespread attention recently with the advent of compressed sensing. This paper deals with the…

Dynamical Systems · Mathematics 2021-10-26 Amartya Mukherjee , Yusuf Aydogdu , Thambirajah Ravichandran , Navaratnam Sri Namachchivaya

Intensively growing approach in signal processing and acquisition, the Compressive Sensing approach, allows sparse signals to be recovered from small number of randomly acquired signal coefficients. This paper analyses some of the commonly…

Signal Processing · Electrical Eng. & Systems 2018-02-21 Tamara Koljensic , Caslav Labudovic

A class of splitting alternating algorithms is proposed for finding the sparse solution of linear systems with concatenated orthogonal matrices. Depending on the number of matrices concatenated, the proposed algorithms are classified into…

Information Theory · Computer Science 2025-09-30 Yun-Bin Zhao , Zhong-Feng Sun

Compressive sensing is a novel approach that linearly samples sparse or compressible signals at a rate much below the Nyquist-Shannon sampling rate and outperforms traditional signal processing techniques in acquiring and reconstructing…

Information Theory · Computer Science 2019-01-03 Ramin Ayanzadeh , Seyedahmad Mousavi , Milton Halem , Tim Finin

We consider the problem of the recovery of a k-sparse vector from compressed linear measurements when data are corrupted by a quantization noise. When the number of measurements is not sufficiently large, different $k$-sparse solutions may…

Optimization and Control · Mathematics 2019-09-10 Vito Cerone , Sophie M. Fosson , Diego Regruto

The traditional compressed sensing approach is naturally offline, in that it amounts to sparsely sampling and reconstructing a given dataset. Recently, an online algorithm for performing compressed sensing on streaming data was proposed:…

Optimization and Control · Mathematics 2016-05-10 Pantelis Sopasakis , Nikolaos Freris , Panagiotis Patrinos

The Kaczmarz method is a popular iterative method for solving consistent, overdetermined linear system such as medical imaging in computerized tomography. The Kaczmarz's iteration repeatedly scans all equations in order, which leads to…

Numerical Analysis · Mathematics 2023-05-23 Chuan-gang Kang

The channel estimation is one of important techniques to ensure reliable broadband signal transmission. Broadband channels are often modeled as a sparse channel. Comparing with traditional dense-assumption based linear channel estimation…

Information Theory · Computer Science 2014-07-24 Guan Gui , Li Xu , Fumiyuki Adachi

In this technical report we present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image…

Numerical Analysis · Mathematics 2012-04-03 Deanna Needell , Rachel Ward

The Kaczmarz method is an efficient iterative algorithm for large-scale linear systems. However, its linear convergence rate suffers from ill-conditioned problems and is highly sensitive to the smallest nonzero singular value. In this work,…

Numerical Analysis · Mathematics 2026-02-26 Yunying Ke , Hao Luo

The Kaczmarz method is an iterative projection scheme for solving con-sistent system $Ax = b$. It is later extended to the inconsistent and ill-posed linear problems. But the classical Kaczmarz method is sensitive to the correlation of the…

Numerical Analysis · Mathematics 2022-10-04 Chuan-gang Kang , Heng Zhou

Randomized Kaczmarz is a simple iterative method for finding solutions of linear systems $Ax = b$. We point out that the arising sequence $(x_k)_{k=1}^{\infty}$ tends to converge to the solution $x$ in an interesting way: generically, as $k…

Numerical Analysis · Mathematics 2021-09-15 Stefan Steinerberger