English
Related papers

Related papers: Extension of Sparse Randomized Kaczmarz Algorithm …

200 papers

The Bregman-Kaczmarz method is an iterative method which can solve strongly convex problems with linear constraints and uses only one or a selected number of rows of the system matrix in each iteration, thereby making it amenable for…

Optimization and Control · Mathematics 2023-07-31 Dirk A. Lorenz , Maximilian Winkler

We show that an idea, originating initially with a fundamental recursive iteration scheme (usually referred as "the" Kaczmarz algorithm), admits important applications in such infinite-dimensional, and non-commutative, settings as are…

Functional Analysis · Mathematics 2019-04-10 Palle Jorgensen , Myung-Sin Song , Feng Tian

We propose an iterative gradient-based algorithm to efficiently solve the portfolio selection problem with multiple spectral risk constraints. Since the conditional value at risk (CVaR) is a special case of the spectral risk measure, our…

Portfolio Management · Quantitative Finance 2015-03-26 Carlos Abad , Garud Iyengar

A class of averaging block nonlinear Kaczmarz methods is developed for the solution of the nonlinear system of equations. The convergence theory of the proposed method is established under suitable assumptions and the upper bounds of the…

Numerical Analysis · Mathematics 2023-07-31 Aqin Xiao , Junfeng Yin

In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of…

Numerical Analysis · Mathematics 2017-11-15 Matthias Morzfeld , Marcus S. Day , Ray W. Grout , George Shu Heng Pau , Stefan A. Finsterle , John B. Bell

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman

The random reshuffling Kaczmarz (RRK) method enjoys the simplicity and efficiency in solving linear systems as a Kaczmarz-type method, whereas it also inherits the practical improvements of the stochastic gradient descent (SGD) with random…

Numerical Analysis · Mathematics 2025-08-08 Deren Han , Jiaxin Xie

The multivariate regression model basically offers the analysis of a single dataset with multiple responses. However, such a single-dataset analysis often leads to unsatisfactory results. Integrative analysis is an effective method to pool…

Methodology · Statistics 2023-04-18 Shuichi Kawano , Toshikazu Fukushima , Junichi Nakagawa , Mamoru Oshiki

The multi-step inertial randomized Kaczmarz (MIRK) method is an iterative method for solving large-scale linear systems. In this paper, we enhance the MIRK method by incorporating the greedy probability criterion, coupled with the…

Numerical Analysis · Mathematics 2024-10-10 Yansheng Su , Deren Han , Yun Zeng , Jiaxin Xie

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a…

Machine Learning · Statistics 2022-10-25 Sasila Ilandarideva , Yannis Bekri , Anatoli Juditsky , Vianney Perchet

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter

To exploit the benefits of massive multiple-input multiple-output (M-MIMO) technology in scenarios where base stations (BSs) need to be cheap and equipped with simple hardware, the computational complexity of classical signal processing…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Victor Croisfelt Rodrigues , Jose Carlos Marinello Filho , Taufik Abrao

Novel sparse reconstruction algorithms are proposed for beamspace channel estimation in massive multiple-input multiple-output systems. The proposed algorithms minimize a least-squares objective having a nonconvex regularizer. This…

Information Theory · Computer Science 2021-12-02 Pengxia Wu , Julian Cheng

A greedy randomized nonlinear Bregman-Kaczmarz method by sampling the working index with residual information is developed for the solution of the constrained nonlinear system of equations. Theoretical analyses prove the convergence of the…

Numerical Analysis · Mathematics 2024-06-25 Aqin Xiao , Junfeng Yin

Recovering a signal $x^\ast \in \mathbb{R}^n$ from a sequence of linear measurements is an important problem in areas such as computerized tomography and compressed sensing. In this work, we consider an online setting in which measurements…

Numerical Analysis · Mathematics 2022-11-14 Benjamin Jarman , Yotam Yaniv , Deanna Needell

Vector valued data appearing in concrete applications often possess sparse expansions with respect to a preassigned frame for each vector component individually. Additionally, different components may also exhibit common sparsity patterns.…

Numerical Analysis · Mathematics 2007-05-23 Massimo Fornasier , Holger Rauhut

We investigate the problem of estimating the 3D shape of an object defined by a set of 3D landmarks, given their 2D correspondences in a single image. A successful approach to alleviating the reconstruction ambiguity is the 3D deformable…

Computer Vision and Pattern Recognition · Computer Science 2017-01-12 Xiaowei Zhou , Menglong Zhu , Spyridon Leonardos , Kostas Daniilidis

Two complementary approaches have been extensively used in signal and image processing leading to novel results, the sparse representation methodology and the variational strategy. Recently, a new sparsity based model has been proposed, the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Raja Giryes , Michael Elad , Alfred M. Bruckstein

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian