English
Related papers

Related papers: The sparse Kaczmarz method with surrogate hyperpla…

200 papers

In this technical report we present a Projection onto Convex Sets (POCS) type algorithm for solving systems of linear equations. POCS methods have found many applications ranging from computer tomography to digital signal and image…

Numerical Analysis · Mathematics 2012-04-03 Deanna Needell , Rachel Ward

We propose a variant of the classical conditional gradient method for sparse inverse problems with differentiable measurement models. Such models arise in many practical problems including superresolution, time-series modeling, and matrix…

Optimization and Control · Mathematics 2015-07-07 Nicholas Boyd , Geoffrey Schiebinger , Benjamin Recht

Diffusion kernels over graphs have been widely utilized as effective tools in various applications due to their ability to accurately model the flow of information through nodes and edges. However, there is a notable gap in the literature…

Numerical Analysis · Mathematics 2026-04-15 Giuseppe Alessio D'Inverno , Kylian Ajavon , Simone Brugiapaglia

The convolutional sparse model has recently gained increasing attention in the signal and image processing communities, and several methods have been proposed for solving the pursuit problem emerging from it -- in particular its convex…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

We investigate the methods that simultaneously enforce sparsity and low-rank structure in a matrix as often employed for sparse phase retrieval problems or phase calibration problems in compressive sensing. We propose a new approach for…

Numerical Analysis · Computer Science 2014-03-20 Cagdas Bilen , Gilles Puy , Rémi Gribonval , Laurent Daudet

In compressive sensing, the basis pursuit algorithm aims to find the sparsest solution to an underdetermined linear equation system. In this paper, we generalize basis pursuit to finding the sparsest solution to higher order nonlinear…

Information Theory · Computer Science 2013-04-23 Henrik Ohlsson , Allen Y. Yang , Roy Dong , S. Shankar Sastry

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

Optimization and Control · Mathematics 2026-03-20 Dan Garber

For solving a consistent system of linear equations, the classical row-action (also known as Kaczmarz) method is a simple while really effective iteration solver. Based on the greedy index selection strategy and Polyak's heavy-ball momentum…

Numerical Analysis · Mathematics 2024-03-13 Nian-Ci Wu , Qian Zuo , Yatian Wang

We revisit the problem of certifying the correctness of approximate solution paths computed by numerical homotopy continuation methods. We propose a conceptually simple approach based on a parametric variant of the Krawczyk method from…

Numerical Analysis · Mathematics 2024-05-31 Timothy Duff , Kisun Lee

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

To solve the problem of joint sparsity pattern recovery in a decen-tralized network, we propose an algorithm named decentralized and collaborative subspace pursuit (DCSP). The basic idea of DCSP is to embed collaboration among nodes and…

Information Theory · Computer Science 2014-03-07 Gang Li , Thakshila Wimalajeewa , Pramod K. Varshney

Matching pursuits are a class of greedy algorithms commonly used in signal processing, for solving the sparse approximation problem. They rely on an atom selection step that requires the calculation of numerous projections, which can be…

Data Structures and Algorithms · Computer Science 2012-04-06 Manuel Moussallam , Laurent Daudet , Gaël Richard

We investigate iterated Tikhonov methods coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization method. In the…

Numerical Analysis · Mathematics 2020-12-23 J. Baumeister , A. De Cezaro , A. Leitao

In this article a modified Levenberg-Marquardt method coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations is investigated. We show that the proposed method is a convergent…

Numerical Analysis · Mathematics 2020-11-20 J. Baumeister , B. Kaltenbacher , A. Leitao

Combined optimization problems that couple data-fidelity and regularization terms arise naturally in a wide range of inverse problems. In this paper, we study an adaptive randomized averaging block extended Bregman-Kaczmarz (aRABEBK) method…

Numerical Analysis · Mathematics 2026-01-19 Zeyu Dong , Aqin Xiao , Guojian Yin , Junfeng Yin

A common task in inverse problems and imaging is finding a solution that is sparse, in the sense that most of its components vanish. In the framework of compressed sensing, general results guaranteeing exact recovery have been proven. In…

Numerical Analysis · Mathematics 2021-04-29 Monica Pragliola , Daniela Calvetti , Erkki Somersalo

This paper investigates the convergence of the randomized Kaczmarz algorithm for the problem of phase retrieval of complex-valued objects. While this algorithm has been studied for the real-valued case}, its generalization to the…

Information Theory · Computer Science 2020-10-14 Teng Zhang , Feng Yu

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

This paper presents a particle swarm optimization algorithm that leverages surrogate modeling to replace the conventional global best solution with the minimum of an n-dimensional quadratic form, providing a better-conditioned dynamic…

Neural and Evolutionary Computing · Computer Science 2026-03-19 Maurizio Clemente , Marcello Canova

We describe an apparatus for subgradient-following of the optimum of convex problems with variational penalties. In this setting, we receive a sequence $y_i,\ldots,y_n$ and seek a smooth sequence $x_1,\ldots,x_n$. The smooth sequence needs…

Machine Learning · Computer Science 2025-04-11 Kai-Chia Mo , Shai Shalev-Shwartz , Nisæl Shártov