English
Related papers

Related papers: Multiple Choice Hard Thresholding Pursuit (MCHTP) …

200 papers

This paper seeks to bridge the two major algorithmic approaches to sparse signal recovery from an incomplete set of linear measurements -- L_1-minimization methods and iterative methods (Matching Pursuits). We find a simple regularized…

Numerical Analysis · Mathematics 2008-03-15 Deanna Needell , Roman Vershynin

Unions of subspaces provide a powerful generalization to linear subspace models for collections of high-dimensional data. To learn a union of subspaces from a collection of data, sets of signals in the collection that belong to the same…

Machine Learning · Computer Science 2016-10-28 Eva L. Dyer , Aswin C. Sankaranarayanan , Richard G. Baraniuk

For compressed sensing over arbitrarily connected networks, we consider the problem of estimating underlying sparse signals in a distributed manner. We introduce a new signal model that helps to describe inter-signal correlation among…

Information Theory · Computer Science 2013-10-29 Dennis Sundman , Saikat Chatterjee , Mikael Skoglund

Greedy algorithms are popular in compressive sensing for their high computational efficiency. But the performance of current greedy algorithms can be degenerated seriously by noise (both multiplicative noise and additive noise). A robust…

Information Theory · Computer Science 2014-02-10 Yurrit Avonds , Yipeng Liu , Sabine Van Huffel

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

Several sparsity-constrained algorithms such as Orthogonal Matching Pursuit or the Frank-Wolfe algorithm with sparsity constraints work by iteratively selecting a novel atom to add to the current non-zero set of variables. This selection…

Machine Learning · Computer Science 2016-08-23 A Rakotomamonjy , S Koço , Liva Ralaivola

In this paper, we propose a sparse least squares (SLS) optimization model for solving multilinear equations, in which the sparsity constraint on the solutions can effectively reduce storage and computation costs. By employing variational…

Optimization and Control · Mathematics 2023-10-10 Xin Li , Ziyan Luo , Yang Chen

The hierarchical sparsity framework, and in particular the HiHTP algorithm, has been successfully applied to many relevant communication engineering problems recently, particularly when the signal space is hierarchically structured. In this…

Information Theory · Computer Science 2024-11-12 Axel Flinth , Ingo Roth , Gerhard Wunder

The problem of consistently estimating the sparsity pattern of a vector $\betastar \in \real^\mdim$ based on observations contaminated by noise arises in various contexts, including subset selection in regression, structure estimation in…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright

In this paper, we consider the block-sparse signals recovery problem in the context of multiple measurement vectors (MMV) with common row sparsity patterns. We develop a new method for recovery of common row sparsity MMV signals, where a…

Machine Learning · Computer Science 2017-11-07 Hang Xiao , Zhengli Xing , Linxiao Yang , Jun Fang , Yanlun Wu

As a greedy algorithm to recover sparse signals from compressed measurements, orthogonal matching pursuit (OMP) algorithm has received much attention in recent years. In this paper, we introduce an extension of the OMP for pursuing…

Information Theory · Computer Science 2014-04-01 Jian Wang , Seokbeop Kwon , Byonghyo Shim

Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of…

Optimization and Control · Mathematics 2022-09-29 Saeed Damadi , Jinglai Shen

We propose a Multi-step Screening Procedure (MSP) for the recovery of sparse linear models in high-dimensional data. This method is based on a repeated small penalty strategy that quickly converges to an estimate within a few iterations.…

Methodology · Statistics 2019-12-13 Yuehan Yang , Ji Zhu , Edward I. George

This paper deals with the problem of sparse recovery often found in compressive sensing applications exploiting a priori knowledge. In particular, we present a knowledge-aided normalized iterative hard thresholding (KA-NIHT) algorithm that…

Information Theory · Computer Science 2018-09-26 R. C. de Lamare

Hard Thresholding Pursuit (HTP) has aroused increasing attention for its robust theoretical guarantees and impressive numerical performance in non-convex optimization. In this paper, we introduce a novel tuning-free procedure, named…

Statistics Theory · Mathematics 2025-01-07 Yanhang Zhang , Zhifan Li , Shixiang Liu , Xueqin Wang , Jianxin Yin

Recently, it has been discovered that results on universal sampling discretization of the square norm are useful in sparse sampling recovery with error being measured in the square norm. It was established that a simple greedy type…

Numerical Analysis · Mathematics 2023-07-11 F. Dai , V. Temlyakov

We provide a new efficient version of the backpropagation algorithm, specialized to the case where the weights of the neural network being trained are sparse. Our algorithm is general, as it applies to arbitrary (unstructured) sparsity and…

Machine Learning · Computer Science 2023-02-10 Mahdi Nikdan , Tommaso Pegolotti , Eugenia Iofinova , Eldar Kurtic , Dan Alistarh

We study sparse regression codes (SPARC) for multiple access channels with multiple receive antennas, in non-coherent flat fading channels. We propose a novel practical decoder, referred to as maximum likelihood matching pursuit (MLMP),…

Signal Processing · Electrical Eng. & Systems 2025-07-16 V S V Sandeep , Sai Dinesh Kancharana , Arun Pachai Kannu

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

This paper addresses the problem of estimating sparse channels in massive MIMO-OFDM systems. Most wireless channels are sparse in nature with large delay spread. In addition, these channels as observed by multiple antennas in a neighborhood…

Applications · Statistics 2015-06-22 Mudassir Masood , Laila H. Afify , Tareq Y. Al-Naffouri