English
Related papers

Related papers: Lorentzian Iterative Hard Thresholding: Robust Com…

200 papers

The use of M-estimators in generalized linear regression models in high dimensional settings requires risk minimization with hard $L_0$ constraints. Of the known methods, the class of projected gradient descent (also known as iterative hard…

Machine Learning · Computer Science 2014-10-22 Prateek Jain , Ambuj Tewari , Purushottam Kar

Noise robust compressive sensing algorithm is considered. This algorithm allows an efficient signal reconstruction in the presence of different types of noise due to the possibility to change minimization norm. For instance, the commonly…

Information Theory · Computer Science 2015-02-23 Maja Lakicevic , Mitar Moracanin , Nadja Djerkovic

Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of…

Optimization and Control · Mathematics 2022-09-29 Saeed Damadi , Jinglai Shen

In this paper, we present modifications of the iterative hard thresholding (IHT) method for recovery of jointly row-sparse and low-rank matrices. In particular a Riemannian version of IHT is considered which significantly reduces…

Optimization and Control · Mathematics 2022-10-03 Henrik Eisenmann , Felix Krahmer , Max Pfeffer , André Uschmajew

We consider the problem of in-network compressed sensing from distributed measurements. Every agent has a set of measurements of a signal $x$, and the objective is for the agents to recover $x$ from their collective measurements using only…

Information Theory · Computer Science 2015-06-17 Stacy Patterson , Yonina C. Eldar , Idit Keidar

Compressed sensing has shown great potentials in accelerating magnetic resonance imaging. Fast image reconstruction and high image quality are two main issues faced by this new technology. It has been shown that, redundant image…

Medical Physics · Physics 2016-01-27 Yunsong Liu , Zhifang Zhan , Jian-Feng Cai , Di Guo , Zhong Chen , Xiaobo Qu

Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured…

Information Theory · Computer Science 2012-05-09 Thomas Blumensath

Iterative hard thresholding (IHT) and compressive sampling matching pursuit (CoSaMP) are two types of mainstream compressed sensing algorithms using hard thresholding operators for signal recovery and approximation. The guaranteed…

Signal Processing · Electrical Eng. & Systems 2020-09-23 Yun-Bin Zhao , Zhi-Quan Luo

Recovering a sparse signal from outlier-contaminated measurements is a fundamental challenge in many applications. While existing algorithms predominantly address scenarios with bounded noise or assume known signal sparsity, few methods…

Information Theory · Computer Science 2026-03-09 Jiao Xu , Peng Li , Bing Zheng

A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many…

Information Theory · Computer Science 2010-04-13 Jeffrey D. Blanchard , Coralia Cartis , Jared Tanner , Andrew Thompson

Compressed sensing has shown that it is possible to reconstruct sparse high dimensional signals from few linear measurements. In many cases, the solution can be obtained by solving an L1-minimization problem, and this method is accurate…

Numerical Analysis · Mathematics 2009-04-27 Deanna Needell

Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently,…

Information Theory · Computer Science 2024-07-22 D. Barbier , C Lucibello , L. Saglietti , F. Krzakala , L. Zdeborova

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

Machine Learning · Statistics 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

Compressive sensing is a technique to sample signals well below the Nyquist rate using linear measurement operators. In this paper we present an algorithm for signal reconstruction given such a set of measurements. This algorithm…

Information Theory · Computer Science 2009-06-08 Graeme Pope

Greed is good. However, the tighter you squeeze, the less you have. In this paper, a less greedy algorithm for sparse signal reconstruction in compressive sensing, named orthogonal matching pursuit with thresholding is studied. Using the…

Information Theory · Computer Science 2015-07-03 Mingrui Yang , Frank de Hoog

In this note, we analyze an iterative soft / hard thresholding algorithm with homotopy continuation for recovering a sparse signal $x^\dag$ from noisy data of a noise level $\epsilon$. Under suitable regularity and sparsity conditions, we…

Numerical Analysis · Mathematics 2017-05-24 Yuling Jiao , Bangti Jin , Xiliang Lu

In this paper, we will investigate the efficacy of IMAT (Iterative Method of Adaptive Thresholding) in recovering the sparse signal (parameters) for linear models with missing data. Sparse recovery rises in compressed sensing and machine…

Machine Learning · Computer Science 2016-06-14 Ashkan Esmaeili , Farokh Marvasti

We present a novel sparse signal reconstruction method "ISD", aiming to achieve fast reconstruction and a reduced requirement on the number of measurements compared to the classical l_1 minimization approach. ISD addresses failed…

Information Theory · Computer Science 2015-11-23 Yilun Wang , Wotao Yin

Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this work, we propose a data driven non-iterative algorithm to overcome the shortcomings of earlier…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Suhas Lohit , Kuldeep Kulkarni , Ronan Kerviche , Pavan Turaga , Amit Ashok

In representation learning, Convolutional Sparse Coding (CSC) enables unsupervised learning of features by jointly optimising both an \(\ell_2\)-norm fidelity term and a sparsity enforcing penalty. This work investigates using a…

Image and Video Processing · Electrical Eng. & Systems 2021-07-15 Perla Mayo , Oktay Karakuş , Robin Holmes , Alin Achim