English
Related papers

Related papers: Adaptive Block Sparse Regularization under Arbitra…

200 papers

In this paper, we develop a randomized algorithm and theory for learning a sparse model from large-scale and high-dimensional data, which is usually formulated as an empirical risk minimization problem with a sparsity-inducing regularizer.…

Machine Learning · Computer Science 2016-10-18 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

Machine Learning · Statistics 2012-02-14 Cun-Hui Zhang , Tong Zhang

In many linear regression problems, including ill-posed inverse problems in image restoration, the data exhibit some sparse structures that can be used to regularize the inversion. To this end, a classical path is to use $\ell_{12}$ block…

Signal Processing · Electrical Eng. & Systems 2021-10-25 Charles-Alban Deledalle , Nicolas Papadakis , Joseph Salmon , Samuel Vaiter

Block sparsity is an important parameter in many algorithms to successfully recover block sparse signals under the framework of compressive sensing. However, it is often unknown and needs to be estimated. Recently there emerges a few…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Jianfeng Wang , Zhiyong Zhou , Jun Yu

We propose and analyze an online algorithm for reconstructing a sequence of signals from a limited number of linear measurements. The signals are assumed sparse, with unknown support, and evolve over time according to a generic nonlinear…

Optimization and Control · Mathematics 2015-03-12 Joao F. C. Mota , Nikos Deligiannis , Aswin C. Sankaranarayanan , Volkan Cevher , Miguel R. D. Rodrigues

Sparse modeling is one of the efficient techniques for imaging that allows recovering lost information. In this paper, we present a novel iterative phase-retrieval algorithm using a sparse representation of the object amplitude and phase.…

Computer Vision and Pattern Recognition · Computer Science 2011-08-17 Artem Migukin , Vladimir Katkovnik , Jaakko Astola

This work addresses the recovery and demixing problem of signals that are sparse in some general dictionary. Involved applications include source separation, image inpainting, super-resolution, and restoration of signals corrupted by…

Information Theory · Computer Science 2017-03-24 Fei Wen , Lasith Adhikari , Ling Pei , Roummel F. Marcia , Peilin Liu , Robert C. Qiu

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

Information Theory · Computer Science 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

This article proposes diffusion LMS strategies for distributed estimation over adaptive networks that are able to exploit sparsity in the underlying system model. The approach relies on convex regularization, common in compressive sensing,…

Machine Learning · Computer Science 2015-06-05 Paolo Di Lorenzo , Ali H. Sayed

Image quality is the basis of image communication and understanding tasks. Due to the blur and noise effects caused by imaging, transmission and other processes, the image quality is degraded. Blind image restoration is widely used to…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Ningshan Xu

This paper presents a novel Block Iterative Bayesian Algorithm (Block-IBA) for reconstructing block-sparse signals with unknown block structures. Unlike the existing algorithms for block sparse signal recovery which assume the cluster…

Machine Learning · Statistics 2014-12-09 Mehdi Korki , Jingxin Zhang , Cishen Zhang , Hadi Zayyani

We propose two nonconvex regularization methods, LogLOP-l2/l1 and AdaLOP-l2/l1, for recovering block-sparse signals with unknown block partitions. These methods address the underestimation bias of existing convex approaches by extending…

Machine Learning · Computer Science 2026-03-03 Takanobu Furuhashi , Hiroki Kuroda , Masahiro Yukawa , Qibin Zhao , Hidekata Hontani , Tatsuya Yokota

Sparse signals can be recovered from a reduced set of samples by using compressive sensing algorithms. In common methods the signal is recovered in the sparse domain. A method for the reconstruction of sparse signal which reconstructs the…

Information Theory · Computer Science 2015-04-28 Ljubisa Stankovic , Milos Dakovic

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

Given a dictionary that consists of multiple blocks and a signal that lives in the range space of only a few blocks, we study the problem of finding a block-sparse representation of the signal, i.e., a representation that uses the minimum…

Optimization and Control · Mathematics 2015-05-27 Ehsan Elhamifar , Rene Vidal

Sparse solution problems play an important role in both signal processing and image restoration. In this paper, we propose a stochastic column-block nonlinear Bregman method for efficiently computing sparse solutions to nonlinear systems.…

Numerical Analysis · Mathematics 2026-05-11 Wendi Bao , Naiyu Jiang , Lili Xing , Weiguo Li

Recovery of arbitrarily positioned samples that are missing in sparse signals recently attracted significant research interest. Sparse signals with heavily corrupted arbitrary positioned samples could be analyzed in the same way as…

Information Theory · Computer Science 2013-09-24 Ljubisa Stankovic , Milos Dakovic , Stefan Vujovic

Owing to their statistical properties, non-convex sparse regularizers have attracted much interest for estimating a sparse linear model from high dimensional data. Given that the solution is sparse, for accelerating convergence, a working…

Machine Learning · Computer Science 2021-10-22 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Joseph Salmon

We present reconstruction algorithms for smooth signals with block sparsity from their compressed measurements. We tackle the issue of varying group size via group-sparse least absolute shrinkage selection operator (LASSO) as well as via…

Machine Learning · Statistics 2013-09-11 Shahzad Gishkori , Geert Leus

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of…

Information Theory · Computer Science 2016-04-05 Anastasios Kyrillidis , Bubacarr Bah , Rouzbeh Hasheminezhad , Quoc Tran-Dinh , Luca Baldassarre , Volkan Cevher