English
Related papers

Related papers: Sparse approximation and recovery by greedy algori…

200 papers

Sparse signal recovery has been dominated by the basis pursuit denoise (BPDN) problem formulation for over a decade. In this paper, we propose an algorithm that outperforms BPDN in finding sparse solutions to underdetermined linear systems…

Information Theory · Computer Science 2012-06-01 Hassan Mansour

We show that Orthogonal Greedy Algorithms (Orthogonal Matching Pursuit) provides almost optimal approximation on the first [1/(20M)] steps for M-coherent dictionaries

Numerical Analysis · Mathematics 2010-03-30 Eugene Livshitz

One of the biggest open problems in computational algebra is the design of efficient algorithms for Gr{\"o}bner basis computations that take into account the sparsity of the input polynomials. We can perform such computations in the case of…

Symbolic Computation · Computer Science 2018-06-22 Matías Bender , Jean-Charles Faugère , Elias Tsigaridas

Democracy functions of wavelet admissible bases are computed for weighted Orlicz Spaces in terms of its fundamental function. In particular, we prove that these bases are greedy if and only if the Orlicz space is a Lebesgue space. Also,…

History and Overview · Mathematics 2009-11-26 Maria de Natividade

We consider multichannel sparse recovery problem where the objective is to find good recovery of jointly sparse unknown signal vectors from the given multiple measurement vectors which are different linear combinations of the same known…

Information Theory · Computer Science 2015-06-11 Esa Ollila

In this paper, we consider the problem of collaboratively estimating the sparsity pattern of a sparse signal with multiple measurement data in distributed networks. We assume that each node makes Compressive Sensing (CS) based measurements…

Information Theory · Computer Science 2012-11-29 Thakshila Wimalajeewa , Pramod K. Varshney

Test set with redundancy is one of the focuses in recent bioinformatics research. Set cover greedy algorithm (SGA for short) is a commonly used algorithm for test set with redundancy. This paper proves that the approximation ratio of SGA…

Data Structures and Algorithms · Computer Science 2007-09-27 Peng Cui

Probabilistic Coalition Structure Generation (PCSG) is NP-hard and can be recast as an $l_0$-type sparse recovery problem by representing coalition structures as sparse coefficient vectors over a coalition-incidence design. A natural…

Computer Science and Game Theory · Computer Science 2026-01-12 Angshul Majumdar

Greedy expansions with prescribed coefficients have been introduced by V. N. Temlyakov in the frame of Banach spaces. The idea is to choose a sequence of fixed (real) coefficients $\{c_n\}_{n=1}^\infty$ and a fixed set of elements…

Functional Analysis · Mathematics 2023-07-06 Alessandro Oliaro , Luca Tomatis , Albert R. Valiullin , Artur R. Valiullin

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Kernel interpolation is a versatile tool for the approximation of functions from data, and it can be proven to have some optimality properties when used with kernels related to certain Sobolev spaces. In the context of interpolation, the…

Numerical Analysis · Mathematics 2025-01-09 Gabriele Santin , Tizian Wenzel , Bernard Haasdonk

Garling sequence spaces admit a renorming with respect to which their standard unit vector basis is 1-greedy. We also discuss some additional properties of these Banach spaces related to uniform convexity and superreflexivity. In…

Functional Analysis · Mathematics 2017-05-12 Fernado Albiac , José L. Ansorena , Ben Wallis

Greedy algorithms are central to sparse approximation and stage-wise learning methods such as matching pursuit and boosting. It is known that the Power-Relaxed Greedy Algorithm with step sizes $m^{-\alpha}$ may fail to converge when…

Machine Learning · Computer Science 2026-03-10 Pablo M. Berná

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

This paper examines the ability of greedy algorithms to estimate a block sparse parameter vector from noisy measurements. In particular, block sparse versions of the orthogonal matching pursuit and thresholding algorithms are analyzed under…

Information Theory · Computer Science 2015-05-19 Zvika Ben-Haim , Yonina C. Eldar

The fields of signal and image processing have been deeply influenced by the introduction of deep neural networks. These are successfully deployed in a wide range of real-world applications, obtaining state of the art results and surpassing…

Machine Learning · Computer Science 2020-10-21 Rajaei Khatib , Dror Simon , Michael Elad

The paper gives a constructive method, based on greedy algorithms, that provides for the classes of functions with small mixed smoothness the best possible in the sense of order approximation error for the $m$-term approximation with…

Numerical Analysis · Mathematics 2015-03-03 V. N. Temlyakov

We define a family of weak thresholding greedy algorithms for the multivariate Haar basis for $L_1[0,1]^d$ ($d \ge 1$). We prove convergence and uniform boundedness of the weak greedy approximants for all $f \in L_1[0,1]^d$.

Functional Analysis · Mathematics 2012-09-07 S. J. Dilworth , S. Gogyan , Denka Kutzarova

Greedy algorithm are in widespread use for sparse recovery because of its efficiency. But some evident flaws exists in most popular greedy algorithms, such as CoSaMP, which includes unreasonable demands on prior knowledge of target signal…

Information Theory · Computer Science 2009-08-18 Hao Zhang , Gang Li , Huadong Meng

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh