English
Related papers

Related papers: A unified way of analyzing some greedy algorithms

200 papers

The "classical" (weak) greedy algorithm is widely used within model order reduction in order to compute a reduced basis in the offline training phase: An a posteriori error estimator is maximized and the snapshot corresponding to the…

Numerical Analysis · Mathematics 2026-05-27 Niklas Reich , Karsten Urban , Jürgen Vorloeper

Recently, it has been discovered that results on universal sampling discretization of the square norm are useful in sparse sampling recovery with error being measured in the square norm. It was established that a simple greedy type…

Numerical Analysis · Mathematics 2023-07-11 F. Dai , V. Temlyakov

A novel and detailed convergence analysis is presented for a greedy algorithm that was previously introduced for operator reconstruction problems in the field of quantum mechanics. This algorithm is based on an offline/online decomposition…

Optimization and Control · Mathematics 2020-11-02 S Buchwald , G Ciaramella , Julien Salomon

We establish estimates for the Lebesgue parameters of the Chebyshev Weak Thresholding Greedy Algorithm in the case of general bases in Banach spaces. These generalize and slightly improve earlier results in [9], and are complemented with…

Functional Analysis · Mathematics 2018-11-13 Pablo M. Berná , Oscar Blasco , Gustavo Garrigós , Eugenio Hernández , Timur Oikhberg

Given a Banach space X and one of its compact sets F, we consider the problem of finding a good n dimensional space X_n \subset X which can be used to approximate the elements of F. The best possible error we can achieve for such an…

Functional Analysis · Mathematics 2012-04-12 Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

We study sparse approximate solutions to convex optimization problems. It is known that in many engineering applications researchers are interested in an approximate solution of an optimization problem as a linear combination of elements…

Machine Learning · Statistics 2012-06-05 V. N. Temlyakov

We present some new results concerning Lebesgue-type inequalities for the Weak Chebyshev Greedy Algorithm (WCGA) in uniformly smooth Banach spaces $\mathbb{X}$. First, we generalize a result of Temlyakov to cover situations in which the…

Functional Analysis · Mathematics 2022-09-13 Gustavo Garrigós

For the past 25 years, one of the most studied algorithms in the field of Nonlinear Approximation Theory has been the Thresholding Greedy Algorithm. In this paper, we propose new summability methods for this algorithm, generating two new…

Functional Analysis · Mathematics 2025-05-02 Miguel Berasategui , Pablo M. Berná , Stephen J. Dilworth , Denka Kutzarova

We prove some results on the rate of convergence of greedy algorithms, which provide expansions. We consider both the case of Hilbert spaces and the more general case of Banach spaces. The new ingredient of the paper is that we bound the…

Numerical Analysis · Mathematics 2023-04-14 V. N. Temlyakov

We present various estimates for the Lebesgue constants of the thresholding greedy algorithm, in the case of general bases in Banach spaces. We show the optimality of these estimates in some situations. Our results recover and slightly…

Functional Analysis · Mathematics 2016-06-22 Pablo M. Berná , Gustavo Garrigós , Óscar Blasco

Garling sequence spaces admit a renorming with respect to which their standard unit vector basis is 1-greedy. We also discuss some additional properties of these Banach spaces related to uniform convexity and superreflexivity. In…

Functional Analysis · Mathematics 2017-05-12 Fernado Albiac , José L. Ansorena , Ben Wallis

The aim of this article is to use Banach lattice techniques to study coordinate systems in function spaces. We begin by proving that the greedy algorithm of a basis is order convergent if and only if a certain maximal inequality is…

Functional Analysis · Mathematics 2026-01-06 Pablo Berná , Daniel Freeman , Timur Oikhberg , Mitchell Taylor

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

We study greedy-type algorithms such that at a greedy step we pick several dictionary elements contrary to a single dictionary element in standard greedy-type algorithms. We call such greedy algorithms {\it super greedy algorithms}. The…

Numerical Analysis · Mathematics 2010-10-27 Entao Liu , Vladimir N. Temlyakov

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

We present new results regarding Lebesgue-type inequalities for the Weak Chebyshev Greedy Algorithm (WCGA) in uniformly smooth Banach spaces. We improve earlier bounds in Temlyakov (Forum Math Sigma 2014), for dictionaries satisfying a new…

Functional Analysis · Mathematics 2019-10-01 Stephen Dilworth , Gustavo Garrigos , Eugenio Hernandez , Denka Kutzarova , Vladimir Temlyakov

Greedy bases are those bases where the Thresholding Greedy Algorithm (introduced by S. V. Konyagin and V. N. Temlyakov) produces the best possible approximation up to a constant. In 2017, Bern\'a and Blasco gave a characterization of these…

Functional Analysis · Mathematics 2023-11-21 Miguel Berasategui , Pablo M. Berná , David González

In this effort we introduce and analyze a novel reduced basis approach, used to construct an approximating subspace for a given set of data. Our technique, which we call the Natural Greedy Algorithm (NGA), is based on a recursive approach…

Functional Analysis · Mathematics 2019-11-05 Anton Dereventsov , Clayton Webster

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson