English
Related papers

Related papers: On Greedy Algorithms with bounded cumulative coher…

200 papers

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

Considering the set cover problem, by modifying the approach that gives a logarithmic approximation guarantee for the greedy algorithm, we obtain an estimation of the greedy algorithm's accuracy for a particular input. We compare the…

Data Structures and Algorithms · Computer Science 2019-02-13 Alexander Prolubnikov

The Kaczmarz method is an iterative algorithm for solving systems of linear equalities and inequalities, that iteratively projects onto these constraints. Recently, Strohmer and Vershynin [J. Fourier Anal. Appl., 15(2):262-278, 2009] gave a…

Numerical Analysis · Mathematics 2016-12-26 Julie Nutini , Behrooz Sepehry , Issam Laradji , Mark Schmidt , Hoyt Koepke , Alim Virani

Nearly three decades ago, Bar-Noy, Motwani and Naor showed that no online edge-coloring algorithm can edge color a graph optimally. Indeed, their work, titled "the greedy algorithm is optimal for on-line edge coloring", shows that the…

Data Structures and Algorithms · Computer Science 2021-05-17 Amin Saberi , David Wajc

We suggest a new greedy strategy for convex optimization in Banach spaces and prove its convergent rates under a suitable behavior of the modulus of uniform smoothness of the objective function.

Optimization and Control · Mathematics 2015-05-15 Zheming Gao , Guergana Petrova

We analyze the convergence of generalized kernel-based interpolation methods. This is done under minimalistic assumptions on both the kernel and the target function. On these grounds, we further prove convergence of popular greedy data…

Numerical Analysis · Mathematics 2024-11-26 Kristof Albrecht , Armin Iske

We study the fundamental limits of matching pursuit, or the pure greedy algorithm, for approximating a target function $ f $ by a linear combination $f_n$ of $n$ elements from a dictionary. When the target function is contained in the…

Machine Learning · Statistics 2024-07-24 Jason M. Klusowski , Jonathan W. Siegel

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is…

Numerical Analysis · Mathematics 2025-02-20 V. Temlyakov

This paper describes a simple greedy D-approximation algorithm for any covering problem whose objective function is submodular and non-decreasing, and whose feasible region can be expressed as the intersection of arbitrary (closed upwards)…

Data Structures and Algorithms · Computer Science 2015-06-02 Christos Koufogiannakis , Neal E. Young

Chebyshev Greedy Algorithm is a generalization of the well known Orthogonal Matching Pursuit defined in a Hilbert space to the case of Banach spaces. We apply this algorithm for constructing sparse approximate solutions (with respect to a…

Machine Learning · Statistics 2013-12-05 Vladimir Temlyakov

More precise estimation of the greedy algorithm complexity for a special case of the set cover problem is given in this paper.

Discrete Mathematics · Computer Science 2011-07-22 Hakob Aslanyan

Motivated by sequential budgeted allocation problems, we investigate online matching problems where connections between vertices are not i.i.d., but they have fixed degree distributions -- the so-called configuration model. We estimate the…

Data Structures and Algorithms · Computer Science 2021-07-05 Nathan Noiry , Flore Sentenac , Vianney Perchet

Kernel-based methods provide flexible and accurate algorithms for the reconstruction of functions from meshless samples. A major question in the use of such methods is the influence of the samples locations on the behavior of the…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Bernard Haasdonk

In this article we prove that the minimum-degree greedy algorithm, with adversarial tie-breaking, is a $(2/3)$-approximation for the Maximum Independent Set problem on interval graphs. We show that this is tight, even on unit interval…

Data Structures and Algorithms · Computer Science 2024-03-19 Steven Chaplick , Martin Frohn , Steven Kelk , Johann Lottermoser , Matus Mihalak

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been…

Numerical Analysis · Mathematics 2022-10-31 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

Orthogonal greedy learning (OGL) is a stepwise learning scheme that starts with selecting a new atom from a specified dictionary via the steepest gradient descent (SGD) and then builds the estimator through orthogonal projection. In this…

Machine Learning · Computer Science 2016-04-21 Lin Xu , Shaobo Lin , Jinshan Zeng , Xia Liu , Zongben Xu

Greedy algorithms which use only function evaluations are applied to convex optimization in a general Banach space $X$. Along with algorithms that use exact evaluations, algorithms with approximate evaluations are treated. A priori upper…

Machine Learning · Statistics 2014-01-03 R. A. DeVore , V. N. Temlyakov

A novel and detailed convergence analysis is presented for a greedy algorithm that was previously introduced for operator reconstruction problems in the field of quantum mechanics. This algorithm is based on an offline/online decomposition…

Optimization and Control · Mathematics 2020-11-02 S Buchwald , G Ciaramella , Julien Salomon

We investigate at decision trees that incorporate both traditional queries based on one attribute and queries based on hypotheses about the values of all attributes. Such decision trees are similar to ones studied in exact learning, where…

Computational Complexity · Computer Science 2022-03-18 Mohammad Azad , Igor Chikalov , Shahid Hussain , Mikhail Moshkov , Beata Zielosko

We derive new results for the performance of a simple greedy algorithm for finding large independent sets and matchings in constant degree regular graphs. We show that for $r$-regular graphs with $n$ nodes and girth at least $g$, the…

Discrete Mathematics · Computer Science 2008-07-09 David Gamarnik , David Goldberg