English
Related papers

Related papers: Sharp Convergence Rates for Matching Pursuit

200 papers

It is a survey on recent results in constructive sparse approximation. Three directions are discussed here: (1) Lebesgue-type inequalities for greedy algorithms with respect to a special class of dictionaries, (2) constructive sparse…

Numerical Analysis · Mathematics 2015-11-06 Vladimir Temlyakov

We derive new results for the performance of a simple greedy algorithm for finding large independent sets and matchings in constant degree regular graphs. We show that for $r$-regular graphs with $n$ nodes and girth at least $g$, the…

Discrete Mathematics · Computer Science 2008-07-09 David Gamarnik , David Goldberg

In this paper we study the adaptivity of submodular maximization. Adaptivity quantifies the number of sequential rounds that an algorithm makes when function evaluations can be executed in parallel. Adaptivity is a fundamental concept that…

Data Structures and Algorithms · Computer Science 2018-04-18 Eric Balkanski , Aviad Rubinstein , Yaron Singer

Submodular function maximization finds application in a variety of real-world decision-making problems. However, most existing methods, based on greedy maximization, assume it is computationally feasible to evaluate F, the function being…

Artificial Intelligence · Computer Science 2020-08-11 Yash Satsangi , Shimon Whiteson , Frans A. Oliehoek

We investigate the performance of the standard Greedy algorithm for cardinality constrained maximization of non-submodular nondecreasing set functions. While there are strong theoretical guarantees on the performance of Greedy for…

Discrete Mathematics · Computer Science 2019-05-15 Andrew An Bian , Joachim M. Buhmann , Andreas Krause , Sebastian Tschiatschek

We study the problem of maximizing a non-negative monotone submodular objective $f$ subject to the intersection of $k$ arbitrary matroid constraints. The natural greedy algorithm guarantees $(k+1)$-approximation for this problem, and the…

Data Structures and Algorithms · Computer Science 2026-05-11 Moran Feldman , Justin Ward

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

This paper studies the maximum cardinality matching problem in stochastically evolving graphs. We formally define the arrival-departure model with stochastic departures. There, a graph is sampled from a specific probability distribution and…

Data Structures and Algorithms · Computer Science 2020-05-19 Eleni C. Akrida , Argyrios Deligkas , George B. Mertzios , Paul G. Spirakis , Viktor Zamaraev

In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor…

Functional Analysis · Mathematics 2012-10-26 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Let G be an edge-weighted hypergraph on n vertices, m edges of size \le s, where the edges have real weights in an interval [1,W]. We show that if we can approximate a maximum weight matching in G within factor alpha in time T(n,m,W) then…

Data Structures and Algorithms · Computer Science 2011-01-12 Andrzej Lingas , Cui Di

An important research thread in algorithmic game theory studies the design of efficient truthful mechanisms that approximate the optimal social welfare. A fundamental question is whether an \alpha-approximation algorithm translates into an…

Computer Science and Game Theory · Computer Science 2015-05-13 Chandra Chekuri , Iftah Gamzu

Hard Thresholding Pursuit (HTP) is an iterative greedy selection procedure for finding sparse solutions of underdetermined linear systems. This method has been shown to have strong theoretical guarantee and impressive numerical performance.…

Machine Learning · Computer Science 2013-11-26 Xiao-Tong Yuan , Ping Li , Tong Zhang

In this experimental study we consider Steiner tree approximations that guarantee a constant approximation of ratio smaller than $2$. The considered greedy algorithms and approaches based on linear programming involve the incorporation of…

Data Structures and Algorithms · Computer Science 2015-12-10 Stephan Beyer , Markus Chimani

Given a finite family of functions, the goal of model selection aggregation is to construct a procedure that mimics the function from this family that is the closest to an unknown regression function. More precisely, we consider a general…

Statistics Theory · Mathematics 2012-12-13 Dong Dai , Philippe Rigollet , Tong Zhang

In the Shortest Common Superstring problem, one needs to find the shortest superstring for a set of strings. This problem is APX-hard, and many approximation algorithms were proposed, with the current best approximation factor of 2.466.…

Data Structures and Algorithms · Computer Science 2024-07-31 Maksim Nikolaev

We implement and test the performances of several approximation algorithms for computing the minimum dominating set of a graph. These algorithms are the standard greedy algorithm, the recent LP rounding algorithms and a hybrid algorithm…

Data Structures and Algorithms · Computer Science 2020-09-11 Jonathan S. Li , Rohan Potru , Farhad Shahrokhi

A maximal $\varepsilon$-near perfect matching is a maximal matching which covers at least $(1-\varepsilon)|V(G)|$ vertices. In this paper, we study the number of maximal near perfect matchings in generalized quasirandom and dense graphs. We…

Combinatorics · Mathematics 2019-02-07 Yifan Jing , Akbar Rafiey

We study greedy-type algorithms such that at a greedy step we pick several dictionary elements contrary to a single dictionary element in standard greedy-type algorithms. We call such greedy algorithms {\it super greedy algorithms}. The…

Numerical Analysis · Mathematics 2010-10-27 Entao Liu , Vladimir N. Temlyakov

Finding the sparsest solution $\alpha$ for an under-determined linear system of equations $D\alpha=s$ is of interest in many applications. This problem is known to be NP-hard. Recent work studied conditions on the support size of $\alpha$…

Numerical Analysis · Computer Science 2010-04-27 Joseph Shtok , Michael Elad

We study parallel algorithms for the problem of maximizing a non-negative submodular function. Our main result is an algorithm that achieves a nearly-optimal $1/2 -\epsilon$ approximation using $O(\log(1/\epsilon) / \epsilon)$ parallel…

Data Structures and Algorithms · Computer Science 2018-12-05 Alina Ene , Huy L. Nguyen , Adrian Vladu