English
Related papers

Related papers: Performance guarantees of forward and reverse gree…

200 papers

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

MapReduce has become the de facto standard model for designing distributed algorithms to process big data on a cluster. There has been considerable research on designing efficient MapReduce algorithms for clustering, graph optimization, and…

Data Structures and Algorithms · Computer Science 2018-06-19 Nicholas J. A. Harvey , Christopher Liaw , Paul Liu

We study mechanisms that use greedy allocation rules and pay-your-bid pricing to allocate resources subject to a matroid constraint. We show that all such mechanisms obtain a constant fraction of the optimal welfare at any equilibrium of…

Computer Science and Game Theory · Computer Science 2015-03-20 Brendan Lucier , Vasilis Syrgkanis

We consider classes of objective functions of cardinality constrained maximization problems for which the greedy algorithm guarantees a constant approximation. We propose the new class of $\gamma$-$\alpha$-augmentable functions and prove…

Discrete Mathematics · Computer Science 2022-10-05 Yann Disser , David Weckbecker

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

We study the problem of maximizing a non-monotone, non-negative submodular function subject to a matroid constraint. The prior best-known deterministic approximation ratio for this problem is $\frac{1}{4}-\epsilon$ under…

Data Structures and Algorithms · Computer Science 2020-10-23 Kai Han , Zongmai Cao , Shuang Cui , Benwei Wu

When developing robust preconditioners for multiphysics problems, fractional functions of the Laplace operator often arise and need to be inverted. Rational approximation in the uniform norm can be used to convert inverting those fractional…

Numerical Analysis · Mathematics 2024-07-23 James H. Adler , Xiaozhe Hu , Xue Wang , Zhongqin Xue

Machine learning algorithms typically rely on optimization subroutines and are well-known to provide very effective outcomes for many types of problems. Here, we flip the reliance and ask the reverse question: can machine learning…

Machine Learning · Computer Science 2019-07-30 Jesus A. De Loera , Jamie Haddock , Anna Ma , Deanna Needell

We investigate two greedy strategies for finding an approximation to the minimum of a convex function $E$ defined on a Hilbert space $H$. We prove convergence rates for these algorithms under suitable conditions on the objective function…

Numerical Analysis · Mathematics 2014-01-09 Hao Nguyen , Guergana Petrova

An important problem in computational topology is to calculate the homology of a space from samples. In this work, we develop a statistical approach to this problem by calculating the expected rank of an induced map on homology from a…

Computation · Statistics 2023-08-04 Tianyi Sun , Bradley Nelson

Optimal transport (OT) distances are finding evermore applications in machine learning and computer vision, but their wide spread use in larger-scale problems is impeded by their high computational cost. In this work we develop a family of…

Machine Learning · Statistics 2018-03-06 Brahim Khalil Abid , Robert M. Gower

We empirically analyze a simple heuristic for large sparse set cover problems. It uses the weighted greedy algorithm as a basic building block. By multiplicative updates of the weights attached to the elements, the greedy solution is…

Data Structures and Algorithms · Computer Science 2020-10-30 Marc Alexa

In this work, we consider robust submodular maximization with matroid constraints. We give an efficient bi-criteria approximation algorithm that outputs a small family of feasible sets whose union has (nearly) optimal objective value. This…

Data Structures and Algorithms · Computer Science 2018-07-26 Sebastian Pokutta , Mohit Singh , Alfredo Torrico

Greedy optimization methods such as Matching Pursuit (MP) and Frank-Wolfe (FW) algorithms regained popularity in recent years due to their simplicity, effectiveness and theoretical guarantees. MP and FW address optimization over the linear…

Machine Learning · Computer Science 2017-11-21 Francesco Locatello , Michael Tschannen , Gunnar Rätsch , Martin Jaggi

Many robotic systems deal with uncertainty by performing a sequence of information gathering actions. In this work, we focus on the problem of efficiently constructing such a sequence by drawing an explicit connection to submodularity.…

We study the $k$-Submodular Cover ($kSC$) problem, a natural generalization of the classical Submodular Cover problem that arises in artificial intelligence and combinatorial optimization tasks such as influence maximization, resource…

Data Structures and Algorithms · Computer Science 2025-11-04 Hue T. Nguyen , Tan D. Tran , Nguyen Long Giang , Canh V. Pham

The concept of jump system, introduced by Bouchet and Cunningham (1995), is a set of integer points satisfying a certain exchange property. We consider the minimization of a separable convex function on a jump system. It is known that the…

Optimization and Control · Mathematics 2022-06-22 Norito Minamikawa

We address the problem of efficient and unobstructed surveillance or communication in complex environments. On one hand, one wishes to use a minimal number of sensors to cover the environment. On the other hand, it is often important to…

Machine Learning · Computer Science 2023-09-18 Lukas Taus , Yen-Hsi Richard Tsai

We investigate two new optimization problems -- minimizing a submodular function subject to a submodular lower bound constraint (submodular cover) and maximizing a submodular function subject to a submodular upper bound constraint…

Data Structures and Algorithms · Computer Science 2013-11-12 Rishabh Iyer , Jeff Bilmes

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is…

Numerical Analysis · Mathematics 2025-02-20 V. Temlyakov