English
Related papers

Related papers: Differentiable Greedy Submodular Maximization: Gua…

200 papers

Constrained maximization of submodular functions poses a central problem in combinatorial optimization. In many realistic scenarios, a number of agents need to maximize multiple submodular objectives over the same ground set. We study such…

Data Structures and Algorithms · Computer Science 2024-07-22 Georgios Amanatidis , Georgios Birmpas , Philip Lazos , Stefano Leonardi , Rebecca Reiffenhäuser

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban

Submodular functions -- functions exhibiting diminishing returns -- are central to machine learning. When the objective is monotone and non-negative, the greedy algorithm achieves a tight $63\%$ approximation. But many practical objectives…

Machine Learning · Computer Science 2026-05-11 Yixin Chen , Alan Kuhnle

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson

A $k$-submodular function naturally generalizes submodular functions by taking as input $k$ disjoint subsets, rather than a single subset. Unlike standard submodular maximization, which only requires selecting elements for the solution,…

Data Structures and Algorithms · Computer Science 2025-07-18 Chenhao Wang

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

In this paper, we study the non-monotone adaptive submodular maximization problem subject to a cardinality constraint. We first revisit the adaptive random greedy algorithm proposed in \citep{gotovos2015non}, where they show that this…

Machine Learning · Computer Science 2020-12-16 Shaojie Tang

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

We propose a new concept named adaptive submodularity ratio to study the greedy policy for sequential decision making. While the greedy policy is known to perform well for a wide variety of adaptive stochastic optimization problems in…

Machine Learning · Computer Science 2019-04-25 Kaito Fujii , Shinsaku Sakaue

Many algorithms for maximizing a monotone submodular function subject to a knapsack constraint rely on the natural greedy heuristic. We present a novel refined analysis of this greedy heuristic which enables us to: $(1)$ reduce the…

Data Structures and Algorithms · Computer Science 2021-03-16 Ariel Kulik , Roy Schwartz , Hadas Shachnai

Submodularity is a key property in discrete optimization. Submodularity has been widely used for analyzing the greedy algorithm to give performance bounds and providing insight into the construction of valid inequalities for mixed-integer…

Optimization and Control · Mathematics 2022-05-24 Temitayo Ajayi , Taewoo Lee , Andrew Schaefer

We demonstrate that from an algorithm guaranteeing an approximation factor for the ratio of submodular (RS) optimization problem, we can build another algorithm having a different kind of approximation guarantee -- weaker than the classical…

Data Structures and Algorithms · Computer Science 2022-09-12 Pierre Perrault , Jennifer Healey , Zheng Wen , Michal Valko

In this work, we consider the maximization of submodular functions constrained by independence systems. Because of the wide applicability of submodular functions, this problem has been extensively studied in the literature, on specialized…

Data Structures and Algorithms · Computer Science 2019-06-11 Alan Kuhnle

We study submodular maximization problems with matroid constraints, in particular, problems where the objective can be expressed via compositions of analytic and multilinear functions. We show that for functions of this form, the so-called…

Machine Learning · Computer Science 2024-12-17 Gözde Özcan , Armin Moharrer , Stratis Ioannidis

Submodular function maximization finds application in a variety of real-world decision-making problems. However, most existing methods, based on greedy maximization, assume it is computationally feasible to evaluate F, the function being…

Artificial Intelligence · Computer Science 2020-08-11 Yash Satsangi , Shimon Whiteson , Frans A. Oliehoek

In machine learning and big data, the optimization objectives based on set-cover, entropy, diversity, influence, feature selection, etc. are commonly modeled as submodular functions. Submodular (function) maximization is generally NP-hard,…

Data Structures and Algorithms · Computer Science 2022-12-13 Haotian Zhang , Rao Li , Zewei Wu , Guodong Sun

We study the problem of maximizing constrained non-monotone submodular functions and provide approximation algorithms that improve existing algorithms in terms of either the approximation factor or simplicity. Our algorithms combine…

Data Structures and Algorithms · Computer Science 2016-03-01 Salman Fadaei , MohammadAmin Fazli , MohammadAli Safari

While greedy algorithms have long been observed to perform well on a wide variety of problems, up to now approximation ratios have only been known for their application to problems having submodular objective functions $f$. Since many…

Data Structures and Algorithms · Computer Science 2018-01-16 J. David Smith , My T. Thai