English
Related papers

Related papers: An Exponential Speedup in Parallel Running Time fo…

200 papers

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, the objective function…

Machine Learning · Computer Science 2022-03-10 Marwa El Halabi , Stefanie Jegelka

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a difference between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Data Structures and Algorithms · Computer Science 2013-08-27 Rishabh Iyer , Jeff Bilmes

We consider fast algorithms for monotone submodular maximization with a general matroid constraint. We present a randomized $(1 - 1/e - \epsilon)$-approximation algorithm that requires $\tilde{O}_{\epsilon}(\sqrt{r} n)$ independence oracle…

Data Structures and Algorithms · Computer Science 2024-05-02 Yusuke Kobayashi , Tatsuya Terao

We consider the problem of monotone, submodular maximization over a ground set of size $n$ subject to cardinality constraint $k$. For this problem, we introduce the first deterministic algorithms with linear time complexity; these…

Data Structures and Algorithms · Computer Science 2021-03-09 Alan Kuhnle

We generalize the monotone local search approach of Fomin, Gaspers, Lokshtanov and Saurabh [J. ACM 2019], by establishing a connection between parameterized approximation and exponential-time approximation algorithms for monotone subset…

Data Structures and Algorithms · Computer Science 2026-01-13 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

We consider fairness in submodular maximization subject to a knapsack constraint, a fundamental problem with various applications in economics, machine learning, and data mining. In the model, we are given a set of ground elements, each…

Data Structures and Algorithms · Computer Science 2025-05-20 Lijun Li , Chenyang Xu , Liuyi Yang , Ruilong Zhang

The standard greedy algorithm has been recently shown to enjoy approximation guarantees for constrained non-submodular nondecreasing set function maximization. While these recent results allow to better characterize the empirical success of…

Social and Information Networks · Computer Science 2019-10-09 Khashayar Gatmiry , Manuel Gomez-Rodriguez

We give sublinear-time approximation algorithms for some optimization problems arising in machine learning, such as training linear classifiers and finding minimum enclosing balls. Our algorithms can be extended to some kernelized versions…

Machine Learning · Computer Science 2010-10-22 Kenneth L. Clarkson , Elad Hazan , David P. Woodruff

Submodular functions describe a variety of discrete problems in machine learning, signal processing, and computer vision. However, minimizing submodular functions poses a number of algorithmic challenges. Recent work introduced an…

Optimization and Control · Mathematics 2014-11-06 Robert Nishihara , Stefanie Jegelka , Michael I. Jordan

In this paper, we consider the problem of scheduling an application on a parallel computational platform. The application is a particular task graph, either a linear chain of tasks, or a set of independent tasks. The platform is made of…

Data Structures and Algorithms · Computer Science 2012-10-18 Guillaume Aupy , Anne Benoit

We propose a new concept named adaptive submodularity ratio to study the greedy policy for sequential decision making. While the greedy policy is known to perform well for a wide variety of adaptive stochastic optimization problems in…

Machine Learning · Computer Science 2019-04-25 Kaito Fujii , Shinsaku Sakaue

In this paper, we propose scalable methods for maximizing a regularized submodular function $f = g - \ell$ expressed as the difference between a monotone submodular function $g$ and a modular function $\ell$. Indeed, submodularity is…

Machine Learning · Computer Science 2020-02-11 Ehsan Kazemi , Shervin Minaee , Moran Feldman , Amin Karbasi

Submodular optimization with bandit feedback has recently been studied in a variety of contexts. In a number of real-world applications such as diversified recommender systems and data summarization, the submodular function exhibits…

Machine Learning · Computer Science 2024-07-04 Wenjing Chen , Victoria G. Crawford

Submodular maximization is one of the central topics in combinatorial optimization. It has found numerous applications in the real world. Streaming algorithms for submodule maximization have gained attention in recent years, allowing for…

Data Structures and Algorithms · Computer Science 2023-11-08 Xiaoming Sun , Jialin Zhang , Shuo Zhang

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

Maximizing submodular functions has been increasingly used in many applications of machine learning, such as data summarization, recommendation systems, and feature selection. Moreover, there has been a growing interest in both submodular…

Data Structures and Algorithms · Computer Science 2023-11-08 Kiarash Banihashem , Leyla Biabani , Samira Goudarzi , MohammadTaghi Hajiaghayi , Peyman Jabbarzade , Morteza Monemizadeh

In this work we give two new algorithms that use similar techniques for (non-monotone) submodular function maximization subject to a cardinality constraint. The first is an offline fixed parameter tractable algorithm that guarantees a…

Data Structures and Algorithms · Computer Science 2022-04-26 Aviad Rubinstein , Junyao Zhao

Streaming algorithms are generally judged by the quality of their solution, memory footprint, and computational complexity. In this paper, we study the problem of maximizing a monotone submodular function in the streaming setting with a…

Machine Learning · Computer Science 2019-05-14 Ehsan Kazemi , Marko Mitrovic , Morteza Zadimoghaddam , Silvio Lattanzi , Amin Karbasi

We study dynamic algorithms for the problem of maximizing a monotone submodular function over a stream of $n$ insertions and deletions. We show that any algorithm that maintains a $(0.5+\epsilon)$-approximate solution under a cardinality…

Data Structures and Algorithms · Computer Science 2022-04-19 Xi Chen , Binghui Peng

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn