English
Related papers

Related papers: Improved Lower Bounds for Submodular Function Mini…

200 papers

In this work, we study the classical problem of maximizing a submodular function subject to a matroid constraint. We develop deterministic algorithms that are very parsimonious with respect to querying the submodular function, for both the…

Data Structures and Algorithms · Computer Science 2024-08-29 Eric Balkanski , Steven DiSilvio , Alan Kuhnle , ChunLi Peng

We present a new class of polynomial-time algorithms for submodular function minimization (SFM), as well as a unified framework to obtain strongly polynomial SFM algorithms. Our algorithms are based on simple iterative methods for the…

Optimization and Control · Mathematics 2020-02-14 Daniel Dadush , László A. Végh , Giacomo Zambelli

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Submodular function maximization has found a wealth of new applications in machine learning models during the past years. The related supermodular maximization models (submodular minimization) also offer an abundance of applications, but…

Data Structures and Algorithms · Computer Science 2020-06-25 Mehrdad Ghadiri , Richard Santiago , Bruce Shepherd

This paper studies the lower bound complexity for the optimization problem whose objective function is the average of $n$ individual smooth convex functions. We consider the algorithm which gets access to gradient and proximal oracle for…

Optimization and Control · Mathematics 2019-08-23 Guangzeng Xie , Luo Luo , Zhihua Zhang

Submodular functions describe a variety of discrete problems in machine learning, signal processing, and computer vision. However, minimizing submodular functions poses a number of algorithmic challenges. Recent work introduced an…

Optimization and Control · Mathematics 2014-11-06 Robert Nishihara , Stefanie Jegelka , Michael I. Jordan

We introduce the following submodular generalization of the Shortest Cycle problem. For a nonnegative monotone submodular cost function $f$ defined on the edges (or the vertices) of an undirected graph $G$, we seek for a cycle $C$ in $G$ of…

Data Structures and Algorithms · Computer Science 2022-11-10 Fedor V. Fomin , Petr A. Golovach , Tuukka Korhonen , Daniel Lokshtanov , Giannos Stamoulis

We develop a new technique for proving cell-probe lower bounds on dynamic data structures. This technique enables us to prove an amortized randomized Omega(lg n) lower bound per operation for several data structural problems on n elements,…

Data Structures and Algorithms · Computer Science 2007-05-23 Mihai Patrascu , Erik D. Demaine

In large-data applications, it is desirable to design algorithms with a high degree of parallelization. In the context of submodular optimization, adaptive complexity has become a widely-used measure of an algorithm's "sequentiality".…

Data Structures and Algorithms · Computer Science 2020-04-22 Wenzheng Li , Paul Liu , Jan Vondrak

In the past few years, a successful line of research has lead to lower bounds for several fundamental local graph problems in the distributed setting. These results were obtained via a technique called round elimination. On a high level,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-29 Alkida Balliu , Sebastian Brandt , Fabian Kuhn , Dennis Olivetti , Joonatan Saarhelo

Two seemingly unrelated problems, scheduling a multiclass queueing system and minimizing a submodular function, share a rather deep connection via the polymatroid that is characterized by a submodular set function on the one hand and…

Optimization and Control · Mathematics 2008-05-09 Yingdong Lu , David Yao

Given a posimodular function $f: 2^V \to \mathbb{R}$ on a finite set $V$, we consider the problem of finding a nonempty subset $X$ of $V$ that minimizes $f(X)$. Posimodular functions often arise in combinatorial optimization such as…

Data Structures and Algorithms · Computer Science 2014-10-23 Toshimasa Ishii , Kazuhisa Makino

Very recently, Khoury and Schild [FOCS 2025] showed that any randomized LOCAL algorithm that solves maximal matching requires $\Omega(\min\{\log \Delta, \log_\Delta n\})$ rounds, where $n$ is the number of nodes in the graph and $\Delta$ is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Alkida Balliu , Filippo Casagrande , Francesco d'Amore , Dennis Olivetti

We consider maximization of stochastic monotone continuous submodular functions (CSF) with a diminishing return property. Existing algorithms only guarantee the performance \textit{in expectation}, and do not bound the probability of…

Data Structures and Algorithms · Computer Science 2023-03-22 Evan Becker , Jingdong Gao , Ted Zadouri , Baharan Mirzasoleiman

This paper presents a lower bound for optimizing a finite sum of $n$ functions, where each function is $L$-smooth and the sum is $\mu$-strongly convex. We show that no algorithm can reach an error $\epsilon$ in minimizing all functions from…

Machine Learning · Statistics 2015-10-06 Alekh Agarwal , Leon Bottou

Many recent studies on first-order methods (FOMs) focus on \emph{composite non-convex non-smooth} optimization with linear and/or nonlinear function constraints. Upper (or worst-case) complexity bounds have been established for these…

Optimization and Control · Mathematics 2025-05-14 Wei Liu , Qihang Lin , Yangyang Xu

Submodular function minimization is a key problem in a wide variety of applications in machine learning, economics, game theory, computer vision, and many others. The general solver has a complexity of $O(n^3 \log^2 n . E +n^4 {\log}^{O(1)}…

Data Structures and Algorithms · Computer Science 2017-01-25 Srikumar Ramalingam , Chris Russell , Lubor Ladicky , Philip H. S. Torr

Symmetric submodular functions are an important family of submodular functions capturing many interesting cases including cut functions of graphs and hypergraphs. Maximization of such functions subject to various constraints receives little…

Data Structures and Algorithms · Computer Science 2016-04-19 Moran Feldman

We define a new class of set functions that in addition to being monotone and subadditive, also admit a very limited form of submodularity defined over a permutation of the ground set. We refer to this permutation as a submodular order.…

Optimization and Control · Mathematics 2024-03-01 Rajan Udwani

For the problem of maximizing a monotone, submodular function with respect to a cardinality constraint $k$ on a ground set of size $n$, we provide an algorithm that achieves the state-of-the-art in both its empirical performance and its…

Data Structures and Algorithms · Computer Science 2024-08-20 Yixin Chen , Tonmoy Dey , Alan Kuhnle