English
Related papers

Related papers: Non-Smooth, H\"older-Smooth, and Robust Submodular…

200 papers

We consider two classic problems: maximum coverage and monotone submodular maximization subject to a cardinality constraint. [Nemhauser--Wolsey--Fisher '78] proved that the greedy algorithm provides an approximation of $1-1/e$ for both…

Data Structures and Algorithms · Computer Science 2025-03-26 Yuval Filmus , Roy Schwartz , Alexander V. Smal

Monotone submodular maximization with a knapsack constraint is NP-hard. Various approximation algorithms have been devised to address this optimization problem. In this paper, we revisit the widely known modified greedy algorithm. First, we…

Data Structures and Algorithms · Computer Science 2021-01-14 Jing Tang , Xueyan Tang , Andrew Lim , Kai Han , Chongshou Li , Junsong Yuan

Many problems in signal processing and machine learning can be formalized as weak submodular optimization tasks. For such problems, a simple greedy algorithm (\textsc{Greedy}) is guaranteed to find a solution achieving the objective with a…

Discrete Mathematics · Computer Science 2021-11-24 Abolfazl Hashemi , Haris Vikalo , Gustavo de Veciana

It has been well established that first order optimization methods can converge to the maximal objective value of concave functions and provide constant factor approximation guarantees for (non-convex/non-concave) continuous submodular…

Optimization and Control · Mathematics 2021-06-10 Siddharth Mitra , Moran Feldman , Amin Karbasi

In this paper, we study the problem of monotone (weakly) DR-submodular continuous maximization. While previous methods require the gradient information of the objective function, we propose a derivative-free algorithm LDGM for the first…

Machine Learning · Computer Science 2019-02-26 Yibo Zhang , Chao Qian , Ke Tang

We provide improved convergence rates for constrained convex-concave min-max problems and monotone variational inequalities with higher-order smoothness. In min-max settings where the $p^{th}$-order derivatives are Lipschitz continuous, we…

Optimization and Control · Mathematics 2020-07-10 Brian Bullins , Kevin A. Lai

It is known that greedy methods perform well for maximizing monotone submodular functions. At the same time, such methods perform poorly in the face of non-monotonicity. In this paper, we show - arguably, surprisingly - that invoking the…

Machine Learning · Computer Science 2017-04-07 Moran Feldman , Christopher Harshaw , Amin Karbasi

In this paper, we study the problem of \textit{constrained} and \textit{stochastic} continuous submodular maximization. Even though the objective function is not concave (nor convex) and is defined in terms of an expectation, we develop a…

Optimization and Control · Mathematics 2017-11-07 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

In this paper, we present a thorough study of maximizing a regularized non-monotone submodular function subject to various constraints, i.e., $\max \{ g(A) - \ell(A) : A \in \mathcal{F} \}$, where $g \colon 2^\Omega \to \mathbb{R}_+$ is a…

Data Structures and Algorithms · Computer Science 2021-03-19 Cheng Lu , Wenguo Yang , Suixiang Gao

In this work, we consider the distributed optimization of non-smooth convex functions using a network of computing units. We investigate this problem under two regularity assumptions: (1) the Lipschitz continuity of the global objective…

Optimization and Control · Mathematics 2018-06-04 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

We study the problem of maximizing a non-negative monotone submodular objective $f$ subject to the intersection of $k$ arbitrary matroid constraints. The natural greedy algorithm guarantees $(k+1)$-approximation for this problem, and the…

Data Structures and Algorithms · Computer Science 2026-05-11 Moran Feldman , Justin Ward

Subset selection, which aims to select a subset from a ground set to maximize some objective function, arises in various applications such as influence maximization and sensor placement. In real-world scenarios, however, one often needs to…

Neural and Evolutionary Computing · Computer Science 2022-05-10 Chao Bian , Yawen Zhou , Chao Qian

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong

The problem of objectively choosing a string of actions to optimize an objective function that is string submodular has been considered in [1]. There it is shown that the greedy strategy, consisting of a string of actions that only locally…

Data Structures and Algorithms · Computer Science 2016-11-17 Zhenliang Zhang , Edwin K. P. Chong , Ali Pezeshki , William Moran

We design new approximation algorithms for the problems of optimizing submodular and supermodular functions subject to a single matroid constraint. Specifically, we consider the case in which we wish to maximize a nondecreasing submodular…

Data Structures and Algorithms · Computer Science 2014-12-15 Maxim Sviridenko , Jan Vondrák , Justin Ward

Randomized smoothing is a widely adopted technique for optimizing nonsmooth objective functions. However, its efficiency analysis typically relies on global Lipschitz continuity, a condition rarely met in practical applications. To address…

Optimization and Control · Mathematics 2025-09-10 Jingfan Xia , Zhenwei Lin , Qi Deng

We demonstrate that from an algorithm guaranteeing an approximation factor for the ratio of submodular (RS) optimization problem, we can build another algorithm having a different kind of approximation guarantee -- weaker than the classical…

Data Structures and Algorithms · Computer Science 2022-09-12 Pierre Perrault , Jennifer Healey , Zheng Wen , Michal Valko

Many algorithms for maximizing a monotone submodular function subject to a knapsack constraint rely on the natural greedy heuristic. We present a novel refined analysis of this greedy heuristic which enables us to: $(1)$ reduce the…

Data Structures and Algorithms · Computer Science 2021-03-16 Ariel Kulik , Roy Schwartz , Hadas Shachnai

We study the problem of maximizing a monotone submodular function subject to a cardinality constraint $k$, with the added twist that a number of items $\tau$ from the returned set may be removed. We focus on the worst-case setting…

Machine Learning · Statistics 2017-06-16 Ilija Bogunovic , Slobodan Mitrović , Jonathan Scarlett , Volkan Cevher

We study the classical problem of maximizing a monotone submodular function subject to a cardinality constraint k, with two additional twists: (i) elements arrive in a streaming fashion, and (ii) m items from the algorithm's memory are…

Data Structures and Algorithms · Computer Science 2017-11-27 Slobodan Mitrović , Ilija Bogunovic , Ashkan Norouzi-Fard , Jakub Tarnawski , Volkan Cevher