English
Related papers

Related papers: Near-optimal Approximate Discrete and Continuous S…

200 papers

We consider the global minimization of smooth functions based solely on function evaluations. Algorithms that achieve the optimal number of function evaluations for a given precision level typically rely on explicitly constructing an…

Optimization and Control · Mathematics 2020-12-23 Alessandro Rudi , Ulysse Marteau-Ferey , Francis Bach

We study the recently introduced idea of worst-case sensitivity for monotone submodular maximization with cardinality constraint $k$, which captures the degree to which the output argument changes on deletion of an element in the input. We…

Data Structures and Algorithms · Computer Science 2020-10-12 Conor McMeel , Yuichi Yoshida

We consider the problem of minimizing a convex function over a convex set given access only to an evaluation oracle for the function and a membership oracle for the set. We give a simple algorithm which solves this problem with…

Data Structures and Algorithms · Computer Science 2017-06-23 Yin Tat Lee , Aaron Sidford , Santosh S. Vempala

A $k$-submodular function is an extension of a submodular function in that its input is given by $k$ disjoint subsets instead of a single subset. For unconstrained nonnegative $k$-submodular maximization, Ward and \v{Z}ivn\'y proposed a…

Data Structures and Algorithms · Computer Science 2016-08-23 Shinsaku Sakaue

We present a variant of accelerated gradient descent algorithms, adapted from Nesterov's optimal first-order methods, for weakly-quasi-convex and weakly-quasi-strongly-convex functions. We show that by tweaking the so-called estimate…

Optimization and Control · Mathematics 2020-06-16 Jingjing Bu , Mehran Mesbahi

We study dynamic $(1-\epsilon)$-approximate rounding of fractional matchings -- a key ingredient in numerous breakthroughs in the dynamic graph algorithms literature. Our first contribution is a surprisingly simple deterministic rounding…

Data Structures and Algorithms · Computer Science 2024-02-26 Sayan Bhattacharya , Peter Kiss , Aaron Sidford , David Wajc

We consider the problem of minimizing a smooth, Lipschitz, convex function over a compact, convex set using sub-zeroth-order oracles: an oracle that outputs the sign of the directional derivative for a given point and a given direction, an…

Optimization and Control · Mathematics 2021-03-02 Mustafa O. Karabag , Cyrus Neary , Ufuk Topcu

Maximizing monotone submodular functions under a matroid constraint is a classic algorithmic problem with multiple applications in data mining and machine learning. We study this classic problem in the fully dynamic setting, where elements…

Data Structures and Algorithms · Computer Science 2025-05-26 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Maximization of {\it non-submodular} functions appears in various scenarios, and many previous works studied it based on some measures that quantify the closeness to being submodular. On the other hand, many practical non-submodular…

Data Structures and Algorithms · Computer Science 2019-10-04 Shinsaku Sakaue

Maximizing a non-negative, monontone, submodular function $f$ over $n$ elements under a cardinality constraint $k$ (SMCC) is a well-studied NP-hard problem. It has important applications in, e.g., machine learning and influence…

Data Structures and Algorithms · Computer Science 2024-02-05 Philip Cervenjak , Junhao Gan , Anthony Wirth

In the matroid secretary problem, the elements of a matroid $\mathcal{M}$ arrive in random order. Once we observe an item we need to irrevocably decide whether or not to accept it. The set of selected elements should form an independent set…

Data Structures and Algorithms · Computer Science 2020-01-06 Mohammad Shadravan

Submodularity is a discrete domain functional property that can be interpreted as mimicking the role of the well-known convexity/concavity properties in the continuous domain. Submodular functions exhibit strong structure that lead to…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Ehsan Tohidi , Rouhollah Amiri , Mario Coutino , David Gesbert , Geert Leus , Amin Karbasi

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the…

Machine Learning · Computer Science 2016-02-24 Francis Bach

Submodular maximization is one of the central topics in combinatorial optimization. It has found numerous applications in the real world. In the past decades, a series of algorithms have been proposed for this problem. However, most of the…

Data Structures and Algorithms · Computer Science 2023-04-03 Xiaoming Sun , Jialin Zhang , Shuo Zhang , Zhijie Zhang

Omnipredictors are simple prediction functions that encode loss-minimizing predictions with respect to a hypothesis class $H$, simultaneously for every loss function within a class of losses $L$. In this work, we give near-optimal learning…

Machine Learning · Statistics 2025-12-17 Princewill Okoroafor , Robert Kleinberg , Michael P. Kim

Frequently, when dealing with many machine learning models, optimization problems appear to be challenging due to a limited understanding of the constructions and characterizations of the objective functions in these problems. Therefore,…

Optimization and Control · Mathematics 2024-11-27 A. V. Gasnikov , M. S. Alkousa , A. V. Lobanov , Y. V. Dorn , F. S. Stonyakin , I. A. Kuruzov , S. R. Singh

Submodular functions are discrete functions that model laws of diminishing returns and enjoy numerous algorithmic applications. They have been used in many areas, including combinatorial optimization, machine learning, and economics. In…

Data Structures and Algorithms · Computer Science 2012-08-24 Maria-Florina Balcan , Nicholas J. A. Harvey

In this paper we develop the first algorithms for online submodular minimization that preserve differential privacy under full information feedback and bandit feedback. A sequence of $T$ submodular functions over a collection of $n$…

Data Structures and Algorithms · Computer Science 2018-07-09 Adrian Rivera Cardoso , Rachel Cummings

This paper presents a unified approach for maximizing continuous DR-submodular functions that encompasses a range of settings and oracle access types. Our approach includes a Frank-Wolfe type offline algorithm for both monotone and…

Machine Learning · Computer Science 2024-01-15 Mohammad Pedramfar , Christopher John Quinn , Vaneet Aggarwal

In this paper, we develop fast algorithms for two stochastic submodular maximization problems. We start with the well-studied adaptive submodular maximization problem subject to a cardinality constraint. We develop the first linear-time…

Machine Learning · Computer Science 2020-07-09 Shaojie Tang