English
Related papers

Related papers: Non-Smooth, H\"older-Smooth, and Robust Submodular…

200 papers

We prove that no online algorithm (even randomized, against an oblivious adversary) is better than 1/2-competitive for welfare maximization with coverage valuations, unless $NP = RP$. Since the Greedy algorithm is known to be…

Data Structures and Algorithms · Computer Science 2013-01-31 Michael Kapralov , Ian Post , Jan Vondrak

Performativity means that the deployment of a predictive model incentivizes agents to strategically adapt their behavior, thereby inducing a model-dependent distribution shift. Practitioners often repeatedly retrain the model on data…

Optimization and Control · Mathematics 2026-02-09 Siyi Wang , Zifan Wang , Karl H. Johansson

It is generally believed that submodular functions -- and the more general class of $\gamma$-weakly submodular functions -- may only be optimized under the non-negativity assumption $f(S) \geq 0$. In this paper, we show that once the…

Data Structures and Algorithms · Computer Science 2019-04-23 Christopher Harshaw , Moran Feldman , Justin Ward , Amin Karbasi

Many sequential decision making problems, including pool-based active learning and adaptive viral marketing, can be formulated as an adaptive submodular maximization problem. Most of existing studies on adaptive submodular optimization…

Machine Learning · Computer Science 2022-12-13 Shaojie Tang , Jing Yuan

An effective technique for solving optimization problems over massive data sets is to partition the data into smaller pieces, solve the problem on each piece and compute a representative solution from it, and finally obtain a solution…

Data Structures and Algorithms · Computer Science 2015-06-23 Vahab Mirrokni , Morteza Zadimoghaddam

We present a new family of min-max optimization algorithms that automatically exploit the geometry of the gradient data observed at earlier iterations to perform more informative extra-gradient steps in later ones. Thanks to this adaptation…

Optimization and Control · Mathematics 2020-11-20 Kimon Antonakopoulos , E. Veronica Belmega , Panayotis Mertikopoulos

We propose a new family of subgradient- and gradient-based methods which converges with optimal complexity for convex optimization problems whose feasible region is simple enough. This includes cases where the objective function is…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito , Mituhiro Fukuda

In this paper, we consider a broad class of nonconvex and nonsmooth optimization problems, where one objective component is a nonsmooth weakly convex function composed with a linear operator. By integrating variable smoothing techniques…

Optimization and Control · Mathematics 2025-11-03 Xian-Jun Long , Kang Zeng , Gao-Xi Li , Minh N. Dao , Zai-Yun Peng

Diminishing-returns (DR) submodular optimization is an important field with many real-world applications in machine learning, economics and communication systems. It captures a subclass of non-convex optimization that provides both…

Machine Learning · Computer Science 2019-05-24 Christoph Dürr , Nguyen Kim Thang , Abhinav Srivastav , Léo Tible

We consider minimizing a sum of non-smooth objective functions with set constraints in a distributed manner. As to this problem, we propose a distributed algorithm with an exponential convergence rate for the first time. By the exact…

Optimization and Control · Mathematics 2020-01-06 Weijian Li , Xianlin Zeng , Shu Liang , Yiguang Hong

We consider the problem of multi-objective maximization of monotone submodular functions subject to cardinality constraint, often formulated as $\max_{|A|=k}\min_{i\in\{1,\dots,m\}}f_i(A)$. While it is widely known that greedy methods work…

Data Structures and Algorithms · Computer Science 2021-05-04 Rajan Udwani

Submodular functions have applications throughout machine learning, but in many settings, we do not have direct access to the underlying function $f$. We focus on stochastic functions that are given as an expectation of functions over a…

Machine Learning · Computer Science 2018-06-07 Matthew Staib , Bryan Wilder , Stefanie Jegelka

Non-smoothness at optimal points is a common phenomenon in many eigenvalue optimization problems. We consider two recent algorithms to minimize the largest eigenvalue of a Hermitian matrix dependent on one parameter, both proven to be…

Numerical Analysis · Mathematics 2018-05-14 Fatih Kangal , Emre Mengi

In monotone submodular function maximization, approximation guarantees based on the curvature of the objective function have been extensively studied in the literature. However, the notion of curvature is often pessimistic, and we rarely…

Data Structures and Algorithms · Computer Science 2017-09-12 Tasuku Soma , Yuichi Yoshida

Many large-scale machine learning problems--clustering, non-parametric learning, kernel machines, etc.--require selecting a small yet representative subset from a large dataset. Such problems can often be reduced to maximizing a submodular…

Machine Learning · Computer Science 2016-06-28 Baharan Mirzasoleiman , Amin Karbasi , Rik Sarkar , Andreas Krause

In this paper, we study the non-monotone DR-submodular function maximization over integer lattice. Functions over integer lattice have been defined submodular property that is similar to submodularity of set functions. DR-submodular is a…

Social and Information Networks · Computer Science 2022-12-14 Shuyang Gu , Chuangen Gao , Jun Huang , Weili Wu

Applications such as adversarially robust training and Wasserstein Distributionally Robust Optimization (WDRO) can be naturally formulated as min-sum-max optimization problems. While this formulation can be rewritten as an equivalent…

Optimization and Control · Mathematics 2025-02-26 Wei Liu , Muhammad Khan , Gabriel Mancino-Ball , Yangyang Xu

This paper presents a polynomial-time $1/2$-approximation algorithm for maximizing nonnegative $k$-submodular functions. This improves upon the previous $\max\{1/3, 1/(1+a)\}$-approximation by Ward and \v{Z}ivn\'y~(SODA'14), where…

Data Structures and Algorithms · Computer Science 2015-02-27 Satoru Iwata , Shin-ichi Tanigawa , Yuichi Yoshida

In this paper, we propose scalable methods for maximizing a regularized submodular function $f = g - \ell$ expressed as the difference between a monotone submodular function $g$ and a modular function $\ell$. Indeed, submodularity is…

Machine Learning · Computer Science 2020-02-11 Ehsan Kazemi , Shervin Minaee , Moran Feldman , Amin Karbasi

We propose a proximal variable smoothing algorithm for a nonsmooth optimization problem whose cost function is the sum of three functions including a weakly convex composite function. The proposed algorithm has a single-loop structure…

Optimization and Control · Mathematics 2025-06-09 Keita Kume , Isao Yamada