English
Related papers

Related papers: Stochastic Submodular Maximization: The Case of Co…

200 papers

In this paper, we study the problem of \textit{constrained} and \textit{stochastic} continuous submodular maximization. Even though the objective function is not concave (nor convex) and is defined in terms of an expectation, we develop a…

Optimization and Control · Mathematics 2017-11-07 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

The problem of finding global minima of nonlinear discrete functions arises in many fields of practical matters. In recent years, methods based on discrete filled functions become popular as ways of solving these sort of problems. However,…

Optimization and Control · Mathematics 2020-03-26 Juan Di Mauro , Hugo D. Scolnik

A framework is introduced for sequentially solving convex stochastic minimization problems, where the objective functions change slowly, in the sense that the distance between successive minimizers is bounded. The minimization problems are…

Optimization and Control · Mathematics 2018-03-12 Craig Wilson , Venugopal Veeravalli , Angelia Nedich

This paper deals with composite optimization problems having the objective function formed as the sum of two terms, one has Lipschitz continuous gradient along random subspaces and may be nonconvex and the second term is simple and…

Optimization and Control · Mathematics 2024-01-10 I. Necoara , F. Chorobura

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

In this paper we consider finite sum composite convex optimization problems with many functional constraints. The objective function is expressed as a finite sum of two terms, one of which admits easy computation of (sub)gradients while the…

Optimization and Control · Mathematics 2024-12-03 Nitesh Kumar Singh , Ion Necoara , Vyacheslav Kungurtsev

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

Conditional stochastic optimization covers a variety of applications ranging from invariant learning and causal inference to meta-learning. However, constructing unbiased gradient estimators for such problems is challenging due to the…

Optimization and Control · Mathematics 2024-06-04 Yifan Hu , Siqi Zhang , Xin Chen , Niao He

We study the foundations of variational inference, which frames posterior inference as an optimisation problem, for probabilistic programming. The dominant approach for optimisation in practice is stochastic gradient descent. In particular,…

Programming Languages · Computer Science 2023-01-10 Basim Khajwal , C. -H. Luke Ong , Dominik Wagner

This work studies constrained stochastic optimization problems where the objective and constraint functions are convex and expressed as compositions of stochastic functions. The problem arises in the context of fair classification, fair…

Machine Learning · Computer Science 2022-09-13 Srujan Teja Thomdapu , Harshvardhan , Ketan Rajawat

The problem of maximizing nonnegative monotone submodular functions under a certain constraint has been intensively studied in the last decade, and a wide range of efficient approximation algorithms have been developed for this problem.…

Data Structures and Algorithms · Computer Science 2020-06-30 Akbar Rafiey , Yuichi Yoshida

Stochastic gradient descent (SGD) method is popular for solving non-convex optimization problems in machine learning. This work investigates SGD from a viewpoint of graduated optimization, which is a widely applied approach for non-convex…

Optimization and Control · Mathematics 2023-08-15 Da Li , Jingjing Wu , Qingrun Zhang

We study two mixed robust/average-case submodular partitioning problems that we collectively call Submodular Partitioning. These problems generalize both purely robust instances of the problem (namely max-min submodular fair allocation…

Data Structures and Algorithms · Computer Science 2016-08-17 Kai Wei , Rishabh Iyer , Shengjie Wang , Wenruo Bai , Jeff Bilmes

We study the $k$-Submodular Cover ($kSC$) problem, a natural generalization of the classical Submodular Cover problem that arises in artificial intelligence and combinatorial optimization tasks such as influence maximization, resource…

Data Structures and Algorithms · Computer Science 2025-11-04 Hue T. Nguyen , Tan D. Tran , Nguyen Long Giang , Canh V. Pham

Maximizing submodular functions under cardinality constraints lies at the core of numerous data mining and machine learning applications, including data diversification, data summarization, and coverage problems. In this work, we study this…

Data Structures and Algorithms · Computer Science 2016-11-01 Alessandro Epasto , Silvio Lattanzi , Sergei Vassilvitskii , Morteza Zadimoghaddam

We investigate the continuous non-monotone DR-submodular maximization problem subject to a down-closed convex solvable constraint. Our first contribution is to construct an example to demonstrate that (first-order) stationary points can…

Data Structures and Algorithms · Computer Science 2024-03-27 Shengminjie Chen , Donglei Du , Wenguo Yang , Dachuan Xu , Suixiang Gao

Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality…

Data Structures and Algorithms · Computer Science 2026-02-19 Ajitesh Srivastava , Shanghua Teng

We consider the problem of maximizing non-negative non-decreasing set functions. Although most of the recent work focus on exploiting submodularity, it turns out that several objectives we encounter in practice are not submodular.…

Data Structures and Algorithms · Computer Science 2018-06-19 Gaurav Gupta , Sergio Pequito , Paul Bogdan

Submodular optimization has numerous applications such as crowdsourcing and viral marketing. In this paper, we study the fundamental problem of non-negative submodular function maximization subject to a $k$-system constraint, which…

Data Structures and Algorithms · Computer Science 2021-06-16 Kai Han , Shuang Cui , Tianshuai Zhu , Jing Tang , Benwei Wu , He Huang

In machine learning and big data, the optimization objectives based on set-cover, entropy, diversity, influence, feature selection, etc. are commonly modeled as submodular functions. Submodular (function) maximization is generally NP-hard,…

Data Structures and Algorithms · Computer Science 2022-12-13 Haotian Zhang , Rao Li , Zewei Wu , Guodong Sun