English
Related papers

Related papers: Continuous DR-submodular Maximization: Structure a…

200 papers

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, which are ubiquitous in…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

A wide variety of problems in machine learning, including exemplar clustering, document summarization, and sensor placement, can be cast as constrained submodular maximization problems. A lot of recent effort has been devoted to developing…

Data Structures and Algorithms · Computer Science 2016-08-15 Rafael da Ponte Barbosa , Alina Ene , Huy L. Nguyen , Justin Ward

Distributed maximization of a submodular function in the MapReduce (MR) model has received much attention, culminating in two frameworks that allow a centralized algorithm to be run in the MR setting without loss of approximation, as long…

Data Structures and Algorithms · Computer Science 2024-09-17 Yixin Chen , Tonmoy Dey , Alan Kuhnle

The task of maximizing a monotone submodular function under a cardinality constraint is at the core of many machine learning and data mining applications, including data summarization, sparse regression and coverage problems. We study this…

Data Structures and Algorithms · Computer Science 2023-05-26 Silvio Lattanzi , Slobodan Mitrović , Ashkan Norouzi-Fard , Jakub Tarnawski , Morteza Zadimoghaddam

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

In this paper, we study stochastic submodular maximization problems with general matroid constraints, that naturally arise in online learning, team formation, facility location, influence maximization, active learning and sensing objective…

Machine Learning · Computer Science 2023-03-20 Gözde Özcan , Stratis Ioannidis

In this work, we study the problem of monotone non-submodular maximization with partition matroid constraint. Although a generalization of this problem has been studied in literature, our work focuses on leveraging properties of partition…

Data Structures and Algorithms · Computer Science 2022-05-02 Lan N. Nguyen , My T. Thai

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

In this paper, we study a family of non-convex and possibly non-smooth inf-projection minimization problems, where the target objective function is equal to minimization of a joint function over another variable. This problem include…

Machine Learning · Computer Science 2020-07-15 Yan Yan , Yi Xu , Lijun Zhang , Xiaoyu Wang , Tianbao Yang

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

Submodular functions are discrete functions that model laws of diminishing returns and enjoy numerous algorithmic applications. They have been used in many areas, including combinatorial optimization, machine learning, and economics. In…

Data Structures and Algorithms · Computer Science 2012-08-24 Maria-Florina Balcan , Nicholas J. A. Harvey

Maximization of submodular functions under various constraints is a fundamental problem that has been studied extensively. A powerful technique that has emerged and has been shown to be extremely effective for such problems is the…

Data Structures and Algorithms · Computer Science 2024-09-24 Niv Buchbinder , Moran Feldman

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

In this paper we study the adaptivity of submodular maximization. Adaptivity quantifies the number of sequential rounds that an algorithm makes when function evaluations can be executed in parallel. Adaptivity is a fundamental concept that…

Data Structures and Algorithms · Computer Science 2018-04-18 Eric Balkanski , Aviad Rubinstein , Yaron Singer

Maximizing submodular functions under cardinality constraints lies at the core of numerous data mining and machine learning applications, including data diversification, data summarization, and coverage problems. In this work, we study this…

Data Structures and Algorithms · Computer Science 2016-11-01 Alessandro Epasto , Silvio Lattanzi , Sergei Vassilvitskii , Morteza Zadimoghaddam

We analyze the performance of the greedy algorithm, and also a discrete semi-gradient based algorithm, for maximizing the sum of a suBmodular and suPermodular (BP) function (both of which are non-negative monotone non-decreasing) under two…

Discrete Mathematics · Computer Science 2018-01-24 Wenruo Bai , Jeffrey A. Bilmes

The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc.…

Data Structures and Algorithms · Computer Science 2023-09-22 Dung T. K. Ha , Canh V. Pham , Tan D. Tran , Huan X. Hoang

In this work, we study the classical problem of maximizing a submodular function subject to a matroid constraint. We develop deterministic algorithms that are very parsimonious with respect to querying the submodular function, for both the…

Data Structures and Algorithms · Computer Science 2024-08-29 Eric Balkanski , Steven DiSilvio , Alan Kuhnle , ChunLi Peng

An optimization algorithm for nonsmooth nonconvex constrained optimization problems with upper-C2 objective functions is proposed and analyzed. Upper-C2 is a weakly concave property that exists in difference of convex (DC) functions and…

Optimization and Control · Mathematics 2022-04-21 Jingyi Wang , Cosmin G. Petra

We introduce a novel framework for decentralized projection-free optimization, extending projection-free methods to a broader class of upper-linearizable functions. Our approach leverages decentralized optimization techniques with the…

Optimization and Control · Mathematics 2026-02-25 Yiyang Lu , Mohammad Pedramfar , Vaneet Aggarwal