English
Related papers

Related papers: On Unconstrained Quasi-Submodular Function Optimiz…

200 papers

Set function optimization is essential in AI and machine learning. We focus on a subadditive set function that generalizes submodularity, and examine the subadditivity of non-submodular functions. We also deal with a minimax subadditive…

Data Structures and Algorithms · Computer Science 2019-08-27 Kiyohito Nagano , Akihiro Kishimoto

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

Optimization of DR-submodular functions has experienced a notable surge in significance in recent times, marking a pivotal development within the domain of non-convex optimization. Motivated by real-world scenarios, some recent works have…

Machine Learning · Computer Science 2024-01-18 Loay Mualem , Murad Tukan , Moran Fledman

In this paper, we consider a finite-dimensional optimization problem minimizing a continuous objective on a compact domain subject to a multi-dimensional constraint function. For the latter, we assume the availability of a global Lipschitz…

Optimization and Control · Mathematics 2026-02-11 Adrian Göß , Alexander Martin , Sebastian Pokutta , Kartikey Sharma

We investigate a more generalized form of submodular maximization, referred to as $k$-submodular maximization, with applications across social networks and machine learning domains. In this work, we propose the multilinear extension of…

Data Structures and Algorithms · Computer Science 2023-09-13 Lingxiao Huang , Baoxiang Wang , Huanjian Zhou

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

Real continuous submodular functions, as a generalization of the corresponding discrete notion to the continuous domain, gained considerable attention recently. The analog notion for entropy functions requires additional properties: a real…

Optimization and Control · Mathematics 2021-02-12 Laszlo Csirmaz

Most of existing studies on submodular maximization focus on selecting a subset of items that maximizes a \emph{single} submodular function. However, in many real-world scenarios, we might have multiple user-specific functions, each of…

Machine Learning · Computer Science 2024-09-06 Jing Yuan , Shaojie Tang

We consider non-monotone DR-submodular function maximization, where DR-submodularity (diminishing return submodularity) is an extension of submodularity for functions over the integer lattice based on the concept of the diminishing return…

Data Structures and Algorithms · Computer Science 2016-12-06 Tasuku Soma , Yuichi Yoshida

Minimax optimization has been central in addressing various applications in machine learning, game theory, and control theory. Prior literature has thus far mainly focused on studying such problems in the continuous domain, e.g.,…

Optimization and Control · Mathematics 2021-11-03 Arman Adibi , Aryan Mokhtari , Hamed Hassani

Submodular optimization with bandit feedback has recently been studied in a variety of contexts. In a number of real-world applications such as diversified recommender systems and data summarization, the submodular function exhibits…

Machine Learning · Computer Science 2024-07-04 Wenjing Chen , Victoria G. Crawford

Submodular function maximization is a fundamental combinatorial optimization problem with plenty of applications -- including data summarization, influence maximization, and recommendation. In many of these problems, the goal is to find a…

Data Structures and Algorithms · Computer Science 2023-09-04 Yanhao Wang , Yuchen Li , Francesco Bonchi , Ying Wang

Global minimization is a fundamental challenge in optimization, especially in machine learning, where finding the global minimum of a function directly impacts model performance and convergence. This article introduces a novel optimization…

Machine Learning · Computer Science 2024-10-31 Seifeddine Achour

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed graph structure, and…

Machine Learning · Computer Science 2013-09-27 Kiyohito Nagano , Yoshinobu Kawahara

Non-convex optimization is ubiquitous in machine learning. Majorization-Minimization (MM) is a powerful iterative procedure for optimizing non-convex functions that works by optimizing a sequence of bounds on the function. In MM, the bound…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Sobhan Naderi Parizi , Kun He , Reza Aghajani , Stan Sclaroff , Pedro Felzenszwalb

The simplex algorithm for linear programming is based on the fact that any local optimum with respect to the polyhedral neighborhood is also a global optimum. We show that a similar result carries over to submodular maximization. In…

Data Structures and Algorithms · Computer Science 2017-12-01 Simon Bruggmann , Rico Zenklusen

Non-monotone constrained submodular maximization plays a crucial role in various machine learning applications. However, existing algorithms often struggle with a trade-off between approximation guarantees and practical efficiency. The…

Machine Learning · Computer Science 2024-05-24 Murad Tukan , Loay Mualem , Moran Feldman

Submodular set functions are undoubtedly among the most important building blocks of combinatorial optimization. Somewhat surprisingly, continuous counterparts of such functions have also appeared in an analytic line of research where they…

Combinatorics · Mathematics 2024-06-10 Kristóf Bérczi , Boglárka Gehér , András Imolay , László Lovász , Tamás Schwarcz

In this work, we treat the problem of multi-task submodular optimization from the perspective of local distributional robustness within the neighborhood of a reference distribution which assigns an importance score to each task. We…

Machine Learning · Computer Science 2026-03-06 Ege C. Kaya , Abolfazl Hashemi

We consider the optimal coverage problem where a multi-agent network is deployed in an environment with obstacles to maximize a joint event detection probability. The objective function of this problem is non-convex and no global optimum is…

Optimization and Control · Mathematics 2017-08-15 Xinmiao Sun , Christos G. Cassandras , Xiangyu Meng