English
Related papers

Related papers: Efficient Minimization of Decomposable Submodular …

200 papers

Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation…

Machine Learning · Computer Science 2019-05-07 Andrew An Bian , Baharan Mirzasoleiman , Joachim M. Buhmann , Andreas Krause

Set-functions appear in many areas of computer science and applied mathematics, such as machine learning, computer vision, operations research or electrical networks. Among these set-functions, submodular functions play an important role,…

Machine Learning · Computer Science 2010-11-17 Francis Bach

Problem decomposition plays a vital role when applying cooperative coevolution (CC) to large scale global optimization problems. However, most learning-based decomposition algorithms either only apply to additively separable problems or…

Neural and Evolutionary Computing · Computer Science 2021-01-20 An Chen , Zhigang Ren , Muyi Wang , Yongsheng Liang , Hanqing Liu , Wenhao Du

We introduce a new convex optimization problem, termed quadratic decomposable submodular function minimization (QDSFM), which allows to model a number of learning tasks on graphs and hypergraphs. The problem exhibits close ties to…

Machine Learning · Computer Science 2020-10-27 Pan Li , Niao He , Olgica Milenkovic

We study two mixed robust/average-case submodular partitioning problems that we collectively call Submodular Partitioning. These problems generalize both purely robust instances of the problem (namely max-min submodular fair allocation…

Data Structures and Algorithms · Computer Science 2016-08-17 Kai Wei , Rishabh Iyer , Shengjie Wang , Wenruo Bai , Jeff Bilmes

Robust Optimization is becoming increasingly important in machine learning applications. This paper studies the problem of robust submodular minimization subject to combinatorial constraints. Constrained Submodular Minimization arises in…

Machine Learning · Computer Science 2020-01-28 Rishabh Iyer

We show that any submodular minimization (SM) problem defined on a linear constraint set with constraints having up to two variables per inequality, are 2-approximable in polynomial time. If the constraints are monotone (the two variables…

Discrete Mathematics · Computer Science 2017-05-01 Dorit S. Hochbaum

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

This paper defines a convertible nonconvex function(CN function for short) and a weak (strong) uniform (decomposable, exact) CN function, proves the optimization conditions for their global solutions and proposes algorithms for solving the…

Optimization and Control · Mathematics 2022-02-16 M. Jiang , R. Shen , Z. Q. Meng , C. Y. Dang

Submodular functions are a special class of set functions which naturally model the notion of representativeness, diversity, coverage etc. and have been shown to be computationally very efficient. A lot of past work has applied submodular…

Machine Learning · Computer Science 2022-02-24 Vishal Kaushal , Ganesh Ramakrishnan , Rishabh Iyer

Polynomial optimization problems represent a wide class of optimization problems, with a large number of real-world applications. Current approaches for polynomial optimization, such as the sum of squares (SOS) method, rely on large-scale…

Optimization and Control · Mathematics 2025-07-04 Dimitris Bertsimas , Dick den Hertog , Thodoris Koukouvinos

Constrained submodular function maximization has been used in subset selection problems such as selection of most informative sensor locations. While these models have been quite popular, the solutions Constrained submodular function…

Data Structures and Algorithms · Computer Science 2020-10-15 Alfredo Torrico , Mohit Singh , Sebastian Pokutta , Nika Haghtalab , Joseph , Naor , Nima Anari

Submodular function optimization has numerous applications in machine learning and data analysis, including data summarization which aims to identify a concise and diverse set of data points from a large dataset. It is important to…

Data Structures and Algorithms · Computer Science 2023-04-11 Shaojie Tang , Jing Yuan , Twumasi Mensah-Boateng

We propose a decomposition framework for the parallel optimization of the sum of a differentiable function and a (block) separable nonsmooth, convex one. The latter term is typically used to enforce structure in the solution as, for…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-12 Francisco Facchinei , Simone Sagratella , Gesualdo Scutari

In a nutshell, submodular functions encode an intuitive notion of diminishing returns. As a result, submodularity appears in many important machine learning tasks such as feature selection and data summarization. Although there has been a…

Data Structures and Algorithms · Computer Science 2018-03-19 Marko Mitrovic , Moran Feldman , Andreas Krause , Amin Karbasi

The field of Natural Language Processing has experienced a dramatic leap in capabilities with the recent introduction of huge Language Models. Despite this success, natural language problems that involve several compounded steps are still…

Computation and Language · Computer Science 2023-02-16 Noam Wies , Yoav Levine , Amnon Shashua

In model selection problems for machine learning, the desire for a well-performing model with meaningful structure is typically expressed through a regularized optimization problem. In many scenarios, however, the meaningful structure is…

Optimization and Control · Mathematics 2022-11-09 Jonathan Bunton , Paulo Tabuada

Symmetric submodular functions are an important family of submodular functions capturing many interesting cases including cut functions of graphs and hypergraphs. Maximization of such functions subject to various constraints receives little…

Data Structures and Algorithms · Computer Science 2016-04-19 Moran Feldman

We consider the problem of minimising functions represented as a difference of lattice submodular functions. We propose analogues to the SupSub, SubSup and ModMod routines for lattice submodular functions. We show that our…

Data Structures and Algorithms · Computer Science 2019-06-03 Conor McMeel , Panos Parpas

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet