English
Related papers

Related papers: Worst-case Optimal Submodular Extensions for Margi…

200 papers

Submodular functions are a special class of set functions which naturally model the notion of representativeness, diversity, coverage etc. and have been shown to be computationally very efficient. A lot of past work has applied submodular…

Machine Learning · Computer Science 2022-02-24 Vishal Kaushal , Ganesh Ramakrishnan , Rishabh Iyer

In this paper we study the fundamental problems of maximizing a continuous non-monotone submodular function over the hypercube, both with and without coordinate-wise concavity. This family of optimization problems has several applications…

Data Structures and Algorithms · Computer Science 2018-05-25 Rad Niazadeh , Tim Roughgarden , Joshua R. Wang

Expanding a lower-dimensional problem to a higher-dimensional space and then projecting back is often beneficial. This article rigorously investigates this perspective in the context of finite mixture models, namely how to improve inference…

Methodology · Statistics 2014-11-10 Andrea Mercatanti , Fan Li , Fabrizia Mealli

We consider the problem of maximizing non-negative non-decreasing set functions. Although most of the recent work focus on exploiting submodularity, it turns out that several objectives we encounter in practice are not submodular.…

Data Structures and Algorithms · Computer Science 2018-06-19 Gaurav Gupta , Sergio Pequito , Paul Bogdan

We study the problem of maximizing a monotone submodular function with viability constraints. This problem originates from computational biology, where we are given a phylogenetic tree over a set of species and a directed graph, the…

Data Structures and Algorithms · Computer Science 2016-11-18 Wolfgang Dvořák , Monika Henzinger , David P. Williamson

Rule sets are highly interpretable logical models in which the predicates for decision are expressed in disjunctive normal form (DNF, OR-of-ANDs), or, equivalently, the overall model comprises an unordered collection of if-then decision…

Machine Learning · Computer Science 2022-06-09 Fan Yang , Kai He , Linxiao Yang , Hongxia Du , Jingbang Yang , Bo Yang , Liang Sun

We present combinatorial and parallelizable algorithms for maximization of a submodular function, not necessarily monotone, with respect to a size constraint. We improve the best approximation factor achieved by an algorithm that has…

Data Structures and Algorithms · Computer Science 2024-02-21 Yixin Chen , Alan Kuhnle

Several large-scale machine learning tasks, such as data summarization, can be approached by maximizing functions that satisfy submodularity. These optimization problems often involve complex side constraints, imposed by the underlying…

Data Structures and Algorithms · Computer Science 2021-02-15 Francesco Quinzan , Vanja Doskoč , Andreas Göbel , Tobias Friedrich

We study a general stochastic ranking problem where an algorithm needs to adaptively select a sequence of elements so as to "cover" a random scenario (drawn from a known distribution) at minimum expected cost. The coverage of each scenario…

Data Structures and Algorithms · Computer Science 2019-02-06 Fatemeh Navidi , Prabhanjan Kambadur , Viswanath Nagarajan

Maximizing submodular functions under cardinality constraints lies at the core of numerous data mining and machine learning applications, including data diversification, data summarization, and coverage problems. In this work, we study this…

Data Structures and Algorithms · Computer Science 2016-11-01 Alessandro Epasto , Silvio Lattanzi , Sergei Vassilvitskii , Morteza Zadimoghaddam

In this work, we present a new algorithm for maximizing a non-monotone submodular function subject to a general constraint. Our algorithm finds an approximate fractional solution for maximizing the multilinear extension of the function over…

Data Structures and Algorithms · Computer Science 2016-08-15 Alina Ene , Huy L. Nguyen

Discrete energy minimization is widely-used in computer vision and machine learning for problems such as MAP inference in graphical models. The problem, in general, is notoriously intractable, and finding the global optimal solution is…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Mengtian Li , Alexander Shekhovtsov , Daniel Huber

We study the complexity of approximate representation and learning of submodular functions over the uniform distribution on the Boolean hypercube $\{0,1\}^n$. Our main result is the following structural theorem: any submodular function is…

Machine Learning · Computer Science 2013-04-03 Vitaly Feldman , Pravesh Kothari , Jan Vondrak

We study planning with submodular objective functions, where instead of maximizing the cumulative reward, the goal is to maximize the objective value induced by a submodular function. Our framework subsumes standard planning and submodular…

Artificial Intelligence · Computer Science 2020-10-23 Ruosong Wang , Hanrui Zhang , Devendra Singh Chaplot , Denis Garagić , Ruslan Salakhutdinov

This paper introduces a generalised version of importance subsampling for time series reduction/aggregation in optimisation-based power system planning models. Recent studies indicate that reliably determining optimal electricity…

Applications · Statistics 2020-08-26 Adriaan P Hilbers , David J Brayshaw , Axel Gandy

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

We extend the traditional worst-case, minimax analysis of stochastic convex optimization by introducing a localized form of minimax complexity for individual functions. Our main result gives function-specific lower and upper bounds on the…

Machine Learning · Statistics 2016-05-27 Yuancheng Zhu , Sabyasachi Chatterjee , John Duchi , John Lafferty

In this paper, we propose SubLoRA, a rank determination method for Low-Rank Adaptation (LoRA) based on submodular function maximization. In contrast to prior approaches, such as AdaLoRA, that rely on first-order (linearized) approximations…

Machine Learning · Computer Science 2025-07-03 Yihang Gao , Vincent Y. F. Tan

Worst-case bounds on the expected shortfall risk given only limited information on the distribution of the random variables has been studied extensively in the literature. In this paper, we develop a new worst-case bound on the expected…

Risk Management · Quantitative Finance 2017-02-12 Anulekha Dhara , Bikramjit Das , Karthik Natarajan

Weak submodularity is a natural relaxation of the diminishing return property, which is equivalent to submodularity. Weak submodularity has been used to show that many (monotone) functions that arise in practice can be efficiently maximized…

Data Structures and Algorithms · Computer Science 2020-09-24 Richard Santiago , Yuichi Yoshida