English
Related papers

Related papers: Worst-case Optimal Submodular Extensions for Margi…

200 papers

Computing the partition function and the marginals of a global probability distribution are two important issues in any probabilistic inference problem. In a previous work, we presented sub-tree based upper and lower bounds on the partition…

Applications · Statistics 2011-03-03 Mehdi Molkaraie , Payam Pakzad

Submodular optimization is a fundamental problem with many applications in machine learning, often involving decision-making over datasets with sensitive attributes such as gender or age. In such settings, it is often desirable to produce a…

Machine Learning · Computer Science 2024-07-09 Wenjing Chen , Shuo Xing , Samson Zhou , Victoria G. Crawford

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle

Natural Language Processing (NLP) systems are increasingly taking the form of sophisticated modular pipelines, e.g., Retrieval Augmented Generation (RAG), where each module may involve a distinct Language Model (LM) and an associated prompt…

Computation and Language · Computer Science 2024-10-08 Dilara Soylu , Christopher Potts , Omar Khattab

The submodular function maximization is an attractive optimization model that appears in many real applications. Although a variety of greedy algorithms quickly find good feasible solutions for many instances while guaranteeing…

Data Structures and Algorithms · Computer Science 2018-11-13 Naoya Uematsu , Shunji Umetani , Yoshinobu Kawahara

In this paper, we propose a new framework for designing fast parallel algorithms for fundamental statistical subset selection tasks that include feature selection and experimental design. Such tasks are known to be weakly submodular and are…

Machine Learning · Computer Science 2021-04-02 Sharon Qian , Yaron Singer

We study in detail the two main algorithms which have been considered for fitting constrained marginal models to discrete data, one based on Lagrange multipliers and the other on a regression model. We show that the updates produced by the…

Computation · Statistics 2013-05-28 Robin J. Evans , Antonio Forcina

Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality…

Data Structures and Algorithms · Computer Science 2026-02-19 Ajitesh Srivastava , Shanghua Teng

Submodular maximization has found extensive applications in various domains within the field of artificial intelligence, including but not limited to machine learning, computer vision, and natural language processing. With the increasing…

Data Structures and Algorithms · Computer Science 2024-12-04 Shuang Cui , Kai Han , Jing Tang , Xueying Li , Aakas Zhiyuli , Hanxiao Li

This paper addresses the problem of sequential submodular maximization: selecting and ranking items in a sequence to optimize some composite submodular function. In contrast to most of the previous works, which assume access to the utility…

Machine Learning · Computer Science 2024-09-10 Jing Yuan , Shaojie Tang

A highly influential ingredient of many techniques designed to exploit sparsity in numerical optimization is the so-called chordal extension of a graph representation of the optimization problem. The definitive relation between chordal…

Machine Learning · Computer Science 2019-10-18 Defeng Liu , Andrea Lodi , Mathieu Tanneau

We present a provably more efficient implementation of the Minimum Norm Point Algorithm conceived by Fujishige than the one presented in \cite{FUJI06}. The algorithm solves the minimization problem for a class of functions known as…

Data Structures and Algorithms · Computer Science 2014-10-02 Igor Stassiy

Energy minimization algorithms, such as graph cuts, enable the computation of the MAP solution under certain probabilistic models such as Markov random fields. However, for many computer vision problems, the MAP solution under the model is…

Computer Vision and Pattern Recognition · Computer Science 2013-07-31 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

We consider a class of discrete optimization problems that aim to maximize a submodular objective function subject to a distributed partition matroid constraint. More precisely, we consider a networked scenario in which multiple agents…

Optimization and Control · Mathematics 2020-11-19 Alexander Robey , Arman Adibi , Brent Schlotfeldt , George J. Pappas , Hamed Hassani

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the…

Machine Learning · Computer Science 2023-03-14 Eldad Haber , Moshe Eliasof , Luis Tenorio

As the scales of data sets expand rapidly in some application scenarios, increasing efforts have been made to develop fast submodular maximization algorithms. This paper presents a currently the most efficient algorithm for maximizing…

Data Structures and Algorithms · Computer Science 2018-11-20 Teng Li , Hyo-Sang Shin , Antonios Tsourdos

In this paper, we study the problem of maximizing the difference between an adaptive submodular (revenue) function and an non-negative modular (cost) function under the adaptive setting. The input of our problem is a set of $n$ items, where…

Machine Learning · Computer Science 2021-03-02 Shaojie Tang , Jing Yuan

Submodular functions are relevant to machine learning for at least two reasons: (1) some problems may be expressed directly as the optimization of submodular functions and (2) the lovasz extension of submodular functions provides a useful…

Machine Learning · Computer Science 2013-10-09 Francis Bach

Many problems in Machine Learning can be modeled as submodular optimization problems. Recent work has focused on stochastic or adaptive versions of these problems. We consider the Scenario Submodular Cover problem, which is a counterpart to…

Data Structures and Algorithms · Computer Science 2016-03-11 Nathaniel Grammel , Lisa Hellerstein , Devorah Kletenik , Patrick Lin