English
Related papers

Related papers: Submodular Ground-Set Pruning: Monotone Tightness …

200 papers

In this paper we study submodular maximization under a matroid constraint in the adaptive complexity model. This model was recently introduced in the context of submodular optimization in [BS18a] to quantify the information theoretic…

Data Structures and Algorithms · Computer Science 2018-11-09 Eric Balkanski , Aviad Rubinstein , Yaron Singer

The problem of maximizing a constrained monotone set function has many practical applications and generalizes many combinatorial problems. Unfortunately, it is generally not possible to maximize a monotone set function up to an acceptable…

Data Structures and Algorithms · Computer Science 2014-08-29 Moran Feldman , Rani Izsak

In a recent work, Esmer et al. describe a simple method - Approximate Monotone Local Search - to obtain exponential approximation algorithms from existing parameterized exact algorithms, polynomial-time approximation algorithms and, more…

Data Structures and Algorithms · Computer Science 2023-08-30 Baris Can Esmer , Ariel Kulik , Daniel Marx , Daniel Neuen , Roohani Sharma

The rapid advancement of large language models (LLMs) has led to architectures with billions to trillions of parameters, posing significant deployment challenges due to their substantial demands on memory, processing power, and energy…

Machine Learning · Computer Science 2024-07-02 Enshu Liu , Junyi Zhu , Zinan Lin , Xuefei Ning , Matthew B. Blaschko , Shengen Yan , Guohao Dai , Huazhong Yang , Yu Wang

Finding Minimal Unsatisfiable Subsets (MUSes) of binary constraints is a common problem in infeasibility analysis of over-constrained systems. However, because of the exponential search space of the problem, enumerating MUSes is extremely…

Artificial Intelligence · Computer Science 2024-02-27 Panagiotis Lymperopoulos , Liping Liu

In many submodular optimization applications, datasets are naturally partitioned into disjoint subsets. These scenarios give rise to submodular optimization problems with partition-based constraints, where the desired solution set should be…

Data Structures and Algorithms · Computer Science 2026-01-21 Wenjing Chen , Yixin Chen , Victoria G. Crawford

Submodular maximization with a cardinality constraint can model various problems, and those problems are often very large in practice. For the case where objective functions are monotone, many fast approximation algorithms have been…

Data Structures and Algorithms · Computer Science 2020-01-13 Shinsaku Sakaue

Submodular functions are a broad class of set functions, which naturally arise in diverse areas. Many algorithms have been suggested for the maximization of these functions. Unfortunately, once the function deviates from submodularity, the…

Discrete Mathematics · Computer Science 2017-07-17 Lin Chen , Moran Feldman , Amin Karbasi

Model compression is crucial for deployment of neural networks on devices with limited computational and memory resources. Many different methods show comparable accuracy of the compressed model and similar compression rates. However, the…

Machine Learning · Computer Science 2020-08-21 Ben Mussay , Daniel Feldman , Samson Zhou , Vladimir Braverman , Margarita Osadchy

The sizes of pretrained language models make them challenging and expensive to use when there are multiple desired downstream tasks. In this work, we adopt recent strategies for model pruning during finetuning to explore the question of…

Computation and Language · Computer Science 2021-12-13 Patrick Xia , Richard Shin

Network pruning techniques, including weight pruning and filter pruning, reveal that most state-of-the-art neural networks can be accelerated without a significant performance drop. This work focuses on filter pruning which enables…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Xuanyu He , Yu-I Yang , Ran Song , Jiachen Pu , Conggang Hu , Feijun Jiang , Wei Zhang , Huanghao Ding

Submodularity is an important property of set functions and has been extensively studied in the literature. It models set functions that exhibit a diminishing returns property, where the marginal value of adding an element to a set…

Data Structures and Algorithms · Computer Science 2020-11-03 Gamal Sallam , Zizhan Zheng , Jie Wu , Bo Ji

Submodular function maximization is a central problem in combinatorial optimization, generalizing many important problems including Max Cut in directed/undirected graphs and in hypergraphs, certain constraint satisfaction problems, maximum…

Computational Complexity · Computer Science 2009-02-03 Jon Lee , Vahab Mirrokni , Viswanath Nagarjan , Maxim Sviridenko

Evolutionary algorithms (EAs) are a kind of nature-inspired general-purpose optimization algorithm, and have shown empirically good performance in solving various real-word optimization problems. During the past two decades, promising…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Yang Yu , Ke Tang , Xin Yao , Zhi-Hua Zhou

We propose a new random pruning method (called "submodular sparsification (SS)") to reduce the cost of submodular maximization. The pruning is applied via a "submodularity graph" over the $n$ ground elements, where each directed edge is…

Machine Learning · Computer Science 2016-06-02 Tianyi Zhou , Hua Ouyang , Yi Chang , Jeff Bilmes , Carlos Guestrin

We propose the first adversarially robust algorithm for monotone submodular maximization under single and multiple knapsack constraints with scalable implementations in distributed and streaming settings. For a single knapsack constraint,…

Data Structures and Algorithms · Computer Science 2019-05-08 Dmitrii Avdiukhin , Slobodan Mitrović , Grigory Yaroslavtsev , Samson Zhou

The objective of a two-stage submodular maximization problem is to reduce the ground set using provided training functions that are submodular, with the aim of ensuring that optimizing new objective functions over the reduced ground set…

Data Structures and Algorithms · Computer Science 2023-11-03 Shaojie Tang

A multiple knapsack constraint over a set of items is defined by a set of bins of arbitrary capacities, and a weight for each of the items. An assignment for the constraint is an allocation of subsets of items to the bins which adheres to…

Data Structures and Algorithms · Computer Science 2021-06-29 Yaron Fairstein , Ariel Kulik , Hadas Shachnai

Constrained submodular function maximization has been used in subset selection problems such as selection of most informative sensor locations. While these models have been quite popular, the solutions Constrained submodular function…

Data Structures and Algorithms · Computer Science 2020-10-15 Alfredo Torrico , Mohit Singh , Sebastian Pokutta , Nika Haghtalab , Joseph , Naor , Nima Anari

Classes of set functions along with a choice of ground set are a bedrock to determine and develop corresponding variants of greedy algorithms to obtain efficient solutions for combinatorial optimization problems. The class of approximate…

Optimization and Control · Mathematics 2021-08-20 Praneeth Vepakomma , Yulia Kempner , Ramesh Raskar