English
Related papers

Related papers: Submodular Functions: Learnability, Structure, and…

200 papers

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

It has been hypothesized that some form of "modular" structure in artificial neural networks should be useful for learning, compositionality, and generalization. However, defining and quantifying modularity remains an open problem. We cast…

Machine Learning · Computer Science 2022-06-23 Richard D. Lange , David S. Rolnick , Konrad P. Kording

Optimization problems often involve vector norms, which has led to extensive research on developing algorithms that can handle objectives beyond the $\ell_p$ norms. Our work introduces the concept of submodular norms, which are a versatile…

Data Structures and Algorithms · Computer Science 2023-10-10 Kalen Patton , Matteo Russo , Sahil Singla

Using polarity, we give an outer polyhedral approximation for the epigraph of set functions. For a submodular function, we prove that the corresponding polar relaxation is exact; hence, it is equivalent to the Lov\'asz extension. The polar…

Optimization and Control · Mathematics 2020-12-09 Alper Atamturk , Vishnu Narayanan

Discrete convex functions are used in many areas, including operations research, discrete-event systems, game theory, and economics. The objective of this paper is to offer a survey on fundamental operations for various kinds of discrete…

Combinatorics · Mathematics 2019-10-04 Kazuo Murota

We consider log-supermodular models on binary variables, which are probabilistic models with negative log-densities which are submodular. These models provide probabilistic interpretations of common combinatorial optimization tasks such as…

Machine Learning · Statistics 2016-08-19 Tatiana Shpakova , Francis Bach

Controllability and observability have long been recognized as fundamental structural properties of dynamical systems, but have recently seen renewed interest in the context of large, complex networks of dynamical systems. A basic problem…

Optimization and Control · Mathematics 2016-11-18 Tyler H. Summers , Fabrizio L. Cortesi , John Lygeros

Randomization is a fundamental tool used in many theoretical and practical areas of computer science. We study here the role of randomization in the area of submodular function maximization. In this area most algorithms are randomized, and…

Data Structures and Algorithms · Computer Science 2015-08-11 Niv Buchbinder , Moran Feldman

Submodular function minimization (SFM) is a fundamental and efficiently solvable problem class in combinatorial optimization with a multitude of applications in various fields. Surprisingly, there is only very little known about constraint…

Data Structures and Algorithms · Computer Science 2018-11-27 Martin Nägele , Benny Sudakov , Rico Zenklusen

Control of underactuated dynamical systems has been studied for decades in robotics, and is now emerging in other fields such as neuroscience. Most of the advances have been in model based control theory, which has limitations when the…

Optimization and Control · Mathematics 2020-06-30 Bharat Monga , Jeff Moehlis

We consider a class of optimization problems that involve determining the maximum value that a function in a particular class can attain subject to a collection of difference constraints. We show that a particular linear programming…

Data Structures and Algorithms · Computer Science 2022-11-16 Sungjin Im , Benjamin Moseley , Hung Q. Ngo , Kirk Pruhs , Alireza Samadian

In submodular optimization we often deal with the expected value of a submodular function $f$ on a distribution $\mathcal{D}$ over sets of elements. In this work we study such submodular expectations for negatively dependent distributions.…

Data Structures and Algorithms · Computer Science 2022-07-13 Frederick Qiu , Sahil Singla

Clustering with submodular functions has been of interest over the last few years. Symmetric submodular functions are of particular interest as minimizing them is significantly more efficient and they include many commonly used functions in…

Data Structures and Algorithms · Computer Science 2014-11-21 Amit Dhurandhar , Karthik Gurumoorthy

In this paper, we study the problem of maximizing continuous submodular functions that naturally arise in many learning applications such as those involving utility functions in active learning and sensing, matrix approximations and network…

Machine Learning · Computer Science 2017-08-16 Hamed Hassani , Mahdi Soltanolkotabi , Amin Karbasi

In this note we study multiple-ratio fractional 0--1 programs, a broad class of NP-hard combinatorial optimization problems. In particular, under some relatively mild assumptions we provide a complete characterization of the conditions,…

Optimization and Control · Mathematics 2020-12-15 Shaoning Han , Andres Gomez , Oleg A Prokopyev

Submodularity is desirable for a variety of objectives in content selection where the current neural encoder-decoder framework is inadequate. However, it has so far not been explored in the neural encoder-decoder system for text generation.…

Computation and Language · Computer Science 2020-10-06 Simeng Han , Xiang Lin , Shafiq Joty

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Submodular function minimization (SFM) is a fundamental discrete optimization problem which generalizes many well known problems, has applications in various fields, and can be solved in polynomial time. Owing to applications in computer…

Data Structures and Algorithms · Computer Science 2016-11-01 Deeparnab Chakrabarty , Yin Tat Lee , Aaron Sidford , Sam Chiu-wai Wong

We study a class of procurement auctions with a budget constraint, where an auctioneer is interested in buying resources or services from a set of agents. Ideally, the auctioneer would like to select a subset of the resources so as to…

Computer Science and Game Theory · Computer Science 2017-10-10 Georgios Amanatidis , Georgios Birmpas , Evangelos Markakis

Submodular functions have found a wealth of new applications in data science and machine learning models in recent years. This has been coupled with many algorithmic advances in the area of submodular optimization: (SO) $\min/\max~f(S): S…

Data Structures and Algorithms · Computer Science 2019-08-23 Richard Santiago , F. Bruce Shepherd