English
Related papers

Related papers: Approximate Modularity Revisited

200 papers

We study the problem of selecting a subset of vectors from a large set, to obtain the best signal representation over a family of functions. Although greedy methods have been widely used for tackling this problem and many of those have been…

Signal Processing · Electrical Eng. & Systems 2023-05-16 Ehsan Tohidi , Mario Coutino , David Gesbert

In many machine learning applications, one needs to interactively select a sequence of items (e.g., recommending movies based on a user's feedback) or make sequential decisions in a certain order (e.g., guiding an agent through a series of…

Machine Learning · Computer Science 2019-06-21 Marko Mitrovic , Ehsan Kazemi , Moran Feldman , Andreas Krause , Amin Karbasi

We introduce the concept of quotient-convergence for sequences of submodular set functions, providing, among others, a new framework for the study of convergence of matroids through their rank functions. Extending the limit theory of…

Combinatorics · Mathematics 2024-06-17 Kristóf Bérczi , Márton Borbényi , László Lovász , László Márton Tóth

We demonstrate the usefulness of submodularity in statistics as a characterization of the difficulty of the \emph{search} problem of feature selection. The search problem is the ability of a procedure to identify an informative set of…

Statistics Theory · Mathematics 2016-05-16 Kory D. Johnson , Robert A. Stine , Dean P. Foster

We study the fundamental problem of selecting optimal features for model construction. This problem is computationally challenging on large datasets, even with the use of greedy algorithm variants. To address this challenge, we extend the…

We investigate the approximability of several classes of real-valued functions by functions of a small number of variables ({\em juntas}). Our main results are tight bounds on the number of variables required to approximate a function…

Data Structures and Algorithms · Computer Science 2015-03-31 Vitaly Feldman , Jan Vondrak

We define the supermodular rank of a function on a lattice. This is the smallest number of terms needed to decompose it into a sum of supermodular functions. The supermodular summands are defined with respect to different partial orders. We…

Combinatorics · Mathematics 2023-05-25 Rishi Sonthalia , Anna Seigal , Guido Montufar

Can we effectively learn a nonlinear representation in time comparable to linear learning? We describe a new algorithm that explicitly and adaptively expands higher-order interaction features over base linear representations. The algorithm…

Machine Learning · Computer Science 2014-10-03 Alekh Agarwal , Alina Beygelzimer , Daniel Hsu , John Langford , Matus Telgarsky

Submodular maximization is a general optimization problem with a wide range of applications in machine learning (e.g., active learning, clustering, and feature selection). In large-scale optimization, the parallel running time of an…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

In many real-world applications, reinforcement learning (RL) agents might have to solve multiple tasks, each one typically modeled via a reward function. If reward functions are expressed linearly, and the agent has previously learned a set…

Machine Learning · Computer Science 2022-06-24 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

In this paper we provide improved running times and oracle complexities for approximately minimizing a submodular function. Our main result is a randomized algorithm, which given any submodular function defined on $n$-elements with range…

Data Structures and Algorithms · Computer Science 2019-09-11 Brian Axelrod , Yang P. Liu , Aaron Sidford

We introduce the problem of maximizing approximately $k$-submodular functions subject to size constraints. In this problem, one seeks to select $k$-disjoint subsets of a ground set with bounded total size or individual sizes, and maximum…

Data Structures and Algorithms · Computer Science 2021-01-19 Leqian Zheng , Hau Chan , Grigorios Loukides , Minming Li

We describe several infinite series of rational conformal field theories whose conformal characters are modular units, i.e. which are modular functions having no zeros or poles in the upper complex half plane, and which thus possess simple…

High Energy Physics - Theory · Physics 2009-10-30 Wolfgang Eholzer , Nils-Peter Skoruppa

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

Holomorphic almost modular forms are holomorphic functions of the complex upper half plane which can be approximated arbitrarily well (in a suitable sense) by modular forms of congruence subgroups of large index in $\SL(2,\ZZ)$. It is…

Number Theory · Mathematics 2010-05-21 Jens Marklof

Approximations of functions with finite data often do not respect certain "structural" properties of the functions. For example, if a given function is non-negative, a polynomial approximation of the function is not necessarily also…

Numerical Analysis · Mathematics 2020-08-20 Vidhi Zala , Robert M. Kirby , Akil Narayan

When model predictions inform downstream decision making, a natural question is under what conditions can the decision-makers simply respond to the predictions as if they were the true outcomes. Calibration suffices to guarantee that simple…

Machine Learning · Computer Science 2025-04-23 Jingwu Tang , Jiayun Wu , Zhiwei Steven Wu , Jiahao Zhang

The simplex algorithm for linear programming is based on the fact that any local optimum with respect to the polyhedral neighborhood is also a global optimum. We show that a similar result carries over to submodular maximization. In…

Data Structures and Algorithms · Computer Science 2017-12-01 Simon Bruggmann , Rico Zenklusen

We present connections between the recent literature on multigroup fairness for prediction algorithms and classical results in computational complexity. Multiaccurate predictors are correct in expectation on each member of an arbitrary…

Computational Complexity · Computer Science 2024-07-30 Sílvia Casacuberta , Cynthia Dwork , Salil Vadhan

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive…

Numerical Analysis · Mathematics 2019-03-27 Yuhan Ding , Fred J. Hickernell , Peter Kritzer , Simon Mak