English
Related papers

Related papers: Scalable Greedy Feature Selection via Weak Submodu…

200 papers

We study the problem of estimating a random process from the observations collected by a network of sensors that operate under resource constraints. When the dynamics of the process and sensor observations are described by a state-space…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

For many optimization problems in machine learning, finding an optimal solution is computationally intractable and we seek algorithms that perform well in practice. Since computational intractability often results from pathological…

Machine Learning · Computer Science 2021-02-25 Eric Balkanski , Sharon Qian , Yaron Singer

This paper describes a simple greedy D-approximation algorithm for any covering problem whose objective function is submodular and non-decreasing, and whose feasible region can be expressed as the intersection of arbitrary (closed upwards)…

Data Structures and Algorithms · Computer Science 2015-06-02 Christos Koufogiannakis , Neal E. Young

We introduce the problem of maximizing approximately $k$-submodular functions subject to size constraints. In this problem, one seeks to select $k$-disjoint subsets of a ground set with bounded total size or individual sizes, and maximum…

Data Structures and Algorithms · Computer Science 2021-01-19 Leqian Zheng , Hau Chan , Grigorios Loukides , Minming Li

Simultaneous operation of all sensors in a large-scale sensor network is power-consuming and computationally expensive. Hence, it is desirable to select fewer sensors. A greedy algorithm is widely used for sensor selection in homogeneous…

Signal Processing · Electrical Eng. & Systems 2024-05-24 Kaushani Majumder , SibiRaj B. Pillai , Satish Mulleti

We study a fundamental problem in Bayesian learning, where the goal is to select a set of data sources with minimum cost while achieving a certain learning performance based on the data streams provided by the selected data sources. First,…

Machine Learning · Computer Science 2021-05-04 Lintao Ye , Aritra Mitra , Shreyas Sundaram

Submodular optimization plays a key role in many real-world problems. In many real-world scenarios, it is also necessary to handle uncertainty, and potentially disruptive events that violate constraints in stochastic settings need to be…

Machine Learning · Computer Science 2019-11-27 Benjamin Doerr , Carola Doerr , Aneta Neumann , Frank Neumann , Andrew M. Sutton

To cope with the high level of ambiguity faced in domains such as Computer Vision or Natural Language processing, robust prediction methods often search for a diverse set of high-quality candidate solutions or proposals. In structured…

Machine Learning · Computer Science 2014-11-10 Adarsh Prasad , Stefanie Jegelka , Dhruv Batra

We consider classes of objective functions of cardinality constrained maximization problems for which the greedy algorithm guarantees a constant approximation. We propose the new class of $\gamma$-$\alpha$-augmentable functions and prove…

Discrete Mathematics · Computer Science 2022-10-05 Yann Disser , David Weckbecker

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

We study the problem of maximizing a submodular function, subject to a cardinality constraint, with a set of agents communicating over a connected graph. We propose a distributed greedy algorithm that allows all the agents to converge to a…

Optimization and Control · Mathematics 2020-09-29 Lintao Ye , Shreyas Sundaram

The problem of selecting a small-size representative summary of a large dataset is a cornerstone of machine learning, optimization and data science. Motivated by applications to recommendation systems and other scenarios with query-limited…

Data Structures and Algorithms · Computer Science 2019-10-15 Dmitrii Avdiukhin , Grigory Yaroslavtsev , Samson Zhou

We provide theoretical bounds on the worst case performance of the greedy algorithm in seeking to maximize a normalized, monotone, but not necessarily submodular objective function under a simple partition matroid constraint. We also…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Benjamin Biggs , James McMahon , Philip Baldoni , Daniel J. Stilwell

A $k$-submodular function is a generalization of the submodular set function. Many practical applications can be modeled as maximizing a $k$-submodular function, such as multi-cooperative games, sensor placement with $k$ type sensors,…

Combinatorics · Mathematics 2023-12-13 Hongyang Zhang , Wenchang Luo

We study influence maximization on temporal networks. This is a special setting where the influence function is not submodular, and there is no optimality guarantee for solutions achieved via greedy optimization. We perform an exhaustive…

Physics and Society · Physics 2022-09-05 Sirag Erkol , Dario Mazzilli , Filippo Radicchi

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

A fundamental task underlying many important optimization problems, from influence maximization to sensor placement to content recommendation, is to select the optimal group of $k$ items from a larger set. Submodularity has been very…

Data Structures and Algorithms · Computer Science 2022-03-02 Jon Kleinberg , Emily Ryu , Éva Tardos

We propose and analyze batch greedy heuristics for cardinality constrained maximization of non-submodular non-decreasing set functions. We consider the standard greedy paradigm, along with its distributed greedy and stochastic greedy…

Optimization and Control · Mathematics 2021-08-12 Jayanth Jagalur-Mohan , Youssef Marzouk