English
Related papers

Related papers: Distributed Submodular Minimization over Networks:…

200 papers

Greedy algorithms are widely used for problems in machine learning such as feature selection and set function optimization. Unfortunately, for large datasets, the running time of even greedy algorithms can be quite high. This is because for…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban , Joydeep Ghosh

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality…

Data Structures and Algorithms · Computer Science 2026-02-19 Ajitesh Srivastava , Shanghua Teng

We study the problem of selecting a subset of vectors from a large set, to obtain the best signal representation over a family of functions. Although greedy methods have been widely used for tackling this problem and many of those have been…

Signal Processing · Electrical Eng. & Systems 2023-05-16 Ehsan Tohidi , Mario Coutino , David Gesbert

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue of convexity, is…

Machine Learning · Computer Science 2025-04-04 Maximilian Böther , Abraham Sebastian , Pranjal Awasthi , Ana Klimovic , Srikumar Ramalingam

In this paper, we demonstrate a formulation for optimizing coupled submodular maximization problems with provable sub-optimality bounds. In robotics applications, it is quite common that optimization problems are coupled with one another…

Robotics · Computer Science 2021-11-19 Jun Liu , Ryan K. Williams

We study a class of nested path problems, in which every path-based variable can be decomposed into a sequence of subpaths. Subpaths must satisfy local resources, while paths must satisfy additional global resources. This paper develops a…

Optimization and Control · Mathematics 2026-05-28 Bart van Rossum , Rolf van Lieshout , Alexandre Jacquillat

There are many problems in machine learning and data mining which are equivalent to selecting a non-redundant, high "quality" set of objects. Recommender systems, feature selection, and data summarization are among many applications of…

Machine Learning · Computer Science 2019-04-19 Mehrdad Ghadiri , Mark Schmidt

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

We provide theoretical bounds on the worst case performance of the greedy algorithm in seeking to maximize a normalized, monotone, but not necessarily submodular objective function under a simple partition matroid constraint. We also…

Systems and Control · Electrical Eng. & Systems 2022-10-19 Benjamin Biggs , James McMahon , Philip Baldoni , Daniel J. Stilwell

This paper proposes a distributed algorithm for a network of agents to solve an optimization problem with separable objective function and locally coupled constraints. Our strategy is based on reformulating the original constrained problem…

Optimization and Control · Mathematics 2021-03-12 Priyank Srivastava , Jorge Cortes

We study the matroid secretary problems with submodular valuation functions. In these problems, the elements arrive in random order. When one element arrives, we have to make an immediate and irrevocable decision on whether to accept it or…

Data Structures and Algorithms · Computer Science 2013-02-27 Tengyu Ma , Bo Tang , Yajun Wang

This paper presents a novel Jacobi-style iteration algorithm for solving the problem of distributed submodular maximization, in which each agent determines its own strategy from a finite set so that the global submodular objective function…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Bin Du , Kun Qian , Christian Claudel , Dengfeng Sun

Submodular optimization has received significant attention in both practice and theory, as a wide array of problems in machine learning, auction theory, and combinatorial optimization have submodular structure. In practice, these problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-04 Paul Liu , Jan Vondrak

We study the problem of estimating a random process from the observations collected by a network of sensors that operate under resource constraints. When the dynamics of the process and sensor observations are described by a state-space…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

Submodular optimization plays a key role in many real-world problems. In many real-world scenarios, it is also necessary to handle uncertainty, and potentially disruptive events that violate constraints in stochastic settings need to be…

Machine Learning · Computer Science 2019-11-27 Benjamin Doerr , Carola Doerr , Aneta Neumann , Frank Neumann , Andrew M. Sutton

The team formation and routing problem is a challenging optimization problem with several real-world applications in fields such as airport, healthcare, and maintenance operations. To solve this problem, exact solution methods based on…

Machine Learning · Computer Science 2025-09-22 Giacomo Dall'Olio , Rainer Kolisch , Yaoxin Wu

A $k$-submodular function is a generalization of the submodular set function. Many practical applications can be modeled as maximizing a $k$-submodular function, such as multi-cooperative games, sensor placement with $k$ type sensors,…

Combinatorics · Mathematics 2023-12-13 Hongyang Zhang , Wenchang Luo

We investigate the performance of a deterministic GREEDY algorithm for the problem of maximizing functions under a partition matroid constraint. We consider non-monotone submodular functions and monotone subadditive functions. Even though…

Discrete Mathematics · Computer Science 2019-02-22 Tobias Friedrich , Andreas Göbel , Frank Neumann , Francesco Quinzan , Ralf Rothenberger