English
Related papers

Related papers: Optimal Data Selection: An Online Distributed View

200 papers

The task of maximizing a monotone submodular function under a cardinality constraint is at the core of many machine learning and data mining applications, including data summarization, sparse regression and coverage problems. We study this…

Data Structures and Algorithms · Computer Science 2023-05-26 Silvio Lattanzi , Slobodan Mitrović , Ashkan Norouzi-Fard , Jakub Tarnawski , Morteza Zadimoghaddam

In the classical selection problem, the input consists of a collection of elements and the goal is to pick a subset of elements from the collection such that some objective function $f$ is maximized. This problem has been studied…

Data Structures and Algorithms · Computer Science 2021-09-06 Sofia Maria Nikolakaki , Alina Ene , Evimaria Terzi

In this paper, we develop the first one-pass streaming algorithm for submodular maximization that does not evaluate the entire stream even once. By carefully subsampling each element of data stream, our algorithm enjoys the tightest…

Machine Learning · Computer Science 2018-02-21 Moran Feldman , Amin Karbasi , Ehsan Kazemi

Resource allocation problems in many computer systems can be formulated as mathematical optimization problems. However, finding exact solutions to these problems using off-the-shelf solvers in an online setting is often intractable for…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-15 Deepak Narayanan , Fiodar Kazhamiaka , Firas Abuzaid , Peter Kraft , Matei Zaharia

Consider n nodes connected to a single coordinator. Each node receives an individual online data stream of numbers and, at any point in time, the coordinator has to know the k nodes currently observing the largest values, for a given k…

Data Structures and Algorithms · Computer Science 2016-10-28 Alexander Mäcker , Manuel Malatyali , Friedhelm Meyer auf der Heide

Data-driven evolutionary optimization has witnessed great success in solving complex real-world optimization problems. However, existing data-driven optimization algorithms require that all data are centrally stored, which is not always…

Neural and Evolutionary Computing · Computer Science 2021-02-17 Jinjin Xu , Yaochu Jin , Wenli Du , Sai Gu

We study the relationship between the competitive ratio and the tail distribution of randomized online minimization problems. To this end, we define a broad class of online problems that includes some of the well-studied problems like…

Data Structures and Algorithms · Computer Science 2013-02-15 Dennis Komm , Rastislav Královič , Richard Královič , Tobias Mömke

While variable selection is essential to optimize the learning complexity by prioritizing features, automating the selection process is preferred since it requires laborious efforts with intensive analysis otherwise. However, it is not an…

Machine Learning · Computer Science 2019-10-29 Makiya Nakashima , Alex Sim , Youngsoo Kim , Jonghyun Kim , Jinoh Kim

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2021-08-02 Navid Rezazadeh , Solmaz S. Kia

We study the min-cost seed selection problem in online social networks, where the goal is to select a set of seed nodes with the minimum total cost such that the expected number of influenced nodes in the network exceeds a predefined…

Data Structures and Algorithms · Computer Science 2017-12-21 Kai Han , Yuntian He , Xiaokui Xiao , Shaojie Tang , Jingxin Xu , Liusheng Huang

Motivated by applications in digital health, this work studies the novel problem of online uniform sampling (OUS), where the goal is to distribute a sampling budget uniformly across unknown decision times. In the OUS problem, the algorithm…

Machine Learning · Computer Science 2024-10-22 Xueqing Liu , Kyra Gan , Esmaeil Keyvanshokooh , Susan Murphy

Many machine learning approaches are characterized by information constraints on how they interact with the training data. These include memory and sequential access constraints (e.g. fast first-order methods to solve stochastic…

Machine Learning · Computer Science 2014-10-29 Ohad Shamir

Redundant storage maintains the performance of distributed systems under various forms of uncertainty. This paper considers the uncertainty in node access and download service. We consider two access models under two download service…

Information Theory · Computer Science 2021-08-09 Pei Peng , Moslem Noori , Emina Soljanin

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

We study a competitive online optimization problem with multiple inventories. In the problem, an online decision maker seeks to optimize the allocation of multiple capacity-limited inventories over a slotted horizon, while the allocation…

Performance · Computer Science 2022-02-08 Qiulin Lin , Yanfang Mo , Junyan Su , Minghua Chen

Many large-scale machine learning problems--clustering, non-parametric learning, kernel machines, etc.--require selecting a small yet representative subset from a large dataset. Such problems can often be reduced to maximizing a submodular…

Machine Learning · Computer Science 2016-06-28 Baharan Mirzasoleiman , Amin Karbasi , Rik Sarkar , Andreas Krause

Distributed computing excels at processing large scale data, but the communication cost for synchronizing the shared parameters may slow down the overall performance. Fortunately, the interactions between parameter and data in many problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Mu Li , Dave G. Andersen , Alexander J. Smola

Recent years have witnessed an increasing popularity of algorithm design for distributed data, largely due to the fact that massive datasets are often collected and stored in different locations. In the distributed setting communication…

Data Structures and Algorithms · Computer Science 2017-06-06 Sudipto Guha , Yi Li , Qin Zhang

We investigate a data-driven quasiconcave maximization problem where information about the objective function is limited to a finite sample of data points. We begin by defining an ambiguity set for admissible objective functions based on…

Optimization and Control · Mathematics 2026-04-07 Jian Wu , William B. Haskell , Wenjie Huang , Huifu Xu