English
Related papers

Related papers: Streaming Methods for Restricted Strongly Convex F…

200 papers

We consider the classical problem of maximizing a monotone submodular function subject to a cardinality constraint, which, due to its numerous applications, has recently been studied in various computational models. We consider a clean…

Data Structures and Algorithms · Computer Science 2020-03-31 Moran Feldman , Ashkan Norouzi-Fard , Ola Svensson , Rico Zenklusen

In this paper, we introduce adversarially robust streaming algorithms for central machine learning and algorithmic tasks, such as regression and clustering, as well as their more general counterparts, subspace embedding, low-rank…

Machine Learning · Computer Science 2021-10-27 Vladimir Braverman , Avinatan Hassidim , Yossi Matias , Mariano Schain , Sandeep Silwal , Samson Zhou

Many string processing problems can be phrased in the streaming setting, where the input arrives symbol by symbol and we have sublinear working space. The area of streaming algorithms for string processing has flourished since the seminal…

Data Structures and Algorithms · Computer Science 2026-04-22 Panagiotis Charalampopoulos , Taha El Ghazi , Jonas Ellert , Paweł Gawrychowski , Tatiana Starikovskaya

Maximizing monotone submodular functions under cardinality constraints is a classic optimization task with several applications in data mining and machine learning. In this paper we study this problem in a dynamic environment with…

Data Structures and Algorithms · Computer Science 2024-05-31 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Streaming submodular maximization is a natural model for the task of selecting a representative subset from a large-scale dataset. If datapoints have sensitive attributes such as gender or race, it becomes important to enforce fairness to…

Machine Learning · Computer Science 2025-11-25 Marwa El Halabi , Federico Fusco , Ashkan Norouzi-Fard , Jakab Tardos , Jakub Tarnawski

We explore the use of local algorithms in the design of streaming algorithms for the Maximum Directed Cut problem. Specifically, building on the local algorithm of Buchbinder et al. (FOCS'12) and Censor-Hillel et al. (ALGOSENSORS'17), we…

Data Structures and Algorithms · Computer Science 2024-12-02 Raghuvansh R. Saxena , Noah G. Singer , Madhu Sudan , Santhoshini Velusamy

Many tasks in machine learning and data mining, such as data diversification, non-parametric learning, kernel machines, clustering etc., require extracting a small but representative summary from a massive dataset. Often, such problems can…

Machine Learning · Computer Science 2018-09-17 Ashkan Norouzi-Fard , Jakub Tarnawski , Slobodan Mitrović , Amir Zandieh , Aida Mousavifar , Ola Svensson

Stimulated by practical applications arising from viral marketing. This paper investigates a novel Budgeted $k$-Submodular Maximization problem defined as follows: Given a finite set $V$, a budget $B$ and a $k$-submodular function $f:…

Data Structures and Algorithms · Computer Science 2021-10-25 Canh V. Pham , Quang C. Vu , Dung K. T. Ha , Tai T. Nguyen

We introduce a streaming framework for analyzing stochastic approximation/optimization problems. This streaming framework is analogous to solving optimization problems using time-varying mini-batches that arrive sequentially. We provide…

Machine Learning · Computer Science 2023-04-25 Antoine Godichon-Baggioni , Nicklas Werge , Olivier Wintenberger

Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation…

Machine Learning · Computer Science 2019-05-07 Andrew An Bian , Baharan Mirzasoleiman , Joachim M. Buhmann , Andreas Krause

We study the problem of maximizing a non-monotone submodular function subject to a cardinality constraint in the streaming model. Our main contribution is a single-pass (semi-)streaming algorithm that uses roughly $O(k / \varepsilon^2)$…

Data Structures and Algorithms · Computer Science 2020-08-11 Naor Alaluf , Alina Ene , Moran Feldman , Huy L. Nguyen , Andrew Suh

We propose the first adversarially robust algorithm for monotone submodular maximization under single and multiple knapsack constraints with scalable implementations in distributed and streaming settings. For a single knapsack constraint,…

Data Structures and Algorithms · Computer Science 2019-05-08 Dmitrii Avdiukhin , Slobodan Mitrović , Grigory Yaroslavtsev , Samson Zhou

Diversity maximization is a fundamental problem with wide applications in data summarization, web search, and recommender systems. Given a set $X$ of $n$ elements, it asks to select a subset $S$ of $k \ll n$ elements with maximum…

Data Structures and Algorithms · Computer Science 2023-04-27 Yanhao Wang , Francesco Fabbri , Michael Mathioudakis

We study high-dimensional robust statistics tasks in the streaming model. A recent line of work obtained computationally efficient algorithms for a range of high-dimensional robust estimation tasks. Unfortunately, all previous algorithms…

Data Structures and Algorithms · Computer Science 2023-05-04 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

In this paper we consider the problem of maximizing a non-negative submodular function subject to a cardinality constraint in the data stream model. Previously, the best known algorithm for this problem was a $5.828$-approximation…

Data Structures and Algorithms · Computer Science 2019-06-27 Naor Alaluf , Moran Feldman

In this thesis, we explore streaming algorithms for approximating constraint satisfaction problems (CSPs). The setup is roughly the following: A computer has limited memory space, sees a long "stream" of local constraints on a set of…

Data Structures and Algorithms · Computer Science 2023-04-14 Noah G. Singer

In this paper, we study streaming and online algorithms in the context of randomness in the input. For several problems, a random order of the input sequence---as opposed to the worst-case order---appears to be a necessary evil in order to…

Data Structures and Algorithms · Computer Science 2020-04-28 Paritosh Garg , Sagar Kale , Lars Rohwedder , Ola Svensson

We investigate the adversarial robustness of streaming algorithms. In this context, an algorithm is considered robust if its performance guarantees hold even if the stream is chosen adaptively by an adversary that observes the outputs of…

Data Structures and Algorithms · Computer Science 2022-07-04 Omri Ben-Eliezer , Rajesh Jayaram , David P. Woodruff , Eylon Yogev

We consider maximizing a monotone submodular function under a cardinality constraint or a knapsack constraint in the streaming setting. In particular, the elements arrive sequentially and at any point of time, the algorithm has access to…

Data Structures and Algorithms · Computer Science 2018-02-20 Chien-Chung Huang , Naonori Kakimura