English
Related papers

Related papers: A Strong Separation for Adversarially Robust $\ell…

200 papers

Estimating the number of subgraphs in data streams is a fundamental problem that has received great attention in the past decade. In this paper, we give improved streaming algorithms for approximately counting the number of occurrences of…

Data Structures and Algorithms · Computer Science 2022-03-29 Hendrik Fichtenberger , Pan Peng

We introduce a new sub-linear space sketch---the Weight-Median Sketch---for learning compressed linear classifiers over data streams while supporting the efficient recovery of large-magnitude weights in the model. This enables…

Machine Learning · Computer Science 2018-04-10 Kai Sheng Tai , Vatsal Sharan , Peter Bailis , Gregory Valiant

Graph sketching has emerged as a powerful technique for processing massive graphs that change over time (i.e., are presented as a dynamic stream of edge updates) over the past few years, starting with the work of Ahn, Guha and McGregor…

Data Structures and Algorithms · Computer Science 2019-03-29 Michael Kapralov , Aida Mousavifar , Cameron Musco , Christopher Musco , Navid Nouri

We present an algorithm for the maximum matching problem in dynamic (insertion-deletions) streams with *asymptotically optimal* space complexity: for any $n$-vertex graph, our algorithm with high probability outputs an $\alpha$-approximate…

Data Structures and Algorithms · Computer Science 2022-02-01 Sepehr Assadi , Vihan Shah

In recent years, many efforts have demonstrated that modern machine learning algorithms are vulnerable to adversarial attacks, where small, but carefully crafted, perturbations on the input can make them fail. While these attack methods are…

Cryptography and Security · Computer Science 2019-06-25 Yuan Gong , Boyang Li , Christian Poellabauer , Yiyu Shi

Adaptive sampling is a useful algorithmic tool for data summarization problems in the classical centralized setting, where the entire dataset is available to the single processor performing the computation. Adaptive sampling repeatedly…

Data Structures and Algorithms · Computer Science 2020-04-24 Sepideh Mahabadi , Ilya Razenshteyn , David P. Woodruff , Samson Zhou

Given a stream of graph edges from a dynamic graph, how can we assign anomaly scores to edges and subgraphs in an online manner, for the purpose of detecting unusual behavior, using constant time and memory? For example, in intrusion…

Data Structures and Algorithms · Computer Science 2023-07-18 Siddharth Bhatia , Mohit Wadhwa , Kenji Kawaguchi , Neil Shah , Philip S. Yu , Bryan Hooi

Anomaly detection is critical for finding suspicious behavior in innumerable systems. We need to detect anomalies in real-time, i.e. determine if an incoming entity is anomalous or not, as soon as we receive it, to minimize the effects of…

Machine Learning · Computer Science 2023-01-31 Siddharth Bhatia

Making calibrated online predictions is a central challenge in modern AI systems. Much of the existing literature focuses on fully adversarial environments where outcomes may be arbitrary, leading to conservative algorithms that can perform…

Machine Learning · Computer Science 2026-05-25 Junyan Liu , Haipeng Luo , Lillian J. Ratliff

We improve upon previous oblivious sketching and turnstile streaming results for $\ell_1$ and logistic regression, giving a much smaller sketching dimension achieving $O(1)$-approximation and yielding an efficient optimization problem in…

Data Structures and Algorithms · Computer Science 2023-04-05 Alexander Munteanu , Simon Omlor , David Woodruff

Many dynamic applications are built upon large network infrastructures, such as social networks, communication networks, biological networks and the Web. Such applications create data that can be naturally modeled as graph streams, in which…

Databases · Computer Science 2011-12-01 Peixiang Zhao , Charu C. Aggarwal , Min Wang

We develop a new algorithmic technique that allows to transfer some constant time approximation algorithms for general graphs into random order streaming algorithms. We illustrate our technique by proving that in random order streams with…

Data Structures and Algorithms · Computer Science 2017-11-15 Pan Peng , Christian Sohler

Approximating quantiles and distributions over streaming data has been studied for roughly two decades now. Recently, Karnin, Lang, and Liberty proposed the first asymptotically optimal algorithm for doing so. This manuscript complements…

Data Structures and Algorithms · Computer Science 2019-07-02 Nikita Ivkin , Edo Liberty , Kevin Lang , Zohar Karnin , Vladimir Braverman

In this paper, we study linear programming based approaches to the maximum matching problem in the semi-streaming model. The semi-streaming model has gained attention as a model for processing massive graphs as the importance of such graphs…

Data Structures and Algorithms · Computer Science 2015-03-19 Kook Jin Ahn , Sudipto Guha

Stochastic optimization methods encounter new challenges in the realm of streaming, characterized by a continuous flow of large, high-dimensional data. While first-order methods, like stochastic gradient descent, are the natural choice,…

Statistics Theory · Mathematics 2024-02-02 Antoine Godichon-Baggioni , Nicklas Werge

Large-batch Contrastive Learning (CL), the foundation of modern representation learning, is fundamentally incompatible with the volatile resource constraints of edge devices. This conflict creates a dilemma: small on-device batches degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-27 Minh K. Quan , Pubudu N. Pathirana

Tracking and approximating data matrices in streaming fashion is a fundamental challenge. The problem requires more care and attention when data comes from multiple distributed sites, each receiving a stream of data. This paper considers…

Databases · Computer Science 2014-05-01 Mina Ghashami , Jeff M. Phillips , Feifei Li

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

Data Structures and Algorithms · Computer Science 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

Adversarially robust streaming algorithms are required to process a stream of elements and produce correct outputs, even when each stream element can be chosen as a function of earlier algorithm outputs. As with classic streaming…

Data Structures and Algorithms · Computer Science 2024-07-04 Amit Chakrabarti , Manuel Stoeckl

Streaming algorithms are typically analyzed in the oblivious setting, where we assume that the input stream is fixed in advance. Recently, there is a growing interest in designing adversarially robust streaming algorithms that must maintain…

Data Structures and Algorithms · Computer Science 2023-01-24 Menachem Sadigurschi , Moshe Shechner , Uri Stemmer