English
Related papers

Related papers: How to Catch L_2-Heavy-Hitters on Sliding Windows

200 papers

We consider time-space tradeoffs for exactly computing frequency moments and order statistics over sliding windows. Given an input of length 2n-1, the task is to output the function of each window of length n, giving n outputs in total.…

Computational Complexity · Computer Science 2013-09-19 Paul Beame , Raphael Clifford , Widad Machmouchi

Discovering frequent episodes over event sequences is an important data mining task. In many applications, events constituting the data sequence arrive as a stream, at furious rates, and recent trends (or frequent episodes) can change and…

Machine Learning · Computer Science 2012-05-22 Debprakash Patnaik , Naren Ramakrishnan , Srivatsan Laxman , Badrish Chandramouli

The distinct elements problem is one of the fundamental problems in streaming algorithms --- given a stream of integers in the range $\{1,\ldots,n\}$, we wish to provide a $(1+\varepsilon)$ approximation to the number of distinct elements…

Data Structures and Algorithms · Computer Science 2019-01-07 Jarosław Błasiok

We initiate a broad study of classical problems in the streaming model with insertions and deletions in the setting where we allow the approximation factor $\alpha$ to be much larger than $1$. Such algorithms can use significantly less…

Data Structures and Algorithms · Computer Science 2022-07-19 Yi Li , Honghao Lin , David P. Woodruff , Yuheng Zhang

Large Language Models (LLMs) have significantly impacted many facets of natural language processing and information retrieval. Unlike previous encoder-based approaches, the enlarged context window of these generative models allows for…

Information Retrieval · Computer Science 2024-05-24 Andrew Parry , Sean MacAvaney , Debasis Ganguly

Sliding super point is a special host defined under sliding time window with which there are huge other hosts contact. It plays important roles in network security and management. But how to detect them in real time from nowadays high-speed…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-30 Jie Xu

Detecting frequent elements is among the oldest and most-studied problems in the area of data streams. Given a stream of $m$ data items in $\{1, 2, \dots, n\}$, the objective is to output items that appear at least $d$ times, for some…

Data Structures and Algorithms · Computer Science 2021-02-16 Christian Konrad

Duplicate detection is the problem of identifying whether a given item has previously appeared in a (possibly infinite) stream of data, when only a limited amount of memory is available. Unfortunately the infinite stream setting is…

Data Structures and Algorithms · Computer Science 2020-05-12 Rémi Géraud-Stewart , Marius Lombard-Platet , David Naccache

In this paper we study how to perform distinct sampling in the streaming model where data contain near-duplicates. The goal of distinct sampling is to return a distinct element uniformly at random from the universe of elements, given that…

Data Structures and Algorithms · Computer Science 2018-10-31 Jiecao Chen , Qin Zhang

Motivated by recent work on the experts problem in the streaming model, we consider the experts problem in the sliding window model. The sliding window model is a well-studied model that captures applications such as traffic monitoring,…

Machine Learning · Statistics 2026-01-08 Vladimir Braverman , Sumegha Garg , Chen Wang , David P. Woodruff , Samson Zhou

Optimization of non-convex loss surfaces containing many local minima remains a critical problem in a variety of domains, including operations research, informatics, and material design. Yet, current techniques either require extremely high…

Machine Learning · Computer Science 2021-07-21 Amil Merchant , Luke Metz , Sam Schoenholz , Ekin Dogus Cubuk

Distributed Denial of Service (DDoS) attacks have become more prominent recently, both in frequency of occurrence, as well as magnitude. Such attacks render key Internet resources unavailable and disrupt its normal operation. It is…

Cryptography and Security · Computer Science 2014-12-22 Michael Kallitsis , Stilian Stoev , George Michailidis

Large Language Models (LLMs) have shown exciting performance in listwise passage ranking. Due to the limited input length, existing methods often adopt the sliding window strategy. Such a strategy, though effective, is inefficient as it…

Information Retrieval · Computer Science 2024-12-20 Wenhan Liu , Xinyu Ma , Yutao Zhu , Ziliang Zhao , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Motivated by the prevalence and success of machine learning, a line of recent work has studied learning-augmented algorithms in the streaming model. These results have shown that for natural and practical oracles implemented with machine…

Data Structures and Algorithms · Computer Science 2026-03-04 Soham Nagawanshi , Shalini Panthangi , Chen Wang , David P. Woodruff , Samson Zhou

Sliding-window aggregation is a foundational stream processing primitive that efficiently summarizes recent data. The state-of-the-art algorithms for sliding-window aggregation are highly efficient when stream data items are evicted or…

Databases · Computer Science 2023-10-03 Kanat Tangwongsan , Martin Hirzel , Scott Schneider

We study the space complexity of the following problem: For a fixed regular language $L$, we receive a stream of symbols and want to test membership of a sliding window of size $n$ in $L$. For deterministic streaming algorithms we prove a…

Formal Languages and Automata Theory · Computer Science 2025-03-12 Moses Ganardi , Danny Hucke , Markus Lohrey , Konstantinos Mamouras , Tatiana Starikovskaya

Large, distributed data streams are now ubiquitous. High-accuracy sketches with low memory overhead have become the de facto method for analyzing this data. For instance, if we wish to group data by some label and report the largest counts…

Data Structures and Algorithms · Computer Science 2024-02-14 Homin K. Lee , Charles Masson

Data streams typically have items of large number of dimensions. We study the fundamental heavy-hitters problem in this setting. Formally, the data stream consists of $d$-dimensional items $x_1,\ldots,x_m \in [n]^d$. A $k$-dimensional…

Data Structures and Algorithms · Computer Science 2018-02-22 Branislav Kveton , S. Muthukrishnan , Hoa T. Vu , Yikun Xian

Cosmological N-body simulations are crucial for understanding how the Universe evolves. Studying large-scale distributions of matter in these simulations and comparing them to observations usually involves detecting dense clusters of…

Astrophysics of Galaxies · Physics 2019-12-25 Aidan Reilly , Nikita Ivkin , Gerard Lemson , Vladimir Braverman , Alexander Szalay

The proliferation of sensing and monitoring applications motivates adoption of the event stream model of computation. Though sliding windows are widely used to facilitate effective event stream processing, it is greatly challenged when the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-11-15 Yiling Yang , Yu Huang , Jiannong Cao , Xiaoxing Ma , Jian Lu