English

RPS: A Generic Reservoir Patterns Sampler

Machine Learning 2024-11-04 v1 Artificial Intelligence Combinatorics Probability

Abstract

Efficient learning from streaming data is important for modern data analysis due to the continuous and rapid evolution of data streams. Despite significant advancements in stream pattern mining, challenges persist, particularly in managing complex data streams like sequential and weighted itemsets. While reservoir sampling serves as a fundamental method for randomly selecting fixed-size samples from data streams, its application to such complex patterns remains largely unexplored. In this study, we introduce an approach that harnesses a weighted reservoir to facilitate direct pattern sampling from streaming batch data, thus ensuring scalability and efficiency. We present a generic algorithm capable of addressing temporal biases and handling various pattern types, including sequential, weighted, and unweighted itemsets. Through comprehensive experiments conducted on real-world datasets, we evaluate the effectiveness of our method, showcasing its ability to construct accurate incremental online classifiers for sequential data. Our approach not only enables previously unusable online machine learning models for sequential data to achieve accuracy comparable to offline baselines but also represents significant progress in the development of incremental online sequential itemset classifiers.

Keywords

Cite

@article{arxiv.2411.00074,
  title  = {RPS: A Generic Reservoir Patterns Sampler},
  author = {Lamine Diop and Marc Plantevit and Arnaud Soulet},
  journal= {arXiv preprint arXiv:2411.00074},
  year   = {2024}
}

Comments

Accepted at 2024 IEEE International Conference on Big Data

R2 v1 2026-06-28T19:43:26.843Z