中文
相关论文

相关论文: New Algorithms for Heavy Hitters in Data Streams

200 篇论文

We consider the problem of detecting a few targets among a large number of hierarchical data streams. The data streams are modeled as random processes with unknown and potentially heavy-tailed distributions. The objective is an active…

机器学习 · 计算机科学 2017-09-13 Sattar Vakili , Qing Zhao , Chang Liu , Chen-Nee Chuah

We present two new local differentially private algorithms for frequency estimation. One solves the fundamental frequency oracle problem; the other solves the well-known heavy hitters identification problem. Consistent with prior art, these…

数据结构与算法 · 计算机科学 2022-02-18 Hao Wu , Anthony Wirth

This work consists of a study of a set of techniques and strategies related with algorithm's design, whose purpose is the resolution of problems on massive data sets, in an efficient way. This field is known as Algorithms for Big Data. In…

数据结构与算法 · 计算机科学 2017-08-29 Sergio García Prado

Identifying the "heavy hitter" flows or flows with large traffic volumes in the data plane is important for several applications e.g., flow-size aware routing, DoS detection, and traffic engineering. However, measurement in the data plane…

网络与互联网体系结构 · 计算机科学 2017-07-20 Vibhaalakshmi Sivaraman , Srinivas Narayana , Ori Rottenstreich , S. Muthukrishnan , Jennifer Rexford

We consider the fundamental problem of selecting $k$ out of $n$ random variables in a way that the expected highest or second-highest value is maximized. This question captures several applications where we have uncertainty about the…

计算机科学与博弈论 · 计算机科学 2020-12-16 Aranyak Mehta , Uri Nadav , Alexandros Psomas , Aviad Rubinstein

Finding high-importance patterns in data is an emerging data mining task known as High-utility itemset mining (HUIM). Given a minimum utility threshold, a HUIM algorithm extracts all the high-utility itemsets (HUIs) whose utility values are…

数据库 · 计算机科学 2023-03-28 Shan Huang , Wensheng Gan , Jinbao Miao , Xuming Han , Philippe Fournier-Viger

In the recent decade companies started collecting of large amount of data. Without a proper analyse, the data are usually useless. The field of analysing the data is called data mining. Unfortunately, the amount of data is quite large: the…

数据库 · 计算机科学 2021-08-12 Robert Kessl

We consider the problem of discovering sequential patterns from event-based spatio-temporal data. The dataset is described by a set of event types and their instances. Based on the given dataset, the task is to discover all significant…

数据库 · 计算机科学 2017-07-04 Piotr S. Maciąg

The Basic Counting problem [1] is one of the most fundamental and critical streaming problems of sliding window queries over data streams. Given a stream of 0's and 1's, the purpose of this problem is to estimate the number of 1's in the…

数据结构与算法 · 计算机科学 2019-12-10 Shuhao Sun , Dagang Li

The ability to detect, in real-time, heavy hitters is beneficial to many network applications, such as DoS and anomaly detection. Through programmable languages as P4, heavy hitter detection can be implemented directly in the data-plane,…

网络与互联网体系结构 · 计算机科学 2019-02-20 Belma Turkovic , Jorik Oostenbrink , Fernando Kuipers

Knowledge discovery in databases aims at finding useful information, which can be deployed for decision making. The problem of high utility itemset mining has specifically garnered huge research focus in the past decade, as it aims to find…

数据库 · 计算机科学 2023-08-30 Pushp , Satish Chand

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

数据结构与算法 · 计算机科学 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

Intervals have been generated in many applications (e.g., temporal databases), and they are often associated with weights, such as prices. This paper addresses the problem of processing top-k weighted stabbing queries on interval data.…

数据库 · 计算机科学 2024-05-24 Daichi Amagata , Junya Yamada , Yuchen Ji , Takahiro Hara

Due to the rapid development of science and technology, the importance of imprecise, noisy, and uncertain data is increasing at an exponential rate. Thus, mining patterns in uncertain databases have drawn the attention of researchers.…

We consider the problems of distributed heavy hitters and frequency moments in both the coordinator model and the distributed tracking model (also known as the distributed functional monitoring model). We present simple and optimal (up to…

数据结构与算法 · 计算机科学 2025-05-21 Zengfeng Huang , Zhongzheng Xiong , Xiaoyi Zhu , Zhewei Wei

Studying the computational complexity of problems is one of the - if not the - fundamental questions in computer science. Yet, surprisingly little is known about the computational complexity of many central problems in data mining. In this…

计算复杂性 · 计算机科学 2017-09-05 Stefan Neumann , Pauli Miettinen

We study algorithms for solving three problems on strings. The first one is the Most Frequently String Search Problem. The problem is the following. Assume that we have a sequence of $n$ strings of length $k$. The problem is finding the…

量子物理 · 物理学 2020-01-08 Kamil Khadiev , Artem Ilikaev

We consider message-efficient continuous random sampling from a distributed stream, where the probability of inclusion of an item in the sample is proportional to a weight associated with the item. The unweighted version, where all weights…

数据结构与算法 · 计算机科学 2019-04-09 Rajesh Jayaram , Gokarna Sharma , Srikanta Tirthapura , David P. Woodruff

With the increasing use of online communication platforms, such as email, twitter, and messaging applications, we are faced with a growing amount of data that combine content (what is said), time (when), and user (by whom) information. An…

社会与信息网络 · 计算机科学 2016-07-05 Han Xiao , Polina Rozenshtein , Aristides Gionis

Motivated by real-life deployments of multi-round federated analytics with secure aggregation, we investigate the fundamental communication-accuracy tradeoffs of the heavy hitter discovery and approximate (open-domain) histogram problems…

数据结构与算法 · 计算机科学 2023-07-26 Adria Gascon , Peter Kairouz , Ziteng Sun , Ananda Theertha Suresh