English
Related papers

Related papers: A new Frequency Estimation Sketch for Data Streams

200 papers

Unaggregated data, in streamed or distributed form, is prevalent and come from diverse application domains which include interactions of users with web services and IP traffic. Data elements have {\em keys} (cookies, users, queries) and…

Information Retrieval · Computer Science 2015-06-30 Edith Cohen

One way of getting a better view of data is using frequent patterns. In this paper frequent patterns are subsets that occur a minimal number of times in a stream of itemsets. However, the discovery of frequent patterns in streams has always…

Artificial Intelligence · Computer Science 2007-05-23 Edgar H. de Graaf , Joost N. Kok , Walter A. Kosters

We introduce features for massive data streams. These stream features can be thought of as "ordered moments" and generalize stream sketches from "moments of order one" to "ordered moments of arbitrary order". In analogy to classic moments,…

Machine Learning · Statistics 2017-09-01 Terry Lyons , Harald Oberhauser

The non-stationary nature of data streams strongly challenges traditional machine learning techniques. Although some solutions have been proposed to extend traditional machine learning techniques for handling data streams, these approaches…

Machine Learning · Computer Science 2021-06-23 Xuyang Yan , Abdollah Homaifar , Mrinmoy Sarkar , Abenezer Girma , Edward Tunstel

Traditional sketch segmentation methods mainly rely on handcrafted features and complicate models, and their performance is far from satisfactory due to the abstract representation of sketches. Recent success of Deep Neural Networks (DNNs)…

Image and Video Processing · Electrical Eng. & Systems 2018-12-31 Fei Wang , Shujin Lin , Hanhui Li , Hefeng Wu , Junkun Jiang , Ruomei Wang , Xiaonan Luo

Counting the frequency of small subgraphs is a fundamental technique in network analysis across various domains, most notably in bioinformatics and social networks. The special case of triangle counting has received much attention. Getting…

Data Structures and Algorithms · Computer Science 2014-11-19 Madhav Jha , C. Seshadhri , Ali Pinar

Through legislation and technical advances users gain more control over how their data is processed, and they expect online services to respect their privacy choices and preferences. However, data may be processed for many different…

Databases · Computer Science 2024-03-19 Dorota Filipczuk , Enrico H. Gerding , George Konstantinidis

Large volume of networked streaming event data are becoming increasingly available in a wide variety of applications, such as social network analysis, Internet traffic monitoring and healthcare analytics. Streaming event data are discrete…

Machine Learning · Computer Science 2016-09-20 Shuang Li , Yao Xie , Mehrdad Farajtabar , Apurv Verma , Le Song

Today's large-scale services (e.g., video streaming platforms, data centers, sensor grids) need diverse real-time summary statistics across multiple subpopulations of multidimensional datasets. However, state-of-the-art frameworks do not…

Databases · Computer Science 2022-08-10 Antonis Manousis , Zhuo Cheng , Ran Ben Basat , Zaoxing Liu , Vyas Sekar

Given a stream $p_1, \ldots, p_m$ of items from a universe $\mathcal{U}$, which, without loss of generality we identify with the set of integers $\{1, 2, \ldots, n\}$, we consider the problem of returning all $\ell_2$-heavy hitters, i.e.,…

Data Structures and Algorithms · Computer Science 2015-11-03 Vladimir Braverman , Stephen R. Chestnut , Nikita Ivkin , David P. Woodruff

Network analysis has played a key role in knowledge discovery and data mining. In many real-world applications in recent years, we are interested in mining multilayer networks, where we have a number of edge sets called layers, which encode…

Social and Information Networks · Computer Science 2022-11-08 Yasushi Kawase , Atsushi Miyauchi , Hanna Sumita

Given real-time sensor data streams obtained from machines, how can we continuously predict when a machine failure will occur? This work aims to continuously forecast the timing of future events by analyzing multi-sensor data streams. A key…

Machine Learning · Computer Science 2026-01-16 Kota Nakamura , Koki Kawabata , Yasuko Matsubara , Yasushi Sakurai

Safety-critical applications such as autonomous vehicles and social robots require fast computation and accurate probability density estimation on trajectory prediction. To address both requirements, this paper presents a new normalizing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Takahiro Maeda , Norimichi Ukita

Complex systems which can be represented in the form of static and dynamic graphs arise in different fields, e.g. communication, engineering and industry. One of the interesting problems in analysing dynamic network structures is to monitor…

Machine Learning · Computer Science 2020-11-13 Anna Malinovskaya , Philipp Otto , Torben Peters

The probabilistic-stream model was introduced by Jayram et al. \cite{JKV07}. It is a generalization of the data stream model that is suited to handling ``probabilistic'' data where each item of the stream represents a probability…

Data Structures and Algorithms · Computer Science 2007-05-23 Andrew McGregor , S. Muthukrishnan

Neural marked temporal point processes have been a valuable addition to the existing toolbox of statistical parametric models for continuous-time event data. These models are useful for sequences where each event is associated with a single…

Machine Learning · Computer Science 2024-03-20 Yuxin Chang , Alex Boyd , Padhraic Smyth

Big data streams are possibly one of the most essential underlying notions. However, data streams are often challenging to handle owing to their rapid pace and limited information lifetime. It is difficult to collect and communicate stream…

Machine Learning · Computer Science 2022-03-03 Christos Karras , Aristeidis Karras , Spyros Sioutas

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were otherwise…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Peng Xu , Yongye Huang , Tongtong Yuan , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales , Zhanyu Ma , Jun Guo

Spectral clustering has been one of the widely used methods for community detection in networks. However, large-scale networks bring computational challenges to the eigenvalue decomposition therein. In this paper, we study the spectral…

Social and Information Networks · Computer Science 2022-01-07 Hai Zhang , Xiao Guo , Xiangyu Chang

Frequent itemset mining in uncertain transaction databases semantically and computationally differs from traditional techniques applied on standard (certain) transaction databases. Uncertain transaction databases consist of sets of…

Databases · Computer Science 2010-08-16 Thomas Bernecker , Hans-Peter Kriegel , Matthias Renz , Florian Verhein , Andreas Züfle