English
Related papers

Related papers: Determining Window Sizes using Species Estimation …

200 papers

Data streams (streaming data) consist of transiently observed, evolving in time, multidimensional data sequences that challenge our computational and/or inferential capabilities. In this paper we propose user friendly approaches for robust…

Applications · Statistics 2015-01-20 Daniel Kosiorowski

Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of…

Machine Learning · Computer Science 2025-02-13 Florian Kalinke , Marco Heyden , Georg Gntuni , Edouard Fouché , Klemens Böhm

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

Data Structures and Algorithms · Computer Science 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

Nowadays, every device connected to the Internet generates an ever-growing stream of data (formally, unbounded). Machine Learning on unbounded data streams is a grand challenge due to its resource constraints. In fact, standard machine…

Machine Learning · Computer Science 2019-11-19 Alessio Bernardo , Emanuele Della Valle , Albert Bifet

Today, we have to deal with many data (Big data) and we need to make decisions by choosing an architectural framework to analyze these data coming from different area. Due to this, it become problematic when we want to process these data,…

Software Engineering · Computer Science 2019-01-29 Youness Dendane , Fabio Petrillo , Hamid Mcheick , Souhail Ben Ali

[Background] Nowadays, there is a massive growth of data volume and speed in many types of systems. It introduces new needs for infrastructure and applications that have to handle streams of data with low latency and high throughput.…

Software Engineering · Computer Science 2019-09-25 Alexandre Vianna , Waldemar Ferreira , Kiev Gama

We present an online visual analytics approach to helping users explore and understand hierarchical topic evolution in high-volume text streams. The key idea behind this approach is to identify representative topics in incoming documents…

Information Retrieval · Computer Science 2016-11-17 Shixia Liu , Jialun Yin , Xiting Wang , Weiwei Cui , Kelei Cao , Jian Pei

An increasing number of applications require real-time reasoning under uncertainty with streaming input. The temporal (dynamic) Bayes net formalism provides a powerful representational framework for such applications. However, existing…

Artificial Intelligence · Computer Science 2013-01-07 Masami Takikawa , Bruce D'Ambrosio , Ed Wright

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

Experience of live video streaming can be improved if the video uploader has more accurate knowledge about the future available bandwidth. Because with such knowledge, one is able to know what sizes should he encode the frames to be in an…

Multimedia · Computer Science 2022-10-05 Weijia Zheng

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

In stream processing, stream join is one of the critical sources of performance bottlenecks. The sliding-window-based stream join provides a precise result but consumes considerable computational resources. The current solutions lack…

Databases · Computer Science 2018-11-14 Fei Pan , Hans-Arno Jacobsen

In this paper, we present a framework for the dynamic selection of the wireless channels used to deliver information-rich data streams to edge servers. The approach we propose is data-driven, where a predictor, whose output informs the…

Networking and Internet Architecture · Computer Science 2020-04-06 Sabur Baidya , Peyman Tehrani , Marco Levorato

It is known that the scan statistic with variable window size favors the detection of signals with small spatial extent and there is a corresponding loss of power for signals with large spatial extent. Recent results have shown that this…

Methodology · Statistics 2022-05-20 Guenther Walther

Automatic decision and prediction systems are increasingly deployed in applications where they significantly impact the livelihood of people, such as for predicting the creditworthiness of loan applicants or the recidivism risk of…

Machine Learning · Computer Science 2025-01-31 Jan Baumeister , Bernd Finkbeiner , Frederik Scheerer , Julian Siber , Tobias Wagenpfeil

Online sampling-supported visual analytics is increasingly important, as it allows users to explore large datasets with acceptable approximate answers at interactive rates. However, existing online spatiotemporal sampling techniques are…

Distributed Stream Processing (DSP) systems enable processing large streams of continuous data to produce results in near to real time. They are an essential part of many data-intensive applications and analytics platforms. The rate at…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-11 Kordian Gontarska , Morgan Geldenhuys , Dominik Scheinert , Philipp Wiesner , Andreas Polze , Lauritz Thamsen

The number of triangles (hereafter denoted by $\Delta$) is an important metric to analyze massive graphs. It is also used to compute clustering coefficient in networks. This paper proposes a new algorithm called PES (Priority Edge Sampling)…

Social and Information Networks · Computer Science 2020-08-20 Roohollah Etemadi , Jianguo Lu

Accurately extracting patterns that appear frequently only within specific time intervals, together with their dense intervals, is important in many applications such as understanding seasonal demand and detecting anomalous…

Databases · Computer Science 2026-04-28 Taihei Takahashi , Kanata Takayasu , Satoshi Suga , Satoshi Kurihara

The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accurate classifier for…

Machine Learning · Computer Science 2024-08-20 Ben Halstead , Yun Sing Koh , Patricia Riddle , Mykola Pechenizkiy , Albert Bifet