中文
相关论文

相关论文: K-means for Evolving Data Streams

200 篇论文

Concept drift refers to gradual or sudden changes in the properties of data that affect the accuracy of machine learning models. In this paper, we address the problem of concept drift detection in the malware domain. Specifically, we…

机器学习 · 计算机科学 2026-03-17 Aniket Mishra , Mark Stamp

Data streaming relies on continuous queries to process unbounded streams of data in a real-time fashion. It is commonly demanding in computation capacity, given that the relevant applications involve very large volumes of data. Data…

数据结构与算法 · 计算机科学 2016-06-16 Vincenzo Gulisano , Yiannis Nikolakopoulos , Daniel Cederman , Marina Papatriantafilou , Philippas Tsigas

We propose a new method to combine adaptive processes with a class of entropy estimators for the case of streams of data. Starting from a first estimation obtained from a batch of initial data, model parameters are estimated at each step by…

信号处理 · 电气工程与系统科学 2020-01-15 Mario Angelelli , Enrico Ciavolino , Paola Pasca

Sequence clustering in a streaming environment is challenging because it is computationally expensive, and the sequences may evolve over time. K-medoids or Partitioning Around Medoids (PAM) is commonly used to cluster sequences since it…

机器学习 · 计算机科学 2022-06-27 Azqa Nadeem , Sicco Verwer

The $k$-means algorithm is arguably the most popular nonparametric clustering method but cannot generally be applied to datasets with incomplete records. The usual practice then is to either impute missing values under an assumed…

机器学习 · 统计学 2018-09-11 Andrew Lithio , Ranjan Maitra

With the dawn of the Big Data era, data sets are growing rapidly. Data is streaming from everywhere - from cameras, mobile phones, cars, and other electronic devices. Clustering streaming data is a very challenging problem. Unlike the…

机器学习 · 计算机科学 2019-02-08 Shlomo Bugdary , Shay Maymon

K-means (MacQueen, 1967) [1] is one of the simplest unsupervised learning algorithms that solve the well-known clustering problem. The procedure follows a simple and easy way to classify a given data set to a predefined, say K number of…

机器学习 · 计算机科学 2017-06-23 Srikanta Kolay , Kumar Sankar Ray , Abhoy Chand Mondal

Predictive queries over spatiotemporal (ST) stream data pose significant data processing and analysis challenges. ST data streams involve a set of time series whose data distributions may vary in space and time, exhibiting multiple distinct…

机器学习 · 统计学 2024-10-03 Anderson Chaves , Eduardo Ogasawara , Patrick Valduriez , Fabio Porto

Modern streaming data categorization faces significant challenges from concept drift and class imbalanced data. This negatively impacts the output of the classifier, leading to improper classification. Furthermore, other factors such as the…

机器学习 · 计算机科学 2023-09-29 Priya. S , Haribharathi Sivakumar , Vijay Arvind. R

The growth of network-connected devices has led to an exponential increase in data generation, creating significant challenges for efficient data analysis. This data is generated continuously, creating a dynamic flow known as a data stream.…

机器学习 · 计算机科学 2023-12-27 Kazuhisa Fujita

We consider the streaming complexity of a fundamental task in approximate pattern matching: the $k$-mismatch problem. It asks to compute Hamming distances between a pattern of length $n$ and all length-$n$ substrings of a text for which the…

数据结构与算法 · 计算机科学 2018-04-10 Raphaël Clifford , Tomasz Kociumaka , Ely Porat

Many problems on data streams have been studied at two extremes of difficulty: either allowing randomized algorithms, in the static setting (where they should err with bounded probability on the worst case stream); or when only…

数据结构与算法 · 计算机科学 2022-11-11 Manuel Stoeckl

Center-based clustering is a fundamental primitive for data analysis and becomes very challenging for large datasets. In this paper, we focus on the popular $k$-center variant which, given a set $S$ of points from some metric space and a…

分布式、并行与集群计算 · 计算机科学 2021-06-02 Matteo Ceccarello , Andrea Pietracaprina , Geppino Pucci

Number of connected devices is steadily increasing and these devices continuously generate data streams. Real-time processing of data streams is arousing interest despite many challenges. Clustering is one of the most suitable methods for…

机器学习 · 计算机科学 2020-07-22 Alaettin Zubaroğlu , Volkan Atalay

We revisit the complexity of one of the most basic problems in pattern matching. In the k-mismatch problem we must compute the Hamming distance between a pattern of length m and every m-length substring of a text of length n, as long as…

数据结构与算法 · 计算机科学 2015-08-28 Raphaël Clifford , Allyx Fontaine , Ely Porat , Benjamin Sach , Tatiana Starikovskaya

This thesis aims to invent new approaches for making inferences with the k-means algorithm. k-means is an iterative clustering algorithm that randomly assigns k centroids, then assigns data points to the nearest centroid, and updates…

机器学习 · 计算机科学 2024-10-24 Alfred K. Adzika , Prudence Djagba

Streaming computation plays an important role in large-scale data analysis. The sliding window model is a model of streaming computation which also captures the recency of the data. In this model, data arrives one item at a time, but only…

数据结构与算法 · 计算机科学 2021-11-01 Alessandro Epasto , Mohammad Mahdian , Vahab Mirrokni , Peilin Zhong

As more and more devices connect to Internet of Things, unbounded streams of data will be generated, which have to be processed "on the fly" in order to trigger automated actions and deliver real-time services. Spark Streaming is a popular…

分布式、并行与集群计算 · 计算机科学 2018-09-12 Jia-Chun Lin , Ming-Chang Lee , Ingrid Chieh Yu , Einar Broch Johnsen

We consider streaming data transmission over a discrete memoryless channel. A new message is given to the encoder at the beginning of each block and the decoder decodes each message sequentially, after a delay of $T$ blocks. In this…

信息论 · 计算机科学 2015-12-22 Si-Hyeon Lee , Vincent Y. F. Tan , Ashish Khisti

Stream classification methods classify a continuous stream of data as new labelled samples arrive. They often also have to deal with concept drift. This paper focuses on seasonal drift in stream classification, which can be found in many…

机器学习 · 计算机科学 2020-06-30 Rakshitha Godahewa , Trevor Yann , Christoph Bergmeir , Francois Petitjean