中文
相关论文

相关论文: K-means for Evolving Data Streams

200 篇论文

In recent years, stream data have become an immensely growing area of research for the database, computer science and data mining communities. Stream data is an ordered sequence of instances. In many applications of data stream mining data…

数据库 · 计算机科学 2014-02-10 Nishant Vadnere , R. G. Mehta , D. P. Rana , N. J. Mistry , M. M. Raghuwanshi

Concept drift detection is a crucial task in data stream evolving environments. Most of state of the art approaches designed to tackle this problem monitor the loss of predictive models. However, this approach falls short in many real-world…

机器学习 · 计算机科学 2021-03-09 Vitor Cerqueira , Heitor Murilo Gomes , Albert Bifet , Luis Torgo

We show that both clustering and subspace embeddings can be performed in the streaming model with the same asymptotic efficiency as in the central/offline setting. For $(k, z)$-clustering in the streaming model, we achieve a number of words…

数据结构与算法 · 计算机科学 2025-04-24 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

While ML model training and inference are both GPU-intensive, CPU-based data processing is often the bottleneck. Distributed data processing systems based on the batch or stream processing models assume homogeneous resource requirements.…

The movement of large quantities of data during the training of a Deep Neural Network presents immense challenges for machine learning workloads. To minimize this overhead, especially on the movement and calculation of gradient information,…

机器学习 · 计算机科学 2020-04-28 Siyuan Huang , Brian D. Hoskins , Matthew W. Daniels , Mark D. Stiles , Gina C. Adam

The analysis of continously larger datasets is a task of major importance in a wide variety of scientific fields. In this sense, cluster analysis algorithms are a key element of exploratory data analysis, due to their easiness in the…

机器学习 · 统计学 2018-01-10 Marco Capó , Aritz Pérez , Jose A. Lozano

In the real world, data streams are ubiquitous -- think of network traffic or sensor data. Mining patterns, e.g., outliers or clusters, from such data must take place in real time. This is challenging because (1) streams often have high…

机器学习 · 计算机科学 2021-01-08 Edouard Fouché , Florian Kalinke , Klemens Böhm

It is challenging to handle a large volume of labels in multi-label learning. However, existing approaches explicitly or implicitly assume that all the labels in the learning process are given, which could be easily violated in changing…

机器学习 · 统计学 2016-04-20 Shan You , Chang Xu , Yunhe Wang , Chao Xu , Dacheng Tao

Drift in machine learning refers to the phenomenon where the statistical properties of data or context, in which the model operates, change over time leading to a decrease in its performance. Therefore, maintaining a constant monitoring…

计算与语言 · 计算机科学 2023-09-08 Saeed Khaki , Akhouri Abhinav Aditya , Zohar Karnin , Lan Ma , Olivia Pan , Samarth Marudheri Chandrashekar

Unlike offline processing, streaming video vision-language models face two fundamental constraints: causality and accumulation. Causality prevents access to future frames that offline methods exploit, while accumulation causes tokens to…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Xueyi Chen , Keda Tao , Kele Shao , Huan Wang

K-Medoids(KM) is a standard clustering method, used extensively on semi-metric data.Error analyses of KM have traditionally used an in-sample notion of error,which can be far from the true error and suffer from generalization gap. We…

机器学习 · 计算机科学 2019-10-31 Aravindakshan Babu , Saurabh Agarwal , Sudarshan Babu , Hariharan Chandrasekaran

Clustering data is a popular feature in the field of unsupervised machine learning. Most algorithms aim to find the best method to extract consistent clusters of data, but very few of them intend to cluster data that share the same…

机器学习 · 计算机科学 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

统计计算 · 统计学 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We present an approach for efficiently training Gaussian Mixture Model (GMM) by Stochastic Gradient Descent (SGD) with non-stationary, high-dimensional streaming data. Our training scheme does not require data-driven parameter…

机器学习 · 计算机科学 2021-07-05 Alexander Gepperth , Benedikt Pfülb

Though mostly used as a clustering algorithm, k-means are originally designed as a quantization algorithm. Namely, it aims at providing a compression of a probability distribution with k points. Building upon [21, 33], we try to investigate…

统计理论 · 数学 2018-01-31 Clément Levrard

Data quality is fundamental to modern data science workflows, where data continuously flows as unbounded streams feeding critical downstream tasks, from elementary analytics to advanced artificial intelligence models. Existing data quality…

数据库 · 计算机科学 2025-06-09 Vasileios Papastergios , Anastasios Gounaris

This paper develops an incremental learning algorithm based on quadratic inference function (QIF) to analyze streaming datasets with correlated outcomes such as longitudinal data and clustered data. We propose a renewable QIF (RenewQIF)…

统计方法学 · 统计学 2021-07-01 Lan Luo , Ling Zhou , Peter X. -K. Song

An important thread in the study of data-stream algorithms focuses on settings where stream items are active only for a limited time. We introduce a new expiration model, where each item arrives with its own expiration time. The special…

System identification in modern engineering systems faces emerging challenges from unanticipated adversarial attacks beyond existing detection mechanisms. In this work, we obtain a provably accurate estimate of the Markov parameter matrix…

最优化与控制 · 数学 2025-09-22 Jihun Kim , Javad Lavaei

Concept drift detection has attracted considerable attention due to its importance in many real-world applications such as health monitoring and fault diagnosis. Conventionally, most advanced approaches will be of poor performance when the…

机器学习 · 计算机科学 2023-03-31 Songqiao Hu , Zeyi Liu , Xiao He