English
Related papers

Related papers: Concept Drift Detection for Streaming Data

200 papers

Data stream poses additional challenges to statistical classification tasks because distributions of the training and target samples may differ as time passes. Such distribution change in streaming data is called concept drift. Numerous…

Machine Learning · Computer Science 2020-08-11 Anjin Liu , Jie Lu , Guangquan Zhang

Real-world datasets frequently exhibit evolving data distributions, reflecting temporal variations and underlying shifts. Overlooking this phenomenon, known as concept drift, can substantially degrade the predictive performance of the…

Machine Learning · Computer Science 2025-12-16 Mohammad Abu-Shaira , Weishi Shi

Concept drift is a common phenomenon in data streams where the statistical properties of the target variable change over time. Traditionally, drift is assumed to occur globally, affecting the entire dataset uniformly. However, this…

Machine Learning · Computer Science 2025-03-06 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Online updating of time series forecasting models aims to tackle the challenge of concept drifting by adjusting forecasting models based on streaming data. While numerous algorithms have been developed, most of them focus on model design…

Machine Learning · Computer Science 2024-03-25 YiFan Zhang , Weiqi Chen , Zhaoyang Zhu , Dalin Qin , Liang Sun , Xue Wang , Qingsong Wen , Zhang Zhang , Liang Wang , Rong Jin

Federated Learning (FL) under distributed concept drift is a largely unexplored area. Although concept drift is itself a well-studied phenomenon, it poses particular challenges for FL, because drifts arise staggered in time and space…

Machine Learning · Computer Science 2023-03-01 Ellango Jothimurugesan , Kevin Hsieh , Jianyu Wang , Gauri Joshi , Phillip B. Gibbons

In many real-world applications, data are often collected in the form of stream, and thus the distribution usually changes in nature, which is referred as concept drift in literature. We propose a novel and effective approach to handle…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Le-Wen Cai , Zhi-Hua Zhou

With the growing volume of Internet of Things (IoT) network traffic, machine learning (ML)-based anomaly detection is more relevant than ever. Traditional batch learning models face challenges such as high maintenance and poor adaptability…

Machine Learning · Computer Science 2025-11-03 Rodrigo Matos Carnier , Laura Lahesoo , Kensuke Fukuda

One of the significant problems of streaming data classification is the occurrence of concept drift, consisting of the change of probabilistic characteristics of the classification task. This phenomenon destabilizes the performance of the…

Machine Learning · Computer Science 2021-12-21 Michał Woźniak , Paweł Zyblewski , Paweł Ksieniewicz

Continuous generation of streaming data from diverse sources, such as online transactions and digital interactions, necessitates timely fraud detection. Traditional batch processing methods often struggle to capture the rapidly evolving…

Machine Learning · Computer Science 2025-04-15 Vivek Yelleti

Click-through rate (CTR) prediction is a crucial task in web search, recommender systems, and online advertisement displaying. In practical application, CTR models often serve with high-speed user-generated data streams, whose underlying…

Information Retrieval · Computer Science 2023-02-24 Congcong Liu , Yuejiang Li , Fei Teng , Xiwei Zhao , Changping Peng , Zhangang Lin , Jinghe Hu , Jingping Shao

We study the problem of learning in the presence of a drifting target concept. Specifically, we provide bounds on the error rate at a given time, given a learner with access to a history of independent samples labeled according to a target…

Machine Learning · Computer Science 2015-05-21 Steve Hanneke , Varun Kanade , Liu Yang

In federated learning (FL), the data distribution of each client may change over time, introducing both temporal and spatial data heterogeneity, known as concept drift. Data heterogeneity arises from three drift sources: real drift (a shift…

Machine Learning · Computer Science 2025-06-27 Fu Peng , Ming Tang

Business processes are prone to unexpected changes, as process workers may suddenly or gradually start executing a process differently in order to adjust to changes in workload, season, or other external factors. Early detection of business…

Artificial Intelligence · Computer Science 2020-05-11 Abderrahmane Maaradji , Marlon Dumas , Marcello La Rosa , Alireza Ostovar

In the context of Just-In-Time Software Defect Prediction (JIT-SDP), Concept drift (CD) can occur due to changes in the software development process, the complexity of the software, or changes in user behavior that may affect the stability…

Software Engineering · Computer Science 2023-05-29 Zeynab Chitsazian , Saeed Sedighian Kashi , Amin Nikanjam

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

In this paper we propose an end-to-end swift 3D feature reductionist framework (3DFR) for scene independent change detection. The 3DFR framework consists of three feature streams: a swift 3D feature reductionist stream (AvFeat), a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Murari Mandal , Vansh Dhar , Abhishek Mishra , Santosh Kumar Vipparthi

In recent years, with the increasing popularity of "Smart Technology", the number of Internet of Things (IoT) devices and systems have surged significantly. Various IoT services and functionalities are based on the analytics of IoT…

Machine Learning · Computer Science 2021-05-27 Li Yang , Abdallah Shami

We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent…

Disordered Systems and Neural Networks · Physics 2007-05-23 Renato Vicente , Osame Kinouchi , Nestor Caticha

A speed threshold is a crucial parameter in breakdown and capacity distribution analysis as it defines the boundary between free-flow and congested regimes. However, literature on approaches to establishing the breakpoint value for…

Applications · Statistics 2020-09-02 Emmanuel Kidando , Angela E. Kitali , Boniphace Kutela , Thobias Sando

AI is foreseen to be a centerpiece in next generation wireless networks enabling enabling ubiquitous communication as well as new services. However, in real deployment, feature distribution changes may degrade the performance of AI models…