English
Related papers

Related papers: Concept Drift Detection for Streaming Data

200 papers

We present a novel online learning-based approach for concept drift adaptation in optical network failure detection, achieving up to a 70% improvement in performance over conventional static models while maintaining low latency.

Most machine learning models are static, but the world is dynamic, and increasing online deployment of learned models gives increasing urgency to the development of efficient and effective mechanisms to address learning in the context of…

Machine Learning · Computer Science 2016-11-16 Geoffrey I. Webb , Roy Hyde , Hong Cao , Hai Long Nguyen , Francois Petitjean

One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the joint distribution of feature and label is not stationary but…

Machine Learning · Computer Science 2018-08-10 Shujian Yu , Xiaoyang Wang , Jose C. Principe

Detecting drifts in data is essential for machine learning applications, as changes in the statistics of processed data typically has a profound influence on the performance of trained models. Most of the available drift detection methods…

Machine Learning · Computer Science 2024-10-28 Andrea Castellani , Sebastian Schmitt , Barbara Hammer

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Many real-world applications adopt multi-label data streams as the need for algorithms to deal with rapidly changing data increases. Changes in data distribution, also known as concept drift, cause the existing classification models to…

Machine Learning · Computer Science 2022-02-02 Ege Berkay Gulcan , Fazli Can

Machine learning (ML) represents an efficient and popular approach for network traffic classification. However, network traffic classification is a challenging domain, and trained models may degrade soon after deployment due to the obsolete…

Machine Learning · Computer Science 2026-01-01 Dominik Soukup , Richard Plný , Daniel Vašata , Tomáš Čejka

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. While there do exist…

Machine Learning · Computer Science 2020-06-24 Fabian Hinder , Barbara Hammer

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Increasingly, Internet of Things (IoT) domains, such as sensor networks, smart cities, and social networks, generate vast amounts of data. Such data are not only unbounded and rapidly evolving. Rather, the content thereof dynamically…

Machine Learning · Statistics 2018-01-19 Ali Pesaranghader , Herna Viktor , Eric Paquet

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

Cryptography and Security · Computer Science 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

Outlier detection and concept drift detection represent two challenges in data analysis. Most studies address these issues separately. However, joint detection mechanisms in regression remain underexplored, where the continuous nature of…

Methodology · Statistics 2025-12-16 Bingbing Wang , Shengyan Sun , Jiaqi Wang , Yu Tang

Concept Drift has been extensively studied within the context of Stream Learning. However, it is often assumed that the deployed model's predictions play no role in the concept drift the system experiences. Closer inspection reveals that…

Machine Learning · Computer Science 2025-04-02 Brandon Gower-Winter , Georg Krempl , Sergey Dragomiretskiy , Tineke Jelsma , Arno Siebes

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

Data drift is the change in model input data that is one of the key factors leading to machine learning models performance degradation over time. Monitoring drift helps detecting these issues and preventing their harmful consequences.…

Computation and Language · Computer Science 2023-05-30 Ella Rabinovich , Matan Vetzler , Samuel Ackerman , Ateret Anaby-Tavor

AI-native 6G networks promise unprecedented automation and performance by embedding machine-learning models throughout the radio access and core segments of the network. However, the non-stationary nature of wireless environments due to…

Networking and Internet Architecture · Computer Science 2025-08-04 Athanasios Tziouvaras , Carolina Fortuna , George Floros , Kostas Kolomvatsos , Panagiotis Sarigiannidis , Marko Grobelnik , Blaž Bertalanič

The change in data distribution over time, also known as concept drift, poses a significant challenge to the reliability of online learning methods. Existing methods typically require model retraining or drift detection, both of which…

Machine Learning · Computer Science 2025-06-11 Songqiao Hu , Zeyi Liu , Xiao He