English
Related papers

Related papers: Cluster Analysis and Concept Drift Detection in Ma…

200 papers

Data are being collected from various aspects of life. These data can often arrive in chunks/batches. Traditional static clustering algorithms are not suitable for dynamic datasets, i.e., when data arrive in streams of chunks/batches. If we…

Machine Learning · Computer Science 2020-03-31 Mitchell D. Woodbright , Md Anisur Rahman , Md Zahidul Islam

We introduce Class Distribution Monitoring (CDM), an effective concept-drift detection scheme that monitors the class-conditional distributions of a datastream. In particular, our solution leverages multiple instances of an online and…

Machine Learning · Computer Science 2022-10-18 Diego Stucchi , Luca Frittoli , Giacomo Boracchi

Recent research has introduced ideas from concept drift into process mining to enable the analysis of changes in business processes over time. This stream of research, however, has not yet addressed the challenges of drift categorization,…

Artificial Intelligence · Computer Science 2026-02-19 Anton Yeshchenko , Claudio Di Ciccio , Jan Mendling , Artem Polyvyanyy

In machine learning, concept drift is an evolution of information that invalidates the current data model. It happens when the statistical properties of the input data change over time in unforeseen ways. Concept drift detection is crucial…

Machine Learning · Computer Science 2024-06-21 Honorius Galmeanu , Razvan Andonie

Machine learning based malware detectors become obsolete over time due to concept drift in benign and malware applications. Recent methods rely on fully labeled data and use hierarchical contrastive loss (HCL) with active learning to…

Unlabeled streaming data are usually collected to describe dynamic systems, where concept drift detection is a vital prerequisite to understanding the evolution of systems. However, the drifting concepts are usually imbalanced in most real…

Machine Learning · Computer Science 2026-03-10 Yiqun Zhang , Zhanpei Huang , Mingjie Zhao , Chuyao Zhang , Yang Lu , Yuzhu Ji , Fangqing Gu , An Zeng

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

Machine Learning · Computer Science 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

Concept drift is a phenomenon in which the distribution of a data stream changes over time in unforeseen ways, causing prediction models built on historical data to become inaccurate. While a variety of automated methods have been developed…

Machine Learning · Computer Science 2023-08-10 Weikai Yang , Zhen Li , Mengchen Liu , Yafeng Lu , Kelei Cao , Ross Maciejewski , Shixia Liu

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Classifiers and other statistics-based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical…

Machine Learning · Computer Science 2021-11-11 Samuel Ackerman , Orna Raz , Marcel Zalmanovici , Aviad Zlotnick

With the boom of machine learning (ML) techniques, software practitioners build ML systems to process the massive volume of streaming data for diverse software engineering tasks such as failure prediction in AIOps. Trained using historical…

Machine Learning · Computer Science 2025-08-05 Tri Minh Triet Pham , Karthikeyan Premkumar , Mohamed Naili , Jinqiu Yang

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

Malware attacks have become significantly more frequent and sophisticated in recent years. Therefore, malware detection and classification are critical components of information security. Due to the large amount of malware samples…

Cryptography and Security · Computer Science 2024-05-07 Olha Jurečková , Martin Jureček , Mark Stamp

Concept drift, characterized by unpredictable changes in data distribution over time, poses significant challenges to machine learning models in streaming data scenarios. Although error rate-based concept drift detectors are widely used,…

Machine Learning · Computer Science 2024-12-17 Pengqian Lu , Jie Lu , Anjin Liu , Guangquan Zhang

We propose an online method for concept driftdetection based on dynamic classifier ensemble selection. Theproposed method generates a pool of ensembles by promotingdiversity among classifier members and chooses expert ensemblesaccording to…

Given a large unlabeled set of images, how to efficiently and effectively group them into clusters based on extracted visual representations remains a challenging problem. To address this problem, we propose a convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Chih-Chung Hsu , Chia-Wen Lin

In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance…

Machine Learning · Computer Science 2024-11-26 Vennela Yarabolu , Govind Waghmare , Sonia Gupta , Siddhartha Asthana

This article studies how to detect and explain concept drift. Human activity recognition is used as a case study together with a online batch learning situation where the quality of the labels used in the model updating process starts to…

Machine Learning · Computer Science 2023-01-23 Pekka Siirtola , Juha Röning

As the adoption of deep learning models has grown beyond human capacity for verification, meta-algorithms are needed to ensure reliable model inference. Concept drift detection is a field dedicated to identifying statistical shifts that is…

Machine Learning · Computer Science 2025-05-08 Jacob Glenn Ayers , Buvaneswari A. Ramanan , Manzoor A. Khan

Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation.…

Machine Learning · Computer Science 2021-08-12 Samuel Ackerman , Parijat Dube , Eitan Farchi , Orna Raz , Marcel Zalmanovici