English
Related papers

Related papers: Feature Relevance Analysis to Explain Concept Drif…

200 papers

Machine learning models are omnipresent for predictions on big data. One challenge of deployed models is the change of the data over time, a phenomenon called concept drift. If not handled correctly, a concept drift can lead to significant…

Machine Learning · Computer Science 2020-04-02 Lucas Baier , Marcel Hofmann , Niklas Kühl , Marisa Mohr , Gerhard Satzger

Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting…

Machine Learning · Statistics 2015-05-05 Heng Wang , Zubin Abraham

Concept drift refers to a non stationary learning problem over time. The training and the application data often mismatch in real life problems. In this report we present a context of concept drift problem 1. We focus on the issues relevant…

Artificial Intelligence · Computer Science 2010-10-25 Indrė Žliobaitė

In data streams, the data distribution of arriving observations at different time points may change - a phenomenon called concept drift. While detecting concept drift is a relatively mature area of study, solutions to the uncertainty…

Machine Learning · Computer Science 2020-08-11 Anjin Liu , Jie Lu , Guangquan Zhang

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

Concept drift detection is crucial for many AI systems to ensure the system's reliability. These systems often have to deal with large amounts of data or react in real-time. Thus, drift detectors must meet computational requirements or…

Machine Learning · Computer Science 2024-06-11 Elias Werner , Nishant Kumar , Matthias Lieber , Sunna Torge , Stefan Gumhold , Wolfgang E. Nagel

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

Concept drift refers to gradual or sudden changes in the properties of data that affect the accuracy of machine learning models. In this paper, we address the problem of concept drift detection in the malware domain. Specifically, we…

Machine Learning · Computer Science 2026-03-17 Aniket Mishra , Mark Stamp

One important assumption underlying common classification models is the stationarity of the data. However, in real-world streaming applications, the data concept indicated by the joint distribution of feature and label is not stationary but…

Machine Learning · Computer Science 2018-08-10 Shujian Yu , Xiaoyang Wang , Jose C. Principe

Machine learning models are being increasingly used to automate decisions in almost every domain, and ensuring the performance of these models is crucial for ensuring high quality machine learning enabled services. Ensuring concept drift is…

Machine Learning · Statistics 2025-09-30 Nelvin Tan , Yu-Ching Shih , Dong Yang , Amol Salunkhe

Machine learning models nowadays play a crucial role for many applications in business and industry. However, models only start adding value as soon as they are deployed into production. One challenge of deployed models is the effect of…

Machine Learning · Computer Science 2020-11-06 Lucas Baier , Vincent Kellner , Niklas Kühl , Gerhard Satzger

Concept drift detectors allow learning systems to maintain good accuracy on non-stationary data streams. Financial time series are an instance of non-stationary data streams whose concept drifts (market phases) are so important to affect…

Statistical Finance · Quantitative Finance 2021-09-02 Filippo Neri

Deployed machine learning models are confronted with the problem of changing data over time, a phenomenon also called concept drift. While existing approaches of concept drift detection already show convincing results, they require true…

Machine Learning · Computer Science 2022-09-26 Lucas Baier , Tim Schlör , Jakob Schöffer , Niklas Kühl

In applying deep learning for malware classification, it is crucial to account for the prevalence of malware evolution, which can cause trained classifiers to fail on drifted malware. Existing solutions to address concept drift use active…

Cryptography and Security · Computer Science 2024-12-23 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

Changes, planned or unexpected, are common during the execution of real-life processes. Detecting these changes is a must for optimizing the performance of organizations running such processes. Most of the algorithms present in the…

Artificial Intelligence · Computer Science 2025-10-28 Victor Gallego-Fontenla , Juan C. Vidal , Manuel Lama

Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation.…

Machine Learning · Computer Science 2021-08-12 Samuel Ackerman , Parijat Dube , Eitan Farchi , Orna Raz , Marcel Zalmanovici

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem

A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their…

Machine Learning · Statistics 2019-02-11 Shujian Yu , Zubin Abraham , Heng Wang , Mohak Shah , Yantao Wei , José C. Príncipe

We utilize neural network embeddings to detect data drift by formulating the drift detection within an appropriate sequential decision framework. This enables control of the false alarm rate although the statistical tests are repeatedly…

Applications · Statistics 2020-08-03 Samuel Ackerman , Parijat Dube , Eitan Farchi

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer