English
Related papers

Related papers: Detection of data drift and outliers affecting mac…

200 papers

In applying deep learning for malware classification, it is crucial to account for the prevalence of malware evolution, which can cause trained classifiers to fail on drifted malware. Existing solutions to address concept drift use active…

Cryptography and Security · Computer Science 2024-12-23 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

This research proposes a novel drift detection methodology for machine learning (ML) models based on the concept of ''deformation'' in the vector space representation of data. Recognizing that new data can act as forces stretching,…

Machine Learning · Computer Science 2024-11-06 Giancarlo Cobino , Simone Farci

Machine Learning models in finance are highly susceptible to model drift, where predictive performance declines as data distributions shift. This issue is especially acute in developing economies such as those in Central Asia and the…

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

Machine Learning · Computer Science 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

Changes, planned or unexpected, are common during the execution of real-life processes. Detecting these changes is a must for optimizing the performance of organizations running such processes. Most of the algorithms present in the…

Artificial Intelligence · Computer Science 2025-10-28 Victor Gallego-Fontenla , Juan C. Vidal , Manuel Lama

In the classic machine learning framework, models are trained on historical data and used to predict future values. It is assumed that the data distribution does not change over time (stationarity). However, in real-world scenarios, the…

Machine Learning · Statistics 2023-06-13 Mansour Zoubeirou A Mayaki , Michel Riveill

When monitoring machine learning systems, two-sample tests of homogeneity form the foundation upon which existing approaches to drift detection build. They are used to test for evidence that the distribution underlying recent deployment…

Machine Learning · Statistics 2022-08-03 Oliver Cobb , Arnaud Van Looveren

Increasingly, Internet of Things (IoT) domains, such as sensor networks, smart cities, and social networks, generate vast amounts of data. Such data are not only unbounded and rapidly evolving. Rather, the content thereof dynamically…

Machine Learning · Statistics 2018-01-19 Ali Pesaranghader , Herna Viktor , Eric Paquet

Distribution shift is a common situation in machine learning tasks, where the data used for training a model is different from the data the model is applied to in the real world. This issue arises across multiple technical settings: from…

Machine Learning · Computer Science 2024-05-24 Nicolas Acevedo , Carmen Cortez , Chris Brooks , Rene Kizilcec , Renzhe Yu

Machine learning approaches for image classification have led to impressive advances in that field. For example, convolutional neural networks are able to achieve remarkable image classification accuracy across a wide range of applications…

Machine Learning · Statistics 2025-10-30 Christopher T. Franck , Anne R. Driscoll , Zoe Szajnfarber , William H. Woodall

In safety-critical domains such as autonomous driving and medical diagnosis, the reliability of machine learning models is crucial. One significant challenge to reliability is concept drift, which can cause model deterioration over time.…

Machine Learning · Computer Science 2023-11-23 Anton Winter , Nicolas Jourdan , Tristan Wirth , Volker Knauthe , Arjan Kuijper

In the field of Machine Learning (ML) and data-driven applications, one of the significant challenge is the change in data distribution between the training and deployment stages, commonly known as distribution shift. This paper outlines…

Machine Learning · Computer Science 2025-07-30 Lakpa Tamang , Mohamed Reda Bouadjenek , Richard Dazeley , Sunil Aryal

Machine learning and deep learning-based decision making has become part of today's software. The goal of this work is to ensure that machine learning and deep learning-based systems are as trusted as traditional software. Traditional…

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

With the boom of machine learning (ML) techniques, software practitioners build ML systems to process the massive volume of streaming data for diverse software engineering tasks such as failure prediction in AIOps. Trained using historical…

Machine Learning · Computer Science 2025-08-05 Tri Minh Triet Pham , Karthikeyan Premkumar , Mohamed Naili , Jinqiu Yang

Deep learning (DL) techniques have achieved great success in predictive accuracy in a variety of tasks, but deep neural networks (DNNs) are shown to produce highly overconfident scores for even abnormal samples. Well-defined uncertainty…

Machine Learning · Computer Science 2021-07-26 Yufei Li , Simin Chen , Wei Yang

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem

Machine learning and data analysis have been used in many robotics fields, especially for modelling. Data are usually the result of sensor measurements and, as such, they might be subjected to noise and outliers. The presence of outliers…

Robotics · Computer Science 2019-08-26 Francesco Cursi , Guang-Zhong Yang