English
Related papers

Related papers: When to Retrain after Drift: A Data-Only Test of P…

200 papers

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

Machine Learning · Computer Science 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

Background: Machine Learning (ML) methods are being increasingly used for automating different activities, e.g., Test Case Prioritization (TCP), of Continuous Integration (CI). However, ML models need frequent retraining as a result of…

Software Engineering · Computer Science 2023-07-18 Ali Kazemi Arani , Triet Huynh Minh Le , Mansooreh Zahedi , Muhammad Ali Babar

Continual Test-Time Adaptation (CTTA) seeks to update a pretrained model during deployment using only the incoming, unlabeled data stream. Although prior approaches such as Tent, EATA etc. provide meaningful improvements under short…

Machine Learning · Computer Science 2026-05-26 Himanshu Mishra

A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their…

Machine Learning · Statistics 2019-02-11 Shujian Yu , Zubin Abraham , Heng Wang , Mohak Shah , Yantao Wei , José C. Príncipe

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

Machine Learning · Computer Science 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

Rehearsal approaches enjoy immense popularity with Continual Learning (CL) practitioners. These methods collect samples from previously encountered data distributions in a small memory buffer; subsequently, they repeatedly optimize on the…

Machine Learning · Computer Science 2022-10-18 Lorenzo Bonicelli , Matteo Boschini , Angelo Porrello , Concetto Spampinato , Simone Calderara

With the increasing number of compute components, failures in future exa-scale computer systems are expected to become more frequent. This motivates the study of novel resilience techniques. Here, we extend a recently proposed…

Mathematical Software · Computer Science 2018-04-18 Markus Huber , Ulrich Rüde , Barbara Wohlmuth

Pre-trained deep neural networks (DNNs) are being widely deployed by industry for making business decisions and to serve users; however, a major problem is model decay, where the DNN's predictions become more erroneous over time, resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Md Yousuf Harun , Christopher Kanan

Real-world reinforcement learning often faces environment drift, but most existing methods rely on static entropy coefficients/target entropy, causing over-exploration during stable periods and under-exploration after drift, and leaving…

Machine Learning · Computer Science 2026-05-19 Tongxi Wang , Zhuoyang Xia , Xinran Chen , Shan Liu

Classifiers deployed in the real world operate in a dynamic environment, where the data distribution can change over time. These changes, referred to as concept drift, can cause the predictive performance of the classifier to drop over…

Machine Learning · Statistics 2017-04-04 Tegjyot Singh Sethi , Mehmed Kantardzic

Concept drift refers to a non stationary learning problem over time. The training and the application data often mismatch in real life problems. In this report we present a context of concept drift problem 1. We focus on the issues relevant…

Artificial Intelligence · Computer Science 2010-10-25 Indrė Žliobaitė

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

Machine Learning · Computer Science 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

Deep learning models require an enormous amount of data for training. However, recently there is a shift in machine learning from model-centric to data-centric approaches. In data-centric approaches, the focus is to refine and improve the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Muhammad Asif Khan , Ridha Hamila , Hamid Menouar

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods…

Machine Learning · Computer Science 2023-03-17 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Most predictive models assume that training and test data are generated from a stationary process. However, this assumption does not hold true in practice. In this paper, we consider the scenario of a gradual concept drift due to the…

Machine Learning · Computer Science 2020-02-12 Subhro Das , Prasanth Lade , Soundar Srinivasan

Recurrent Neural Networks (RNNs) are rich models for the processing of sequential data. Recent work on advancing the state of the art has been focused on the optimization or modelling of RNNs, mostly motivated by adressing the problems of…

In many real-world applications, data are often collected in the form of stream, and thus the distribution usually changes in nature, which is referred as concept drift in literature. We propose a novel and effective approach to handle…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Le-Wen Cai , Zhi-Hua Zhou

The general approach taken when training deep learning classifiers is to save the parameters after every few iterations, train until either a human observer or a simple metric-based heuristic decides the network isn't learning anymore, and…

Machine Learning · Computer Science 2021-11-17 J. K. Terry , Mario Jayakumar , Kusal De Alwis

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem