English
Related papers

Related papers: Improving the output quality of official statistic…

200 papers

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Machine learning models are omnipresent for predictions on big data. One challenge of deployed models is the change of the data over time, a phenomenon called concept drift. If not handled correctly, a concept drift can lead to significant…

Machine Learning · Computer Science 2020-04-02 Lucas Baier , Marcel Hofmann , Niklas Kühl , Marisa Mohr , Gerhard Satzger

Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding and adaptation.…

Machine Learning · Computer Science 2020-04-14 Jie Lu , Anjin Liu , Fan Dong , Feng Gu , Joao Gama , Guangquan Zhang

Predictive models often degrade in performance due to evolving data distributions, a phenomenon known as data drift. Among its forms, concept drift, where the relationship between explanatory variables and the response variable changes, is…

Machine Learning · Statistics 2026-05-18 Ugur Dar , Mustafa Cavus

Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting…

Machine Learning · Statistics 2015-05-05 Heng Wang , Zubin Abraham

With the wide application of machine learning algorithms to the real world, class imbalance and concept drift have become crucial learning issues. Class imbalance happens when the data categories are not equally represented, i.e., at least…

Machine Learning · Computer Science 2017-08-01 Shuo Wang , Leandro L. Minku , Nitesh Chawla , Xin Yao

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

Machine learning and statistical methods can improve conventional motor protection systems, providing early warning and detection of emerging failures. Data-driven methods rely on historical data to learn how the system is expected to…

Applications · Statistics 2025-01-29 Martin Tveten , Morten Stakkeland

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

In statistical modelling the biggest threat is concept drift which makes the model gradually showing deteriorating performance over time. There are state of the art methodologies to detect the impact of concept drift, however general…

Machine Learning · Computer Science 2018-10-09 Kumarjit Pathak , Jitin Kapila

Machine learning is increasingly being used to generate prediction models for use in a number of real-world settings, from credit risk assessment to clinical decision support. Recent discussions have highlighted potential problems in the…

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods…

Artificial Intelligence · Computer Science 2021-05-05 Hang Yu , Tianyu Liu , Jie Lu , Guangquan Zhang

Concept drift is a phenomenon in which the distribution of a data stream changes over time in unforeseen ways, causing prediction models built on historical data to become inaccurate. While a variety of automated methods have been developed…

Machine Learning · Computer Science 2023-08-10 Weikai Yang , Zhen Li , Mengchen Liu , Yafeng Lu , Kelei Cao , Ross Maciejewski , Shixia Liu

We present a new adaptive algorithm for learning discrete distributions under distribution drift. In this setting, we observe a sequence of independent samples from a discrete distribution that is changing over time, and the goal is to…

Machine Learning · Computer Science 2024-03-11 Alessio Mazzetto

When machine learning systems meet real world applications, accuracy is only one of several requirements. In this paper, we assay a complementary perspective originating from the increasing availability of pre-trained and regularly…

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

AI-based digital twins are at the leading edge of the Industry 4.0 revolution, which are technologically empowered by the Internet of Things and real-time data analysis. Information collected from industrial assets is produced in a…

Machine Learning · Computer Science 2023-03-20 Jesus L. Lobo , Ibai Laña , Eneko Osaba , Javier Del Ser

In document classification for, e.g., legal and biomedical text, we often deal with hundreds of classes, including very infrequent ones, as well as temporal concept drift caused by the influence of real world events, e.g., policy changes,…

Computation and Language · Computer Science 2022-03-16 Ilias Chalkidis , Anders Søgaard