English
Related papers

Related papers: Tracking changes using Kullback-Leibler divergence…

200 papers

We address the problem of detecting changes in multivariate datastreams, and we investigate the intrinsic difficulty that change-detection methods have to face when the data dimension scales. In particular, we consider a general approach…

Machine Learning · Statistics 2017-12-04 Cesare Alippi , Giacomo Boracchi , Diego Carrera , Manuel Roveri

Data distributions in streaming environments are usually not stationary. In order to maintain a high predictive quality at all times, online learning models need to adapt to distributional changes, which are known as concept drift. The…

Machine Learning · Computer Science 2022-03-31 Johannes Haug , Gjergji Kasneci

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Machine learning approaches for image classification have led to impressive advances in that field. For example, convolutional neural networks are able to achieve remarkable image classification accuracy across a wide range of applications…

Machine Learning · Statistics 2025-10-30 Christopher T. Franck , Anne R. Driscoll , Zoe Szajnfarber , William H. Woodall

Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting…

Machine Learning · Statistics 2015-05-05 Heng Wang , Zubin Abraham

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods…

Machine Learning · Computer Science 2023-03-17 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Concept drift -- the change of the distribution over time -- poses significant challenges for learning systems and is of central interest for monitoring. Understanding drift is thus paramount, and drift localization -- determining which…

Machine Learning · Computer Science 2026-04-22 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Concept drift, i.e., the change of the data generating distribution, can render machine learning models inaccurate. Several works address the phenomenon of concept drift in the streaming context usually assuming that consecutive data points…

Machine Learning · Computer Science 2023-12-19 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

Machine Learning · Computer Science 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

The distribution of streaming data often changes over time as conditions change, a phenomenon known as concept drift. Only a subset of previous experience, collected in similar conditions, is relevant to learning an accurate classifier for…

Machine Learning · Computer Science 2024-08-20 Ben Halstead , Yun Sing Koh , Patricia Riddle , Mykola Pechenizkiy , Albert Bifet

In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known…

Machine Learning · Computer Science 2022-06-07 Wendi Li , Xiao Yang , Weiqing Liu , Yingce Xia , Jiang Bian

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

The notion of drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. Albeit many attempts were made to deal with drift, formal notions of drift are application-dependent and…

Machine Learning · Computer Science 2019-12-05 Fabian Hinder , André Artelt , Barbara Hammer

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Performance of neural models for named entity recognition degrades over time, becoming stale. This degradation is due to temporal drift, the change in our target variables' statistical properties over time. This issue is especially…

Computation and Language · Computer Science 2021-04-21 Shuguang Chen , Leonardo Neves , Thamar Solorio

The Kullback-Leibler (KL) divergence is a fundamental equation of information theory that quantifies the proximity of two probability distributions. Although difficult to understand by examining the equation, an intuition and understanding…

Information Theory · Computer Science 2014-04-09 Jonathon Shlens

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. While there do exist…

Machine Learning · Computer Science 2020-06-24 Fabian Hinder , Barbara Hammer
‹ Prev 1 2 3 10 Next ›