English
Related papers

Related papers: Tracking changes using Kullback-Leibler divergence…

200 papers

National statistical institutes currently investigate how to improve the output quality of official statistics based on machine learning algorithms. A key obstacle is concept drift, i.e., when the joint distribution of independent variables…

Methodology · Statistics 2021-03-02 Quinten Meertens , Cees Diks , Jaap van den Herik , Frank Takes

The world surrounding us is subject to constant change. These changes, frequently described as concept drift, influence many industrial and technical processes. As they can lead to malfunctions and other anomalous behavior, which may be…

Machine Learning · Computer Science 2023-10-25 Fabian Hinder , Valerie Vaquet , Barbara Hammer

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models may become inaccurate and need adjustment. Many technologies for…

Machine Learning · Computer Science 2022-12-05 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Concept drift detection is a crucial task in data stream evolving environments. Most of state of the art approaches designed to tackle this problem monitor the loss of predictive models. However, this approach falls short in many real-world…

Machine Learning · Computer Science 2021-03-09 Vitor Cerqueira , Heitor Murilo Gomes , Albert Bifet , Luis Torgo

Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process,…

Statistics Theory · Mathematics 2019-03-15 Luai Al-Labadi , Viskakh Patel , Kasra Vakiloroayaei , Clement Wan

In a first part, we present a mathematical analysis of a general methodology of a probabilistic learning inference that allows for estimating a posterior probability model for a stochastic boundary value problem from a prior probability…

Machine Learning · Statistics 2022-06-08 Christian Soize

Recent studies in federated learning (FL) commonly train models on static datasets. However, real-world data often arrives as streams with shifting distributions, causing performance degradation known as concept drift. This paper analyzes…

Machine Learning · Computer Science 2025-06-27 Fu Peng , Meng Zhang , Ming Tang

Detecting an abrupt and persistent change in the underlying distribution of online data streams is an important problem in many applications. This paper proposes a new robust score-based algorithm called RSCUSUM, which can be applied to…

Methodology · Statistics 2023-06-09 Suya Wu , Enmao Diao , Taposh Banerjee , Jie Ding , Vahid Tarokh

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

Knowledge Tracing (KT) has been an established problem in the educational data mining field for decades, and it is commonly assumed that the underlying learning process being modeled remains static. Given the ever-changing landscape of…

Machine Learning · Computer Science 2025-11-05 Morgan Lee , Artem Frenk , Eamon Worden , Karish Gupta , Thinh Pham , Ethan Croteau , Neil Heffernan

Classifiers operating in a dynamic, real world environment, are vulnerable to adversarial activity, which causes the data distribution to change over time. These changes are traditionally referred to as concept drift, and several approaches…

Machine Learning · Computer Science 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic

We introduce Class Distribution Monitoring (CDM), an effective concept-drift detection scheme that monitors the class-conditional distributions of a datastream. In particular, our solution leverages multiple instances of an online and…

Machine Learning · Computer Science 2022-10-18 Diego Stucchi , Luca Frittoli , Giacomo Boracchi

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

Networks represent how the entities of a system are connected and can be partitioned differently, prompting ways to compare partitions. Common approaches for comparing network partitions include information-theoretic measures based on…

Social and Information Networks · Computer Science 2024-01-18 Christopher Blöcker , Ingo Scholtes

Machine learning-based performance models are increasingly being used to build critical job scheduling and application optimization decisions. Traditionally, these models assume that data distribution does not change as more samples are…

Machine Learning · Computer Science 2023-10-27 Ray A. O. Sinurat , Anurag Daram , Haryadi S. Gunawi , Robert B. Ross , Sandeep Madireddy

Concept Drift has been extensively studied within the context of Stream Learning. However, it is often assumed that the deployed model's predictions play no role in the concept drift the system experiences. Closer inspection reveals that…

Machine Learning · Computer Science 2025-04-02 Brandon Gower-Winter , Georg Krempl , Sergey Dragomiretskiy , Tineke Jelsma , Arno Siebes

The maximum entropy principle is a powerful tool for solving underdetermined inverse problems. This paper considers the problem of discretizing a continuous distribution, which arises in various applied fields. We obtain the approximating…

Numerical Analysis · Mathematics 2020-08-05 Ken'ichiro Tanaka , Alexis Akira Toda

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

Kullback--Leibler (KL) divergence is a fundamental measure of the dissimilarity between two probability distributions, but it can become unstable in high-dimensional settings due to its sensitivity to mismatches in distributional support.…

Information Theory · Computer Science 2025-02-03 Yifeng Peng , Dantong Li , Xinyi Li , Zhiding Liang , Yongshan Ding , Ying Wang

Global physical event detection has traditionally relied on dense coverage of physical sensors around the world; while this is an expensive undertaking, there have not been alternatives until recently. The ubiquity of social networks and…

Machine Learning · Computer Science 2019-12-16 Abhijit Suprem , Calton Pu