English
Related papers

Related papers: Dirichlet process mixture models for non-stationar…

200 papers

The non-stationary nature of data streams strongly challenges traditional machine learning techniques. Although some solutions have been proposed to extend traditional machine learning techniques for handling data streams, these approaches…

Machine Learning · Computer Science 2021-06-23 Xuyang Yan , Abdollah Homaifar , Mrinmoy Sarkar , Abenezer Girma , Edward Tunstel

Modern streaming data categorization faces significant challenges from concept drift and class imbalanced data. This negatively impacts the output of the classifier, leading to improper classification. Furthermore, other factors such as the…

Machine Learning · Computer Science 2023-09-29 Priya. S , Haribharathi Sivakumar , Vijay Arvind. R

Non-stationarity of an underlying data generating process that leads to distributional changes over time is a key characteristic of Data Streams. This phenomenon, commonly referred to as Concept Drift, has been intensively studied, and…

Machine Learning · Computer Science 2026-02-09 Brandon Gower-Winter , Misja Groen , Georg Krempl

This paper presents a novel algorithm, based upon the dependent Dirichlet process mixture model (DDPMM), for clustering batch-sequential data containing an unknown number of evolving clusters. The algorithm is derived via a low-variance…

Machine Learning · Computer Science 2013-11-04 Trevor Campbell , Miao Liu , Brian Kulis , Jonathan P. How , Lawrence Carin

There exists a large body of work on online drift detection with the goal of dynamically finding and maintaining changes in data streams. In this paper, we adopt a query-based approach to drift detection. Our approach relies on {\em a drift…

Data Structures and Algorithms · Computer Science 2016-05-16 Sofia Kleisarchaki , Sihem Amer-Yahia , Ahlame Douzal-Chouakria , Vassilis Christophides

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models can become inaccurate and need adjustment. While there do exist methods…

Machine Learning · Computer Science 2023-03-17 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Traditional machine learning assumes a stationary data distribution, yet many real-world applications operate on nonstationary streams in which the underlying concept evolves over time. This problem can also be viewed as task-free continual…

Machine Learning · Computer Science 2026-03-17 Michal Wozniak , Marek Klonowski , Maciej Maczynski , Bartosz Krawczyk

Bayesian nonparametric mixture models are common for modeling complex data. While these models are well-suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of…

Statistics Theory · Mathematics 2024-05-31 Louise Alamichel , Daria Bystrova , Julyan Arbel , Guillaume Kon Kam King

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequential data setting.…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

With today's abundant streams of data, the only constant we can rely on is change. For stream classification algorithms, it is necessary to adapt to concept drift. This can be achieved by monitoring the model error, and triggering counter…

Machine Learning · Computer Science 2020-12-09 Lukas Fleckenstein , Sebastian Kauschke , Johannes Fürnkranz

We propose an online method for concept driftdetection based on dynamic classifier ensemble selection. Theproposed method generates a pool of ensembles by promotingdiversity among classifier members and chooses expert ensemblesaccording to…

We develop and analyze a general technique for learning with an unknown distribution drift. Given a sequence of independent observations from the last $T$ steps of a drifting distribution, our algorithm agnostically learns a family of…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

One of the more challenging real-world problems in computational intelligence is to learn from non-stationary streaming data, also known as concept drift. Perhaps even a more challenging version of this scenario is when -- following a small…

Machine Learning · Computer Science 2020-12-01 Muhammad Umer , Robi Polikar

This paper addresses the nonparametric estimation of the drift function over a compact domain for a time-homogeneous diffusion process, based on high-frequency discrete observations from $N$ independent trajectories. We propose a neural…

Machine Learning · Statistics 2026-04-01 Yuzhen Zhao , Yating Liu , Marc Hoffmann

Continuous learning from an immense volume of data streams becomes exceptionally critical in the internet era. However, data streams often do not conform to the same distribution over time, leading to a phenomenon called concept drift.…

Machine Learning · Computer Science 2024-07-09 Ke Wan , Yi Liang , Susik Yoon

This paper proposes a new architecture of incremen-tal fuzzy inference system (also called Evolving Fuzzy System-EFS). In the context of classifying data stream in non stationary environment, concept drifts problems must be addressed.…

Artificial Intelligence · Computer Science 2019-07-23 Clement Leroy , Eric Anquetil , Nathalie Girard

Recent research efforts in lifelong learning propose to grow a mixture of models to adapt to an increasing number of tasks. The proposed methodology shows promising results in overcoming catastrophic forgetting. However, the theory behind…

Machine Learning · Computer Science 2021-08-30 Fei Ye , Adrian G. Bors

Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting…

Machine Learning · Statistics 2015-05-05 Heng Wang , Zubin Abraham