English
Related papers

Related papers: Dirichlet process mixture models for non-stationar…

200 papers

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered…

Machine Learning · Computer Science 2019-04-08 Michael Biehl , Fthi Abadi , Christina Göpfert , Barbara Hammer

Concept drift in process mining (PM) is a challenge as classical methods assume processes are in a steady-state, i.e., events share the same process version. We conducted a systematic literature review on the intersection of these areas,…

It is shown that a simple Dirichlet process mixture of multivariate normals offers Bayesian density estimation with adaptive posterior convergence rates. Toward this, a novel sieve for non-parametric mixture densities is explored, and its…

Statistics Theory · Mathematics 2011-11-18 Surya T. Tokdar

Tipping points occur in many real-world systems, at which the system shifts suddenly from one state to another. The ability to predict the occurrence of tipping points from time series data remains an outstanding challenge and a major…

Machine Learning · Computer Science 2024-12-10 Chengzuo Zhuge , Jiawei Li , Wei Chen

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach

Data are being collected from various aspects of life. These data can often arrive in chunks/batches. Traditional static clustering algorithms are not suitable for dynamic datasets, i.e., when data arrive in streams of chunks/batches. If we…

Machine Learning · Computer Science 2020-03-31 Mitchell D. Woodbright , Md Anisur Rahman , Md Zahidul Islam

Most machine learning models are static, but the world is dynamic, and increasing online deployment of learned models gives increasing urgency to the development of efficient and effective mechanisms to address learning in the context of…

Machine Learning · Computer Science 2016-11-16 Geoffrey I. Webb , Roy Hyde , Hong Cao , Hai Long Nguyen , Francois Petitjean

Clustering based on vibration responses, such as transmissibility functions (TFs), is promising in structural anomaly detection. However, most existing methods struggle to determine the optimal cluster number, handle high-dimensional…

Machine Learning · Computer Science 2025-10-21 Lin-Feng Mei , Wang-Ji Yan

We present a method of solving a nonlinear Dirichlet problem with discontinuous boundary data and we give a probabilistic representation of the solution using the nonlocal branching process associated with the nonlinear term of the…

Probability · Mathematics 2024-10-23 Lucian Beznea , Oana Lupascu-Stamate , Alexandra Teodor

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. While there do exist…

Machine Learning · Computer Science 2020-06-24 Fabian Hinder , Barbara Hammer

Continual learning in environments with shifting data distributions is a challenging problem with several real-world applications. In this paper we consider settings in which the data distribution(task) shifts abruptly and the timing of…

Machine Learning · Computer Science 2022-01-07 Mengda Xu , Sumitra Ganesh , Pranay Pasula

In this paper, we study the problem of learning a mixture of Gaussians with streaming data: given a stream of $N$ points in $d$ dimensions generated by an unknown mixture of $k$ spherical Gaussians, the goal is to estimate the model…

Machine Learning · Computer Science 2017-07-11 Aditi Raghunathan , Ravishankar Krishnaswamy , Prateek Jain

In many real-world applications, data are often collected in the form of stream, and thus the distribution usually changes in nature, which is referred as concept drift in literature. We propose a novel and effective approach to handle…

Machine Learning · Computer Science 2020-07-07 Peng Zhao , Le-Wen Cai , Zhi-Hua Zhou

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Statistical modelling in the presence of data organized in groups is a crucial task in Bayesian statistics. The present paper conceives a mixture model based on a novel family of Bayesian priors designed for multilevel data and obtained by…

Methodology · Statistics 2024-07-01 Alessandro Colombi , Raffaele Argiento , Federico Camerlenghi , Lucia Paci

We derive consistency and asymptotic normality results for quasi-maximum likelihood methods for drift parameters of ergodic stochastic processes observed in discrete time in an underlying continuous-time setting. The special feature of our…

Statistics Theory · Mathematics 2021-09-20 Teppei Ogihara , Mitja Stadje

Learning in non-stationary environments is one of the biggest challenges in machine learning. Non-stationarity can be caused by either task drift, i.e., the drift in the conditional distribution of labels given the input data, or the domain…

Machine Learning · Computer Science 2020-03-16 Qicheng Lao , Xiang Jiang , Mohammad Havaei , Yoshua Bengio

Practical applications of artificial intelligence increasingly often have to deal with the streaming properties of real data, which, considering the time factor, are subject to phenomena such as periodicity and more or less chaotic…

Machine Learning · Computer Science 2025-03-05 Joanna Komorniczak , Paweł Ksieniewicz

Federated Learning (FL) is an emerging domain in the broader context of artificial intelligence research. Methodologies pertaining to FL assume distributed model training, consisting of a collection of clients and a server, with the main…

Machine Learning · Computer Science 2023-05-09 Bhargav Ganguly , Vaneet Aggarwal