English
Related papers

Related papers: Sequential Change Detection Under Markov Setup Wit…

200 papers

We consider a change detection problem in which the arrival rate of a Poisson process changes suddenly at some unknown and unobservable disorder time. It is assumed that the prior distribution of the disorder time is known. The objective is…

Optimization and Control · Mathematics 2007-05-23 Erhan Bayraktar , Semih Sezer

In order to perform autonomous sequential manipulation tasks, perception in cluttered scenes remains a critical challenge for robots. In this paper, we propose a probabilistic approach for robust sequential scene estimation and manipulation…

Robotics · Computer Science 2017-03-23 Zhiqiang Sui , Zheming Zhou , Zhen Zeng , Odest Chadwicke Jenkins

A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than…

Machine Learning · Computer Science 2022-04-18 Alexander Stepikin , Evgenia Romanenkova , Alexey Zaytsev

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm in the sequential data setting.…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

In the present work we study Bayesian nonparametric inference for the continuous-time M/G/1 queueing system. In the focus of the study is the unobservable service time distribution. We assume that the only available data of the system are…

Statistics Theory · Mathematics 2017-09-22 Cornelia Wichelhaus , Moritz von Rohrscheidt

A general setting for nested subdivisions of a bounded real set into intervals defining the digits $X_1,X_2,...$ of a random variable $X$ with a probability density function $f$ is considered. Under the weak condition that $f$ is almost…

Probability · Mathematics 2026-01-14 Jesper Møller

One of the proposed solutions to the equilibrium selection problem for agents learning in repeated games is obtained via the notion of stochastic stability. Learning algorithms are perturbed so that the Markov chain underlying the learning…

Computer Science and Game Theory · Computer Science 2012-07-09 John Wicks , Amy Greenwald

Change-point detection methods are proposed for the case of temporary failures, or transient changes, when an unexpected disorder is ultimately followed by a readjustment and return to the initial state. A base distribution of the…

Statistics Theory · Mathematics 2021-12-14 Baron Michael , Malov Sergey

Causal discovery aims to extract qualitative causal knowledge in the form of causal graphs from data. Because causal ground truth is rarely known in the real world, simulated data plays a vital role in evaluating the performance of the…

Machine Learning · Computer Science 2025-12-17 Rebecca J. Herman , Jonas Wahl , Urmi Ninad , Jakob Runge

A new Bayesian modelling framework is introduced for piece-wise homogeneous variable-memory Markov chains, along with a collection of effective algorithmic tools for change-point detection and segmentation of discrete time series. Building…

Methodology · Statistics 2025-01-14 Valentinian Lungu , Ioannis Papageorgiou , Ioannis Kontoyiannis

Spatio-temporal hidden Markov models are extremely difficult to estimate because their latent joint distributions are available only in trivial cases. In the estimation phase, these latent distributions are usually substituted with…

Methodology · Statistics 2025-09-19 Daniele Tancini , Riccardo Rastelli , Francesco Bartolucci

Multivariate time series may be subject to partial structural changes over certain frequency band, for instance, in neuroscience. We study the change point detection problem with high dimensional time series, within the framework of…

Methodology · Statistics 2024-05-31 Xinyu Zhang , Kung-Sik Chan

We consider the problem of sequential change detection, where the goal is to design a scheme for detecting any changes in a parameter or functional $\theta$ of the data stream distribution that has small detection delay, but guarantees…

Statistics Theory · Mathematics 2023-11-28 Shubhanshu Shekhar , Aaditya Ramdas

Cross-sectional observations from a dynamical system can be modeled via steady-state distributions of Markov processes. The major challenge is then to determine whether the process parameters can be identified and estimated from the…

Statistics Theory · Mathematics 2026-03-19 Cecilie Olesen Recke , Niels Richard Hansen

Sequential probability assignment and universal compression go hand in hand. We propose sequential probability assignment for non-binary (and large alphabet) sequences with empirical distributions whose parameters are known to be bounded…

Information Theory · Computer Science 2021-02-09 Michael Drmota , Gil Shamir , Wojciech Szpankowski

Conformal prediction is a widely used method to quantify the uncertainty of a classifier under the assumption of exchangeability (e.g., IID data). We generalize conformal prediction to the Hidden Markov Model (HMM) framework where the…

A Markov network characterizes the conditional independence structure, or Markov property, among a set of random variables. Existing work focuses on specific families of distributions (e.g., exponential families) and/or certain structures…

Machine Learning · Computer Science 2023-05-22 Yujia Zheng , Ignavier Ng , Yewen Fan , Kun Zhang

Ordinal categorical data are routinely encountered in many practical applications. When the primary goal is to construct a regression model for ordinal outcomes, cumulative link models represent one of the most popular choices to link the…

Methodology · Statistics 2026-03-13 Emanuele Aliverti

We consider the problem of quickest change-point detection in data streams. Classical change-point detection procedures, such as CUSUM, Shiryaev-Roberts and Posterior Probability statistics, are optimal only if the change-point model is…

Machine Learning · Statistics 2017-06-13 Denis Volkhonskiy , Ilia Nouretdinov , Alexander Gammerman , Vladimir Vovk , Evgeny Burnaev

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson