English
Related papers

Related papers: Change Detection of Markov Kernels with Unknown Pr…

200 papers

We consider the control of a Markov decision process (MDP) that undergoes an abrupt change in its transition kernel (mode). We formulate the problem of minimizing regret under control-switching based on mode change detection, compared to a…

Systems and Control · Electrical Eng. & Systems 2022-10-11 Nathan Dahlin , Subhonmesh Bose , Venugopal V. Veeravalli

We study the multichannel quickest change detection problem with bandit feedback and controlled sensing, in which an agent sequentially selects one of the data streams to observe at each time-step and aims to detect an unknown change as…

Information Theory · Computer Science 2026-03-31 Yu-Han Huang , Argyrios Gerogiannis , Subhonmesh Bose , Venugopal V. Veeravalli

We consider the quickest change detection problem where both the parameters of pre- and post- change distributions are unknown, which prevents the use of classical simple hypothesis testing. Without additional assumptions, optimal solutions…

Machine Learning · Computer Science 2021-06-10 Firas Jarboui , Viannet Perchet

Algorithms are developed for the quickest detection of a change in statistically periodic processes. These are processes in which the statistical properties are nonstationary but repeat after a fixed time interval. It is assumed that the…

Methodology · Statistics 2023-03-07 Yousef Oleyaeimotlagh , Taposh Banerjee , Ahmad Taha , Eugene John

Change-point detection has garnered significant attention due to its broad range of applications, including epidemic disease outbreaks, social network evolution, image analysis, and wireless communications. In an online setting, where new…

Machine Learning · Statistics 2024-08-26 Zihan Wang

This article studies the problem of online non-parametric change point detection in multivariate data streams. We approach the problem through the lens of kernel-based two-sample testing and introduce a sequential testing procedure based on…

Machine Learning · Statistics 2025-10-31 Florian Kalinke , Shakeel Gavioli-Akilagun

Detecting the emergence of abrupt property changes in time series is a challenging problem. Kernel two-sample test has been studied for this task which makes fewer assumptions on the distributions than traditional parametric approaches.…

Machine Learning · Statistics 2019-01-21 Wei-Cheng Chang , Chun-Liang Li , Yiming Yang , Barnabás Póczos

Change-point detection in dynamic networks has received much attention due to its broad applications in social networks and biological systems. Kernel-based methods have shown strong potential for this problem. However, their performance…

Methodology · Statistics 2026-05-15 Mingxuan Sun , Hao Chen

Assume that there are multiple data streams (channels, sensors) and in each stream the process of interest produces generally dependent and non-identically distributed observations. When the process is in a normal mode (in-control), the…

Statistics Theory · Mathematics 2018-07-25 Alexander Tartakovsky

The widespread use of machine learning algorithms calls for automatic change detection algorithms to monitor their behavior over time. As a machine learning algorithm learns from a continuous, possibly evolving, stream of data, it is…

Machine Learning · Statistics 2021-06-29 Lang Liu , Joseph Salmon , Zaid Harchaoui

Change point detection in time series has attracted substantial interest, but most of the existing results have been focused on detecting change points in the time domain. This paper considers the situation where nonlinear time series have…

Methodology · Statistics 2021-11-22 Yan Cui , Jun Yang , Zhou Zhou

A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal; for example, a video of a chaotic pendulums system. Assuming that we know the dynamical model up to some unknown parameters, can we estimate the…

Machine Learning · Statistics 2021-11-24 Ofir Lindenbaum , Amir Sagiv , Gal Mishne , Ronen Talmon

We study the problem of learning sparse structure changes between two Markov networks $P$ and $Q$. Rather than fitting two Markov networks separately to two sets of data and figuring out their differences, a recent work proposed to learn…

Machine Learning · Statistics 2016-04-11 Song Liu , Taiji Suzuki , Raissa Relator , Jun Sese , Masashi Sugiyama , Kenji Fukumizu

The problem of quickest detection of a change in the distribution of a sequence of random variables is studied. The objective is to detect the change with the minimum possible delay, subject to constraints on the rate of false alarms and…

Methodology · Statistics 2024-12-31 Yingze Hou , Hoda Bidkhori , Taposh Banerjee

We consider the problem of sequential change detection, where the goal is to design a scheme for detecting any changes in a parameter or functional $\theta$ of the data stream distribution that has small detection delay, but guarantees…

Statistics Theory · Mathematics 2023-11-28 Shubhanshu Shekhar , Aaditya Ramdas

This paper considers the change-point problem for finite sequences of networks. To avoid the difficulty of computing the normalization coefficient, such as in Exponential random graphical models (ERGMs) and Markov networks, we construct a…

Statistics Theory · Mathematics 2021-01-19 Lei Qiao , Dong Han

Traditional hidden Markov models have been a useful tool to understand and model stochastic dynamic data; in the case of non-Gaussian data, models such as mixture of Gaussian hidden Markov models can be used. However, these suffer from the…

Machine Learning · Statistics 2023-05-16 Carlos Puerto-Santana , Concha Bielza , Pedro Larrañaga , Gustav Eje Henter

The paper addresses a sequential changepoint detection problem, assuming that the duration of change may be finite and unknown. This problem is of importance for many applications, e.g., for signal and image processing where signals appear…

Statistics Theory · Mathematics 2021-06-09 Alexander G. Tartakovsky , Nikita R. Berenkov , Alexei E. Kolessa , Igor V. Nikiforov

While many methods are available to detect structural changes in a time series, few procedures are available to quantify the uncertainty of these estimates post-detection. In this work, we fill this gap by proposing a new framework to test…

Methodology · Statistics 2021-04-16 Sean Jewell , Paul Fearnhead , Daniela Witten

Sequential change-point detection when the distribution parameters are unknown is a fundamental problem in statistics and machine learning. When the post-change parameters are unknown, we consider a set of detection procedures based on…

Statistics Theory · Mathematics 2017-12-06 Yang Cao , Liyan Xie , Yao Xie , Huan Xu