English
Related papers

Related papers: Quickest Change Detection of a Markov Process Acro…

200 papers

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to…

Optimization and Control · Mathematics 2017-09-28 Alice Cleynen , Benoîte de Saporta

We consider a change detection problem in which the arrival rate of a Poisson process changes suddenly at some unknown and unobservable disorder time. It is assumed that the prior distribution of the disorder time is known. The objective is…

Optimization and Control · Mathematics 2007-05-23 Erhan Bayraktar , Semih Sezer

Rapid detection of spatial events that propagate across a sensor network is of wide interest in many modern applications. In particular, in communications, radar, IoT, environmental monitoring, and biosurveillance, we may observe…

Statistics Theory · Mathematics 2023-01-18 Topi Halme , Eyal Nitzan , Visa Koivunen

A weighted Shiryaev-Roberts change detection procedure is shown to approximately minimize the expected delay to detection as well as higher moments of the detection delay among all change-point detection procedures with the given low…

Statistics Theory · Mathematics 2019-09-04 Serguei Pergamenchtchikov , Alexander G. Tartakovsky

Motivated by Industry 4.0 applications, we consider quickest change detection (QCD) of an abrupt change in a process when its measurements are transmitted by a sensor over a lossy wireless link to a decision maker (DM). The sensor node…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Krishna Chaythanya KV , Saqib Abbas Baba , Anurag Kumar , Arpan Chattopadhyay , Rajesh Sundaresan

We address the problem of quickest change detection in Markov processes with unknown transition kernels. The key idea is to learn the conditional score $\nabla_{\mathbf{y}} \log p(\mathbf{y}|\mathbf{x})$ directly from sample pairs $(…

Machine Learning · Computer Science 2025-11-07 Wuxia Chen , Taposh Banerjee , Vahid Tarokh

Optimal control in non-stationary Markov decision processes (MDP) is a challenging problem. The aim in such a control problem is to maximize the long-term discounted reward when the transition dynamics or the reward function can change over…

Applications · Statistics 2017-03-03 Taposh Banerjee , Miao Liu , Jonathan P. How

The problem of quickest growing dynamic anomaly detection in sensor networks is studied. Initially, the observations at the sensors, which are sampled sequentially by the decision maker, are generated according to a pre-change distribution.…

Statistics Theory · Mathematics 2020-02-04 Georgios Rovatsos , Venugopal V. Veeravalli , Don Towsley , Ananthram Swami

The paper deals with a mathematical model of a surveillance system based on a net of sensors. The signals acquired by each node of the net are Markovian process, have two different transition probabilities, which depends on the presence or…

Computer Science and Game Theory · Computer Science 2011-11-22 Krzysztof Szajowski

The problem of quickest detection of a change in distribution is considered under the assumption that the pre-change distribution is known, and the post-change distribution is only known to belong to a family of distributions…

Applications · Statistics 2019-01-30 Tze Siong Lau , Wee Peng Tay , Venugopal V. Veeravalli

We develop a mixture procedure for multi-sensor systems to monitor data streams for a change-point that causes a gradual degradation to a subset of the streams. Observations are assumed to be initially normal random variables with known…

Machine Learning · Statistics 2016-02-19 Yang Cao , Yao Xie , Nagi Gebraeel

Assume that there are multiple data streams (channels, sensors) and in each stream the process of interest produces generally dependent and non-identically distributed observations. When the process is in a normal mode (in-control), the…

Statistics Theory · Mathematics 2018-07-25 Alexander Tartakovsky

In this paper, we develop a new change detection algorithm for detecting a change in the Markov kernel over a metric space in which the post-change kernel is unknown. Under the assumption that the pre- and post-change Markov kernel is…

Systems and Control · Electrical Eng. & Systems 2024-03-28 Hao Chen , Jiacheng Tang , Abhishek Gupta

We consider the problem of sequential detection of a change in the statistical behavior of a hidden Markov model. By adopting a worst-case analysis with respect to the time of change and by taking into account the data that can be accessed…

Statistics Theory · Mathematics 2019-01-29 George V. Moustakides

Many industrial and security applications employ a suite of sensors for detecting abrupt changes in temporal behavior patterns. These abrupt changes typically manifest locally, rendering only a small subset of sensors informative.…

Machine Learning · Computer Science 2023-06-14 Aditya Gopalan , Venkatesh Saligrama , Braghadeesh Lakshminarayanan

This paper addresses the problem of quickest detection of a change in the maximal coherence between columns of a $n\times p$ random matrix based on a sequence of matrix observations having a single unknown change point. The random matrix is…

Statistics Theory · Mathematics 2018-05-01 Taposh Banerjee , Hamed Firouzi , Alfred O. Hero

The paper investigates the problems of quickest change detection in Markov models and hidden Markov models (HMMs). Sequential observations are taken from a (hidden) Markov model. At some unknown time, an event occurs in the system and…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Qi Zhang , Zhongchang Sun , Luis C. Herrera , Shaofeng Zou

The quickest change detection problem is considered in the context of monitoring large-scale independent normal distributed data streams with possible changes in some of the means. It is assumed that for each individual local data stream,…

Statistics Theory · Mathematics 2016-03-18 Yuan Wang , Yajun Mei

In this paper, Bayesian quickest change detection problems with sampling right constraints are considered. Specifically, there is a sequence of random variables whose probability density function will change at an unknown time. The goal is…

Information Theory · Computer Science 2014-07-16 Jun Geng , Erhan Bayraktar , Lifeng Lai

The problem of quickest change detection in a sequence of independent observations is considered. The pre-change distribution is assumed to be known, while the post-change distribution is unknown. Two tests based on post-change density…

Statistics Theory · Mathematics 2023-11-28 Yuchen Liang , Venugopal V. Veeravalli