English
Related papers

Related papers: Asymptotically Optimal Sequential Testing with Mar…

200 papers

We study sequential multiple testing with independent data streams, where the goal is to identify an unknown subset of signals while controlling commonly used error metrics, including generalized familywise rates and false discovery and…

Statistics Theory · Mathematics 2026-03-06 Jingyu Liu , Yanglei Song

We exhibit an efficient procedure for testing, based on a single long state sequence, whether an unknown Markov chain is identical to or $\varepsilon$-far from a given reference chain. We obtain nearly matching (up to logarithmic factors)…

Machine Learning · Statistics 2019-09-26 Geoffrey Wolfer , Aryeh Kontorovich

New goodness-of-fit tests for Markovian models in time series analysis are developed which are based on the difference between a fully nonparametric estimate of the one-step transition distribution function of the observed process and that…

Statistics Theory · Mathematics 2008-12-18 Michael H. Neumann , Efstathios Paparoditis

A multi-armed bandit with finitely many arms is studied when each arm is a homogeneous Markov process on an underlying finite state space. The transition law of one of the arms, referred to as the odd arm, is different from the common…

Information Theory · Computer Science 2019-12-06 P. N. Karthik , Rajesh Sundaresan

We consider stochastic optimization problems where data is drawn from a Markov chain. Existing methods for this setting crucially rely on knowing the mixing time of the chain, which in real-world applications is usually unknown. We propose…

Machine Learning · Computer Science 2023-07-14 Ron Dorfman , Kfir Y. Levy

Time estimation is a fundamental task that underpins precision measurement, global navigation systems, financial markets, and the organisation of everyday life. Many biological processes also depend on time estimation by nanoscale clocks,…

This article develops a method to construct the optimal sequential test for monitoring the changes in the distribution of finite observation sequences with a general dependence structure. This method allows us to prove that different…

Statistics Theory · Mathematics 2019-08-01 Dong Han , Fugee Tsung , Jinguo Xian

We introduce the concept of asymptotic period for an irreducible and aperiodic, discrete-time Markov chain X on a countable state space, and develop the theory leading to its formal definition. The asymptotic period of X equals one - its…

Probability · Mathematics 2019-03-05 Erik A. van Doorn

Observing stochastic trajectories with rare transitions between states, practically undetectable on time scales accessible to experiments, makes it impossible to directly quantify the entropy production and thus infer whether and how far…

Statistical Mechanics · Physics 2025-12-15 Marco Baiesi , Tomohiro Nishiyama , Gianmaria Falasco

Markov chain Monte Carlo(MCMC) is a popular approach to sample from high dimensional distributions, and the asymptotic variance is a commonly used criterion to evaluate the performance. While most popular MCMC algorithms are reversible,…

Probability · Mathematics 2018-02-06 Chi-Hao Wu , Ting-Li Chen

We present a novel algorithm to solve a non-linear system of equations, whose solution can be interpreted as a tight lower bound on the vector of expected hitting times of a Markov chain whose transition probabilities are only partially…

Probability · Mathematics 2022-03-30 Thomas Krak

We study the problem of learning the transition matrices of a set of Markov chains from a single stream of observations on each chain. We assume that the Markov chains are ergodic but otherwise unknown. The learner can sample Markov chains…

Machine Learning · Computer Science 2019-11-14 Mohammad Sadegh Talebi , Odalric-Ambrym Maillard

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

This article provides the first procedure for computing a fully data-dependent interval that traps the mixing time $t_{\text{mix}}$ of a finite reversible ergodic Markov chain at a prescribed confidence level. The interval is computed from…

Machine Learning · Computer Science 2015-11-04 Daniel Hsu , Aryeh Kontorovich , Csaba Szepesvári

A random sequence having two segments being the homogeneous Markov processes is registered. Each segment has his own transition probability law and the length of the segment is unknown and random. The transition probabilities of each…

Statistics Theory · Mathematics 2020-11-17 A. Ochman-Gozdek , W. Sarnowski , K. J. Szajowski

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

We investigate the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution in a sequential setup. The aim is to jointly infer the true hypothesis and the true parameter while using on…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

A novel sequential change detection problem is proposed, in which the goal is to not only detect but also accelerate the change. Specifically, it is assumed that the sequentially collected observations are responses to treatments selected…

Statistics Theory · Mathematics 2024-06-24 Yanglei Song , Georgios Fellouris

A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic…

Systems and Control · Electrical Eng. & Systems 2024-03-11 Zhi Zhang , Chenyu Ma , Saleh Soudijani , Sadegh Soudjani

Markov chains can be used to generate samples whose distribution approximates a given target distribution. The quality of the samples of such Markov chains can be measured by the discrepancy between the empirical distribution of the samples…

Computation · Statistics 2016-01-18 Josef Dick , Daniel Rudolf , Houying Zhu