English
Related papers

Related papers: Two new Markov order estimators

200 papers

We study very simple sorting algorithms based on a probabilistic comparator model. In our model, errors in comparing two elements are due to (1) the energy or effort put in the comparison and (2) the difference between the compared…

Data Structures and Algorithms · Computer Science 2018-05-16 Barbara Geissmann , Paolo Penna

We present a new approach to the bootstrap for chains of infinite order taking values on a finite alphabet. It is based on a sequential Bootstrap Central Limit Theorem for the sequence of canonical Markov approximations of the chain of…

Probability · Mathematics 2007-05-23 P. Collet , D. Duarte , A. Galves

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev

In 2002, in a seminal article, Christoph Bandt and Bernd Pompe proposed a new methodology for the analysis of complex time series, now known as Ordinal Analysis. The ordinal methodology is based on the computation of symbols (known as…

Data Analysis, Statistics and Probability · Physics 2022-06-07 Inmaculada Leyva , Johann Martinez , Cristina Masoller , Osvaldo A. Rosso , Massimiliano Zanin

We introduce a quantitative method to compare arbitrary pairs of graph centrality measures, based on the ordering of vertices induced by them. The proposed method is conceptually simple, mathematically elegant, and allows for a quantitative…

Social and Information Networks · Computer Science 2026-01-26 G. Exarchakos , R. van der Hofstad , O. Nagy , M. Pandey

A randomized algorithm for finding sparse cuts is given which is based on constructing a dual markov chain called multiscale rings process(MRP) and a new concept of entropy. It is shown how the time to absorption of the dual process…

Probability · Mathematics 2022-03-16 Farshad Noravesh

We describe an exact test of the null hypothesis that a Markov chain is nth order versus the alternate hypothesis that it is $(n+1)$-th order. The procedure does not rely on asymptotic properties, but instead builds up the test statistic…

Data Analysis, Statistics and Probability · Physics 2013-02-07 Shawn D. Pethel , Daniel W. Hahs

We show how to construct a topological Markov map of the interval whose invariant probability measure is the stationary law of a given stochastic chain of infinite order. In particular we caracterize the maps corresponding to stochastic…

Probability · Mathematics 2015-06-05 Pierre Collet , Antonio Galves

We derive explicit upper bounds for the $\bar{d}$-distance between a chain of infinite order and its canonical $k$-steps Markov approximation. Our proof is entirely constructive and involves a "coupling from the past" argument. The new…

Probability · Mathematics 2012-01-16 Sandro Gallo , Matthieu Lerasle , Daniel Yasumasa Takahashi

Motivated by robotic surveillance applications, this paper studies the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with travel times and stationary distribution. The return time entropy…

Optimization and Control · Mathematics 2018-05-29 Xiaoming Duan , Mishel George , Francesco Bullo

We present an algorithm that can efficiently compute a broad class of inferences for discrete-time imprecise Markov chains, a generalised type of Markov chains that allows one to take into account partially specified probabilities and other…

Probability · Mathematics 2019-07-02 Natan T'Joens , Thomas Krak , Jasper De Bock , Gert de Cooman

The present work is dedicated to searching parameters, alternative to entropy, applicable for description of highly organized systems. The general concept has been offered, in which the system complexity and order are functions of the order…

Information Theory · Computer Science 2010-09-03 V. I. Ilyevsky

This paper addresses the question of the fluctuations of the empirical entropy of a chain of infinite order. We assume that the chain takes values on a finite alphabet and loses memory exponentially fast. We consider two possible…

Statistical Mechanics · Physics 2007-05-23 D. Gabrielli , A. Galves , D. Guiol

We consider a two-node queue modeled as a two-dimensional random walk. In particular, we consider the case that one or both queues have finite buffers. We develop an approximation scheme based on the Markov reward approach to error bounds…

Probability · Mathematics 2020-10-28 Yanting Chen , Xinwei Bai , Richard J. Boucherie , Jasper Goseling

We observe a length-$n$ sample generated by an unknown,stationary ergodic Markov process (\emph{model}) over a finite alphabet $\mathcal{A}$. Given any string $\bf{w}$ of symbols from $\mathcal{A}$ we want estimates of the conditional…

Information Theory · Computer Science 2014-06-11 Meysam Asadi , Ramezan Paravi Torghabeh , Narayana P. Santhanam

We present a novel method for computing reachability probabilities of parametric discrete-time Markov chains whose transition probabilities are fractions of polynomials over a set of parameters. Our algorithm is based on two key…

Software Engineering · Computer Science 2014-03-28 Nils Jansen , Florian Corzilius , Matthias Volk , Ralf Wimmer , Erika Ábrahám , Joost-Pieter Katoen , Bernd Becker

We present an algorithm for learning mixtures of Markov chains and Markov decision processes (MDPs) from short unlabeled trajectories. Specifically, our method handles mixtures of Markov chains with optional control input by going through a…

Machine Learning · Statistics 2023-02-07 Chinmaya Kausik , Kevin Tan , Ambuj Tewari

In this paper, we study the concentration properties of quadratic forms associated with Markov chains using the martingale decomposition method introduced by Atchad\'e and Cattaneo (2014). In particular, we derive concentration inequalities…

Probability · Mathematics 2025-05-14 Eric Moulines , Alexey Naumov , Sergey Samsonov

We introduce the Conditional Mutual Information (CMI) for the estimation of the Markov chain order. For a Markov chain of $K$ symbols, we define CMI of order $m$, $I_c(m)$, as the mutual information of two variables in the chain being $m$…

Data Analysis, Statistics and Probability · Physics 2013-01-03 Maria Papapetrou , Dimitris Kugiumtzis