English
Related papers

Related papers: Ziv-Merhav estimation for hidden-Markov processes

200 papers

This is a survey paper about reciprocal processes. The bridges of a Markov process are also Markov. But an arbitrary mixture of these bridges fails to be Markov in general. However, it still enjoys the interesting properties of a reciprocal…

Probability · Mathematics 2022-09-05 Christian Léonard , Sylvie Roelly , Jean-Claude Zambrini

We consider a recurrent Markov process which is an It\^o semi-martingale. The L\'evy kernel describes the law of its jumps. Based on observations X(0),X({\Delta}),...,X(n{\Delta}), we construct an estimator for the L\'evy kernel's density.…

Statistics Theory · Mathematics 2013-05-14 Florian A. J. Ueltzhöfer

In this article we present a methodology to estimate the Transfer Entropy Rate between two systems through the Lempel-Ziv complexity. This methodology carries a set of practical advantages: it can be estimated from two single discrete…

Applications · Statistics 2020-05-20 Juan F. Restrepo , Diego M. Mateos , Gastón Schlotthauer

Explicit rate of convergence in variance (or more general entropies) is obtained for a class of Piecewise Deterministic Markov Processes such as the TCP process, relying on functional inequalities. A method to establish Poincar\'e (and more…

Probability · Mathematics 2015-09-14 Pierre Monmarché

For discrete-time stochastic processes, there is a close connection between return/waiting times and entropy. Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one…

Probability · Mathematics 2007-05-23 Jean-Rene Chazottes , Cristian Giardina , Frank Redig

In this paper, a kernel estimator of the differential entropy of the mark distribution of a homogeneous Poisson marked point process is proposed. The marks have an absolutely continuous distribution on a compact Riemannian manifold without…

Probability · Mathematics 2016-08-09 Alonso-Ruiz , Spodarev

We prove a strong law of large numbers for a class of strongly mixing processes. Our result rests on recent advances in understanding of concentration of measure. It is simple to apply and gives finite-sample (as opposed to asymptotic)…

Probability · Mathematics 2008-07-30 Aryeh Kontorovich , Anthony Brockwell

Hidden Markov models are traditionally decoded by the Viterbi algorithm which finds the highest probability state path in the model. In recent years, several limitations of the Viterbi decoding have been demonstrated, and new algorithms…

Data Structures and Algorithms · Computer Science 2013-08-06 Michal Nánási , Tomáš Vinař , Broňa Brejová

Closely related to the laws of thermodynamics, the detection and quantification of disequilibria are crucial in unraveling the complexities of nature, particularly those beneath observable layers. Theoretical developments in nonequilibrium…

Statistical Mechanics · Physics 2024-07-23 Pedro E. Harunari

We propose two different approaches for introducing the information temperature of the binary N-th order Markov chains. The first approach is based on comparing the Markov sequences with the equilibrium Ising chains at given temperatures.…

Data Analysis, Statistics and Probability · Physics 2022-10-05 O. V. Usatenko , S. S. Melnyk , G. M. Pritula , V. A. Yampol'skii

This paper introduces a new parsimonious structure for mixture of autoregressive models. the weighting coefficients are determined through latent random variables, following a hidden Markov model. We propose a dynamic programming algorithm…

Statistics Theory · Mathematics 2011-05-12 S. H. Alizadeh , S. Rezakhah

In this paper, we investigate a nonparametric approach to provide a recursive estimator of the transition density of a non-stationary piecewise-deterministic Markov process, from only one observation of the path within a long time. In this…

Statistics Theory · Mathematics 2013-05-07 Romain Azaïs

Consider a one-sided Markov additive process with an upper and a lower barrier, where each can be either reflecting or terminating. For both defective and non-defective processes and all possible scenarios we identify the corresponding…

Probability · Mathematics 2013-09-20 Jevgenijs Ivanovs

Hidden Markov Models, HMM's, are mathematical models of Markov processes with state that is hidden, but from which information can leak. They are typically represented as 3-way joint-probability distributions. We use HMM's as denotations of…

Logic in Computer Science · Computer Science 2023-06-22 Annabelle McIver , Carroll Morgan , Tahiry Rabehaja

Hidden Markov models provide a natural statistical framework for the detection of the copy number variations (CNV) in genomics. In this paper, we consider a Hidden Markov Model involving several correlated hidden processes at the same time.…

Methodology · Statistics 2017-06-22 Xiaoqiang Wang , Emilie Lebarbier , Julie Aubert , Stéphane Robin

Cross-sectional observations from a dynamical system can be modeled via steady-state distributions of Markov processes. The major challenge is then to determine whether the process parameters can be identified and estimated from the…

Statistics Theory · Mathematics 2026-03-19 Cecilie Olesen Recke , Niels Richard Hansen

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to…

Statistical Mechanics · Physics 2015-11-13 John Bechhoefer

For a network of discrete states with a periodically driven Markovian dynamics, we develop an inference scheme for an external observer who has access to some transitions. Based on waiting-time distributions between these transitions, the…

Statistical Mechanics · Physics 2024-09-12 Alexander M. Maier , Julius Degünther , Jann van der Meer , Udo Seifert

We introduce and study a family of Markov processes on partitions. The processes preserve the so-called z-measures on partitions previously studied in connection with harmonic analysis on the infinite symmetric group. We show that the…

Mathematical Physics · Physics 2007-05-23 Alexei Borodin , Grigori Olshanski

This paper considers a simulation-based estimator for a general class of Markovian processes and explores some strong consistency properties of the estimator. The estimation problem is defined over a continuum of invariant distributions…

Probability · Mathematics 2010-01-14 Manuel S. Santos