English
Related papers

Related papers: Time multidimensional Markov Renewal chains -- An …

200 papers

The expansion of global production networks has raised many important questions about the interdependence among countries and how future changes in the world economy are likely to affect the countries' positioning in global value chains. We…

General Economics · Economics 2020-05-20 Olivera Kostoska , Viktor Stojkoski , Ljupco Kocarev

In this paper, we consider a general class of two-time-scale Markov chains whose transition rate matrix depends on a parameter $\lambda>0$. We assume that some transition rates of the Markov chain will tend to infinity as…

Probability · Mathematics 2015-07-10 Chen Jia

General Markov chains with a countably additive transition probability in arbitrary phase space are considered. Markov operators extend from the space of countably additive measures to the space of finitely additive measures. In the…

Probability · Mathematics 2018-04-10 Alexander I. Zhdanok

Markov chains with variable length are useful parsimonious stochastic models able to generate most stationary sequence of discrete symbols. The idea is to identify the suffixes of the past, called contexts, that are relevant to predict the…

Machine Learning · Computer Science 2022-01-10 Victor Freguglia , Nancy Garcia

When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This can be done by considering as basic uncertainty models the so-called credal sets that…

Probability · Mathematics 2009-11-24 Gert de Cooman , Filip Hermans , Erik Quaeghebeur

A new object of the probability theory, two-sided chain of events (symbols), is introduced. A theory of multi-steps Markov chains with long-range memory, proposed earlier in Phys. Rev. E 68, 06117 (2003), is developed and used to establish…

Data Analysis, Statistics and Probability · Physics 2007-05-23 S. S. Apostolov , Z. A. Mayzelis , O. V. Usatenko , V. A. Yampol'skii

In this paper we consider multivariate time series obtained as solution to multidimensional nonlinear stochastic difference equations whose coefficients are allowed to be locally degenerate and to present discontinuities. We provide simple…

Probability · Mathematics 2012-09-07 Marco Ferrante , Giovanni Fonseca

Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…

Probability · Mathematics 2025-10-24 Minjun Kim , Seokhwan Moon , Jinsu Kim

This article proposes a new generalization of the Multivariate Markov Chains (MMC) model. The future values of a Markov chain commonly depend on only the past values of the chain in an autoregressive fashion. The generalization proposed in…

Methodology · Statistics 2022-02-02 Carolina Vasconcelos , Bruno Damásio

Tensor structured Markov chains are part of stochastic models of many practical applications, e.g., in the description of complex production or telephone networks. The most interesting question in Markov chain models is the determination of…

Numerical Analysis · Mathematics 2015-05-08 Matthias Bolten , Karsten Kahl , Sonja Sokolović

In this brief note, we find formulas for the distribution and the transition probability matrices of a stochastic process described as a time-reversion in a finite time window of a Markov chain, with cluster observation of the Markov state…

Probability · Mathematics 2022-06-14 Daniel A. Gutierrez-Pachas , Eduardo F. Costa , Alessandro N. Vargas

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer $k$-th order Markov chains, for arbitrary $k$, from finite data by applying Bayesian methods to both…

Statistics Theory · Mathematics 2009-11-13 Christopher C. Strelioff , James P. Crutchfield , Alfred W. Hubler

General Markov chains in an arbitrary phase space are considered in the framework of the operator treatment. Markov operators continue from the space of countably additive measures to the space of finitely additive measures. Cycles of…

Probability · Mathematics 2020-12-09 Alexander I. Zhdanok

Consider an ergodic Markov chain on a countable state space for which the return times have exponential tails. We show that the stationary version of any such chain is a finitary factor of an i.i.d. process. A key step is to show that any…

Probability · Mathematics 2023-06-22 Omer Angel , Yinon Spinka

In many dynamical systems in nature, the law of the dynamics changes along with the temporal evolution of the system. These changes are often associated with the occurrence of certain events. The timing of occurrence of these events…

Probability · Mathematics 2021-07-12 S. Gallo , G. Iacobelli , G. Ost , D. Y. Takahashi

We consider exchangeable Markov multi-state survival processes -- temporal processes taking values over a state-space$\mathcal{S}$ with at least one absorbing failure state $\flat \in \mathcal{S}$ that satisfy natural invariance properties…

Methodology · Statistics 2018-10-26 Walter Dempsey

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock

The two-parameter Macdonald polynomials are a central object of algebraic combinatorics and representation theory. We give a Markov chain on partitions of k with eigenfunctions the coefficients of the Macdonald polynomials when expanded in…

Probability · Mathematics 2010-07-28 Persi Diaconis , Arun Ram

The extremes of a univariate Markov chain with regulary varying stationary marginal distribution and asymptotically linear behavior are known to exhibit a multiplicative random walk structure called the tail chain. In this paper, we extend…

Probability · Mathematics 2014-02-04 Anja Janßen , Johan Segers