Related papers: Why is Kemeny's constant a constant?
When the initial and transition probabilities of a finite Markov chain in discrete time are not well known, we should perform a sensitivity analysis. This is done by considering as basic uncertainty models the so-called credal sets that…
We study continuous-time Markov chains on the non-negative integers under mild regularity conditions (in particular, the set of jump vectors is finite and both forward and backward jumps are possible). Based on the so-called flux balance…
A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the…
For a qualitative analysis of spectra of certain two-dimensional rectangular-well quantum systems several rigorous methods of number theory are shown productive and useful. These methods (and, in particular, a generalization of the concept…
This letter explores how a reinterpretation of the generalized uncertainty principle as an effective variation of Planck's constant provides a physical explanation for a number of fundamental quantities and couplings. In this context, a…
A decade ago, Abdulla, Ben Henda and Mayr introduced the elegant concept of decisiveness for denumerable Markov chains [1]. Roughly speaking, decisiveness allows one to lift most good properties from finite Markov chains to denumerable…
In his 2011 work, Maas has shown that the law of any time-reversible continuous-time Markov chain with finite state space evolves like a gradient flow of the relative entropy with respect to its stationary distribution. In this work we show…
Our recent interest is focused on establishing the necessary and sufficient conditions that guarantee a long-term stable evolution of both natural and artificial systems. Two necessary conditions, called global and local boundedness, are…
In this study, a new extension of the Markov Renewal theory is introduced by allowing time to evolve in multiple dimensions. The resulting chains are referred to as multi-time Markov Renewal chains and since this extension is new, the state…
We briefly review the various contexts within which one might address the issue of ``why'' the dimensionless constants of Nature have the particular values that they are observed to have. Both the general historical trend, in physics, of…
It is shown that the stochastic model of Fenyes and Nelson can be generalized in such a way that the diffusion constant of the Markov theory becomes a free parameter. This extra freedom allows one to identify quantum mechanics with a class…
A strong negative dependence property for measures on {0,1}^n - stability - was recently developed in [5], by considering the zero set of the probability generating function. We extend this property to the more general setting of…
We analyse the structure of imprecise Markov chains and study their convergence by means of accessibility relations. We first identify the sets of states, so-called minimal permanent classes, that are the minimal sets capable of containing…
The trace anomaly and the cosmological constant problem are two typical breakdowns when applying the quantum principle to a general covariant or gravitational system. A quantum theory of spacetime reference frame is proposed and reviewed.…
Symbolic dynamics has proven to be an invaluable tool in analyzing the mechanisms that lead to unpredictability and random behavior in nonlinear dynamical systems. Surprisingly, a discrete partition of continuous state space can produce a…
An accelerated universe should naturally have a vacuum energy density determined by its dynamical curvature. The cosmological constant is most likely a temporary description of a dynamical variable that has been drastically evolving from…
In this paper we continue the study of conditional Markov chains (CMCs) with finite state spaces, that we initiated in Bielecki, Jakubowski and Niew\k{e}g{\l}owski (2014a) in an effort to enrich the theory of CMCs that was originated in…
Let $d >1$ and $(A_n)_{n \ge 1}$ be a sequence of independent identically distributed random matrices with nonnegative entries and no zero column. This induces a Markov chain $M_n = A_n M_{n-1}$ on the cone of d-vectors with nonnegative…
Poisson's equation plays a fundamental role as a tool for performance evaluation and optimization of Markov chains. For continuous-time birth-death chains with possibly unbounded transition and cost rates as addressed herein, when…
Motivated by the notion of resistance distance on graph, we define a new resistance distance between two states on a given finite ergodic Markov chain based on its fundamental matrix. We prove a few equivalent formulations and discuss its…