Related papers: Equivalent CM Models
We present a theoretical framework to tackle quantum non-Markovian dynamics based on a microscopic collision model (CM), where the bath consists of a large collection of initially uncorrelated ancillas. Unlike standard memoryless CMs, we…
The information encoded into an open quantum system that evolves under a Markovian dynamics is always monotonically non-increasing. Nonetheless, for a given quantifier of the information contained in the system, it is in general not clear…
The modeling of natural phenomena via a Markov process --- a process for which the future is independent of the past, given the present--- is ubiquitous in many fields of science. Within this context, it is of foremost importance to develop…
This supplementary material includes three parts: some preliminary results, four examples, an experiment, three new algorithms, and all proofs of the results in the paper "Reversible MCMC on Markov equivalence classes of sparse directed…
With a sequence of regressions, one may generate joint probability distributions. One starts with a joint, marginal distribution of context variables having possibly a concentration graph structure and continues with an ordered sequence of…
To provide a more accurate description of the driving behaviors in vehicle queues, a namely Markov-Gap cellular automata model is proposed in this paper. It views the variation of the gap between two consequent vehicles as a Markov process…
It is well known that there may be many causal explanations that are consistent with a given set of data. Recent work has been done to represent the common aspects of these explanations into one representation. In this paper, we address…
We propose prior distributions for all parts of the specification of a Markov mesh model. In the formulation we define priors for the sequential neighborhood, for the parametric form of the conditional distributions and for the parameter…
Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…
This chapter presents an introduction to Markovian modeling for the analysis of sequence data. Contrary to the deterministic approach seen in the previous sequence analysis chapters, Markovian models are probabilistic models, focusing on…
Model checking is usually based on a comprehensive traversal of the state space. Causality-based model checking is a radically different approach that instead analyzes the cause-effect relationships in a program. We give an overview on a…
In this paper we continue the study of conditional Markov chains (CMCs) with finite state spaces, that we initiated in Bielecki, Jakubowski and Niew\k{e}g\l owski (2015). Here, we turn our attention to the study of Markov consistency and…
Under a markovian evolutionary process, the expected number of substitutions per site (also called branch length) that have occurred when a sequence has evolved from another according to a transition matrix $P$ can be approximated by…
The behavior of extreme observations is well-understood for time series or spatial data, but little is known if the data generating process is a structural causal model (SCM). We study the behavior of extremes in this model class, both for…
We study the backwards Markov chain for the Bak-Sneppen model of biological evolution and derive its corresponding reversibility equations. We show that, in contrast to the forwards Markov chain, the dynamics of the backwards chain…
We study a new class of Markov games, \emph(multi-player) zero-sum Markov Games} with \emph{Networked separable interactions} (zero-sum NMGs), to model the local interaction structure in non-cooperative multi-agent sequential…
We propose a Bayesian inference approach for a class of latent Markov models. These models are widely used for the analysis of longitudinal categorical data, when the interest is in studying the evolution of an individual unobservable…
We propose a class of non-Markov population models with continuous or discrete state space via a limiting procedure involving sequences of rescaled and randomly time-changed Galton--Watson processes. The class includes as specific cases the…
Collision models (CMs) describe an open system interacting in sequence with elements of an environment, termed ancillas. They have been established as a useful tool for analyzing non-Markovian open quantum dynamics based on the ability to…
We provide a large class of quantum evolution governed by the memory kernel master equation. This class defines quantum analog of so called semi-Markov classical stochastic evolution. In this Letter for the first time we provide a proper…