Related papers: Markov Duality for Stochastic Six Vertex Model
Let $S_N$ be the sum of vector-valued functions defined on a finite Markov chain. An analogue of the Bernstein--Hoeffding inequality is derived for the probability of large deviations of $S_N$ and relates the probability to the spectral gap…
We develop a novel theory of weak and strong stochastic integration for cylindrical martingale-valued measures taking values in the dual of a nuclear space. This is applied to develop a theory of SPDEs with rather general coefficients. In…
We study discrete flow equivalence of two-sided topological Markov shifts by using extended Ruelle algebras. We characterize flow equivalence of two-sided topological Markov shifts in terms of conjugacy of certain actions weighted by…
In this work, we investigate a theory of stochastic integration for operator-valued processes with respect to semimartingales taking values in the dual of a nuclear space. Our construction of this particular stochastic integral relies on…
The Hankel determinant representations for the partition function and boundary correlation functions of the six-vertex model with domain wall boundary conditions are investigated by the methods of orthogonal polynomial theory. For specific…
The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…
Markov-modulated fluid queues are popular stochastic processes frequently used for modelling real-life applications. An important performance measure to evaluate in these applications is their steady-state behaviour, which is determined by…
In this paper, a class of non-Markovian forward-backward doubly stochastic systems is studied. By using the technique of functional It\^o (or path-dependent) calculus, the relationship between the systems and related path-dependent…
We prove the Lefschetz duality for intersection (co)homology in the framework of $\partial$-pesudomanifolds. We work with general perversities and without restriction on the coefficient ring.
Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…
We consider any fixed $d\in\mathbb{Z}_{>0}$ number of second class particles in the asymmetric simple exclusion process (ASEP), constructed via a basic coupling of two ASEPs. We give the joint distribution of the positions of the second…
In this paper, we establish the law of the iterated logarithm for a wide class of non-stationary, continuous-time Markov processes evolving on Polish spaces. Specifically, our result applies to certain additive functionals of processes…
This work focuses on a class of semi-linear functional stochastic partial differential equations with Markovian switching, in which the switching component may have finite or countably infinite states. The well-posedness of the underlying…
We study the online estimation of the optimal policy of a Markov decision process (MDP). We propose a class of Stochastic Primal-Dual (SPD) methods which exploit the inherent minimax duality of Bellman equations. The SPD methods update a…
Density function describes the density of states in the state space of a dynamic system or a Markov Decision Process (MDP). Its evolution follows the Liouville equation. We show that the density function is the dual of the value function in…
The paper is dedicated to the study of strong duality for a problem of linear copositive programming. Based on the recently introduced concept of the set of normalized immobile indices, an extended dual problem is deduced. The dual problem…
We prove a positivity theorem for a certain family of operators defined in terms of the stochastic six-vertex model. We explore connections of this result with other vertex models and $t$-deformed Schensted insertions.
This is the first part of a possible monograph on the duality of Markov processes. It contains a proof of Fitzsimmons' existence theorem of a moderate Markov dual process relative to an excessive measure, m, together with the necessary…
Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer $k$-th order Markov chains, for arbitrary $k$, from finite data by applying Bayesian methods to both…
An explicit sufficient condition on the hypercontractivity is derived for the Markov semigroup associated to a class of functional stochastic differential equations. Consequently, the semigroup $P_t$ converges exponentially to its unique…