Related papers: Doob equivalence and non-commutative peaking for M…
Order-preserving couplings are elegant tools for obtaining robust estimates of the time-dependent and stationary distributions of Markov processes that are too complex to be analyzed exactly. The starting point of this paper is to study…
This is a revised version of the doctoral dissertation of the same title, written under the supervision of Professor Krzysztof Stempak in 2019. For general (possibly nondoubling) metric measure spaces various properties of the associated…
We show how to construct a topological Markov map of the interval whose invariant probability measure is the stationary law of a given stochastic chain of infinite order. In particular we caracterize the maps corresponding to stochastic…
In this work we define a stochastic adding machine associated to the Fibonacci base and to a probabilities sequence $\overline{p}=(p_i)_{i\geq 1}$. We obtain a Markov chain whose states are the set of nonnegative integers. We study…
We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory…
Big networks express various large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems. This paper analyzes such big…
We consider stochastic differential equations, obtained by adding weak Gaussian white noise to ordinary differential equations admitting $N$ asymptotically stable periodic orbits. We construct a discrete-time, continuous-space Markov chain,…
Doob fixed-time conditioning enables the sampling of rare trajectories of Markov processes by modifying the drift so that reaching a prescribed target at a given time is guaranteed. We study the statistics of this conditioned path ensemble…
Expanding upon the rich history of algebraic techniques in probability, we show the existence of and construct a Markov chain using the Hopf square map on a quantum group that is both non-commutative and non-cocommutative. This extends the…
Different directed acyclic graphs (DAGs) may be Markov equivalent in the sense that they entail the same conditional independence relations among the observed variables. Meek (1995) characterizes Markov equivalence classes for DAGs (with no…
A theory of symbolic dynamic systems with long-range correlations based on the consideration of the binary N-step Markov chains developed earlier in Phys. Rev. Lett. 90, 110601 (2003) is generalized to the biased case (non equal numbers of…
Recent developments have found unexpected connections between non-commutative probability theory and algebraic topology. In particular, Boolean cumulants functionals seem to be important for describing morphisms of homotopy operadic…
We prove exponential decay of pair correlations for 1D stationary point processes when spacings satisfy a Markov condition, geometric ergodicity, and a condition on exponential moments. The conditions are phrased for stationary sequences of…
We consider a stochastic factor financial model where the asset price process and the process for the stochastic factor depend on an observable Markov chain and exhibit an affine structure. We are faced with a finite time investment horizon…
We analyze the global convergence of the power iterates for the computation of a general mixed-subordinate matrix norm. We prove a new global convergence theorem for a class of entrywise nonnegative matrices that generalizes and improves a…
The main objective of this paper is to investigate the spectral properties, maximum principles, and shape optimization problems for a broad class of nonlinear ``superposition operators" defined as continuous superpositions of operators of…
Probabilistic programming is related to a compositional approach to stochastic modeling by switching from discrete to continuous time dynamics. In continuous time, an operator-algebra semantics is available in which processes proceeding in…
We are interested in risk constraints for infinite horizon discrete time Markov decision processes (MDPs). Starting with average reward MDPs, we show that increasing concave stochastic dominance constraints on the empirical distribution of…
Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…
Maximum likelihood estimators are often of limited practical use due to the intensive computation they require. We propose a family of alternative estimators that maximize a stochastic variation of the composite likelihood function. Each of…