Related papers: W-Markov measures, transfer operators, wavelets an…

Functional inequalities such as the Poincar\'e and log-Sobolev inequalities quantify convergence to equilibrium in continuous-time Markov chains by linking generator properties to variance and entropy decay. However, many applications,…

Dynamical systems are often subject to forcing or changes in their governing parameters and it is of interest to study how this affects their statistical properties. A prominent real-life example of this class of problems is the…

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…

The problem of real-time remote tracking and reconstruction of a two-state Markov process is considered here. A transmitter sends samples from an observed information source to a remote monitor over an unreliable wireless channel. The…

In this review-type paper written at the occasion of the Oberwolfach workshop {\em One-sided vs. Two-sided stochastic processes} (february 22-29, 2020), we discuss and compare Markov properties and generalisations thereof in more…

We consider some random iterated function systems on the interval and show that the invariant measure has density in $\mathcal{C}^\infty$. To prove this we use some techniques for contractions in cone metrics, applied to the transfer…

For a Markov chain both the detailed balance condition and the cycle Kolmogorov condition are algebraic binomials. This remark suggests to study reversible Markov chains with the tool of Algebraic Statistics, such as toric statistical…

We introduce the problem of formally verifying properties of Markov processes where the parameters are given by the output of machine learning models. For a broad class of machine learning models, including linear models, tree-based models,…

We construct and study branching Markov processes on the space of finite configurations of the state space of a given standard process, controlled by a branching kernel and a killing one. In particular, we may start with a superprocess,…

The matrix of a permutation is a partial case of Markov transition matrices. In the same way, a measure preserving bijection of a space A with finite measure is a partial case of Markov transition operators. A Markov transition operator…

We consider a perturbed system $(X,\varphi(\epsilon,\cdot))$, where $X$ is a topological Markov shift with a countably infinite state space, and $\varphi(\epsilon,\cdot)$ is a real-valued potential on X depending on a small parameter…

We consider the problem of defining and fitting models of autoregressive time series of probability distributions on a compact interval of $\mathbb{R}$. An order-$1$ autoregressive model in this context is to be understood as a Markov…

We consider a Markov chain on non-negative integer arrays of a given shape (and satisfying certain constraints) which is closely related to fundamental $SL(r+1,\mathbb{R})$ Whittaker functions and the Toda lattice. In the index zero case…

We develop a practical approach to establish the stability, that is, the recurrence in a given set, of a large class of controlled Markov chains. These processes arise in various areas of applied science and encompass important numerical…

We consider a control problem for a finite-state Markov system whose performance is evaluated by a coherent Markov risk measure. For each policy, the risk of a state is approximated by a function of its features, thus leading to a…

Let $\mathbb{P}$ be the complete metric space consisting of positive invertible operators on an infinite-dimensional Hilbert space with the Thompson metric. We introduce the notion of operator means of probability measures on $\mathbb{P}$,…

Markov chains are fundamental models for stochastic dynamics, with applications in a wide range of areas such as population dynamics, queueing systems, reinforcement learning, and Monte Carlo methods. Estimating the transition matrix and…

We consider evaluation of proper posterior distributions obtained from improper prior distributions. Our context is estimating a bounded function $\phi$ of a parameter when the loss is quadratic. If the posterior mean of $\phi$ is…

This paper concerns the random source problems for the time-harmonic acoustic and elastic wave equations in two and three dimensions. The goal is to determine the compactly supported external force from the radiated wave field measured in a…

This paper has solved the inverse eigenvalue problem for "fixed-free" mass-chain systems with inerters. It is well known that for a spring-mass system wherein the adjacent masses are linked through a spring, the natural frequency assignment…