Related papers: Erratum: Coding map for a contractive Markov syste…
We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These…
In this article we study the expanding properties of random perturbations of contracting Lorenz maps satisfying the summability condition of exponent 1. Under general conditions on the maps and perturbation types, we prove stochastic…
We consider the limit set of generalised iterated function systems. Under the assumption of a natural potential, the so called cylinder function, we prove the existence of the invariant probability measure satisfying the equilibrium state.…
The Markov assumption in Markov Decision Processes (MDPs) is fundamental in reinforcement learning, influencing both theoretical research and practical applications. Existing methods that rely on the Bellman equation benefit tremendously…
The problem of distributed testing against independence with variable-length coding is considered when the \emph{average} and not the \emph{maximum} communication load is constrained as in previous works. The paper characterizes the optimum…
We derive the multifractal analysis of the conformal measure (or equivalently, the invariant measure) associated to a family of weights imposed upon a (multi-dimensional) graph directed Markov system (GDMS) using balls as the filtration.…
Let $G = (V,E)$ be a connected graph. A probability measure $\mu$ on $V$ is called "balanced" if it has the following property: if $T_\mu(v)$ denotes the "earth mover's" cost of transporting all the mass of $\mu$ from all over the graph to…
We find conditions for stationary measures of random dynamical systems on surfaces having dissipative diffeomorphisms to be absolutely continuous. These conditions involve a uniformly expanding on average property in the future (UEF) and…
In [6], a constraint on invariant measures of bi-permutative cellular automata has been observed: fixed values at the positive indices determine almost-surely a uniform conditional probability on the subset of values of positive conditional…
Projective (Von Neumann) Measurement of an operator (i.e. a dynamical variable) selected from a prescribed set of operators is termed unrecorded measurement (URM) when both the selected operator and the measurement outcome are unknown, i.e.…
We call a dynamical system on a measurable metric space {\em measure-expansive} if the probability of two orbits remain close each other for all time is negligible (i.e. zero). We extend results of expansive systems on compact metric spaces…
We consider the reverse math strength of the statement $\mathsf{C\text-DM}$:"Every completely determined Borel set is measurable." Over $\mathsf{WWKL}_0$, we obtain the following results analogous to the previously studied category case.…
An explicit sufficient condition on the hypercontractivity is derived for the Markov semigroup associated to a class of functional stochastic differential equations. Consequently, the semigroup $P_t$ converges exponentially to its unique…
We obtain new types of exponential decay laws for solutions of density-matrix master equations in the weak-coupling limit: after comparing with results already present in the literature and developing the necessary techniques, we study the…
Construction on the measurement matrix $A$ is a central problem in compressed sensing. Although using random matrices is proven optimal and successful in both theory and applications. A deterministic construction on the measurement matrix…
It is shown that for a non-singular conservative shift on a topologically mixing Markov subshift with Doeblin Condition the only possible absolutely continuous shift-invariant measure is a Markov measure. Moreover, if it is not equivalent…
Following Demidovich's concept and definition of convergent systems, we analyze the optimal nonlinear damping control, recently proposed [1] for the second-order systems. Targeting the problem of output regulation, correspondingly tracking…
To any positive contraction $Q$ on $\ell^2(W)$, there is associated a determinantal probability measure ${\mathbf P}^Q$ on $2^W$, where $W$ is a denumerable set. Let $\Gamma$ be a countable sofic finitely generated group and $G = (\Gamma,…
Let $\{S_i\}_{i\in \Lambda}$ be a finite contracting affine iterated function system (IFS) on ${\Bbb R}^d$. Let $(\Sigma,\sigma)$ denote the two-sided full shift over the alphabet $\Lambda$, and $\pi:\Sigma\to {\Bbb R}^d$ be the coding map…
The concept of ergotropy was previously introduced as the maximum extractable work from a quantum state. Its enhancement, which is induced by quantum correlation via projective measurement, was formulated as the daemonic ergotropy. In this…