English

Entropy rate of product of independent processes

Dynamical Systems 2021-07-20 v2 Probability

Abstract

We study the multiplicative version of the classical Furstenberg's filtering problem, where instead of the sum X+Y\mathbf{X}+\mathbf{Y} one considers the product XY\mathbf{X}\cdot \mathbf{Y} (X\mathbf{X} and Y\mathbf{Y} are bilateral, real, finitely-valued, stationary independent processes, Y\mathbf{Y} is taking values in {0,1}\{0,1\}). We provide formulas for H(XYY)\mathbf{H}(\mathbf{X}\cdot\mathbf{Y}|\mathbf{Y}). As a consequence, we show that if H(X)>H(Y)=0\mathbf{H}(\mathbf{X})>\mathbf{H}(\mathbf{Y})=0 and X⨿Y\mathbf{X}\amalg \mathbf{Y}, then H(XY)<H(X)\mathbf{H}(\mathbf{X}\cdot \mathbf{Y})<\mathbf{H}(\mathbf{X}) (and thus X\mathbf{X} cannot be filtered out from XY\mathbf{X}\cdot\mathbf{Y}) whenever X\mathbf{X} is not bilaterally deterministic, Y\mathbf{Y} is ergodic and Y\mathbf{Y} first return to 11 can take arbitrarily long with positive probability. On the other hand, if almost surely Y\mathbf{Y} visits 11 along an infinite arithmetic progression of a fixed difference (with possibly some more visits in between) then we can find X\mathbf{X} that is not bilaterally deterministic and such that H(XY)=H(X)\mathbf{H}(\mathbf{X}\cdot\mathbf{Y})=\mathbf{H}(\mathbf{X}). As a consequence, a B\mathscr{B}-free system (Xη,S)(X_\eta,S) is proximal if and only if there is always an entropy drop h(κνη)<h(κ)h(\kappa\ast\nu_\eta)<h(\kappa) for any κ\kappa corresponding to a non-bilaterally deterministic process of positive entropy. These results partly settle some open problems on invariant measures for B\mathscr{B}-free systems.

Keywords

Cite

@article{arxiv.2004.07648,
  title  = {Entropy rate of product of independent processes},
  author = {Joanna Kułaga-Przymus and Michał Lemańczyk},
  journal= {arXiv preprint arXiv:2004.07648},
  year   = {2021}
}

Comments

25 pages. The paper has been restructured. Main changes: relevant comments on other results on filtering a signal were added, the main technical formula is now stated (and proved) in a stronger form than before, which results in more applications, in particular, new results on B-free systems were added