具有平方误差保真度的多元高斯源在解码器侧信息下分布式源编码的最优测试信道的结构性质
信息论
2020-11-24 v1 math.IT
摘要
本文关注 Wyner 操作信息率失真函数(RDF)R ‾ ( Δ X ) \overline{R}(\Delta_X) R ( Δ X ) 的测试信道的结构性质,该源为多元相关、联合独立同分布的高斯随机变量(RVs)元组 { X t , Y t } t = 1 ∞ \{X_t, Y_t\}_{t=1}^\infty { X t , Y t } t = 1 ∞ ,X t : Ω → R n x X_t: \Omega \rightarrow {\mathbb R}^{n_x} X t : Ω → R n x ,Y t : Ω → R n y Y_t: \Omega \rightarrow {\mathbb R}^{n_y} Y t : Ω → R n y ,在解码器处具有平均均方误差 1 n E ∑ t = 1 n ∣ ∣ X t − X ^ t ∣ ∣ 2 ≤ Δ X \frac{1}{n} {\bf E}\sum_{t=1}^n||X_t - \widehat{X}_t||^2\leq \Delta_X n 1 E ∑ t = 1 n ∣∣ X t − X t ∣ ∣ 2 ≤ Δ X ,当 { Y t } t = 1 ∞ \{Y_t\}_{t=1}^\infty { Y t } t = 1 ∞ 仅为解码器可用的侧信息时。我们构造了达到信息 RDF R ‾ ( Δ X ) ≜ inf M ( Δ X ) I ( X ; Z ∣ Y ) \overline{R}(\Delta_X) \triangleq\inf_{{\cal M}(\Delta_X)} I(X;Z|Y) R ( Δ X ) ≜ inf M ( Δ X ) I ( X ; Z ∣ Y ) 的最优测试信道实现,其中 M ( Δ X ) {\cal M}(\Delta_X) M ( Δ X ) 是辅助 RVs Z Z Z 的集合,满足 P Z ∣ X , Y = P Z ∣ X {\bf P}_{Z|X,Y}={\bf P}_{Z|X} P Z ∣ X , Y = P Z ∣ X ,X ^ = f ( Y , Z ) \widehat{X}=f(Y,Z) X = f ( Y , Z ) ,且 E { ∣ ∣ X − X ^ ∣ ∣ 2 } ≤ Δ X {\bf E}\{||X-\widehat{X}||^2\}\leq \Delta_X E { ∣∣ X − X ∣ ∣ 2 } ≤ Δ X 。我们展示了基本结构性质:(1)达到 RDF R ‾ ( Δ X ) \overline{R}(\Delta_X) R ( Δ X ) 的最优测试信道实现满足条件独立性 P X ∣ X ^ , Y , Z = P X ∣ X ^ , Y = P X ∣ X ^ , E { X ∣ X ^ , Y , Z } = E { X ∣ X ^ } = X ^ {\bf P}_{X|\widehat{X}, Y, Z}={\bf P}_{X|\widehat{X},Y}={\bf P}_{X|\widehat{X}}, \hspace{.2in} {\bf E}\Big\{X\Big|\widehat{X}, Y, Z\Big\}={\bf E}\Big\{X\Big|\widehat{X}\Big\}=\widehat{X} P X ∣ X , Y , Z = P X ∣ X , Y = P X ∣ X , E { X X , Y , Z } = E { X X } = X ;(2)类似地,对于条件 RDF R X ∣ Y ( Δ X ) ≜ inf P X ^ ∣ X , Y : E { ∣ ∣ X − X ^ ∣ ∣ 2 } ≤ Δ X I ( X ; X ^ ∣ Y ) {R}_{X|Y}(\Delta_X) \triangleq \inf_{{\bf P}_{\widehat{X}|X,Y}:{\bf E}\{||X-\widehat{X}||^2\} \leq \Delta_X} I(X; \widehat{X}|Y) R X ∣ Y ( Δ X ) ≜ inf P X ∣ X , Y : E { ∣∣ X − X ∣ ∣ 2 } ≤ Δ X I ( X ; X ∣ Y ) ,当 { Y t } t = 1 ∞ \{Y_t\}_{t=1}^\infty { Y t } t = 1 ∞ 对编码器和解码器均可用时,以及等式 R ‾ ( Δ X ) = R X ∣ Y ( Δ X ) \overline{R}(\Delta_X)={R}_{X|Y}(\Delta_X) R ( Δ X ) = R X ∣ Y ( Δ X ) 。
引用
@article{arxiv.2011.10941,
title = {Structural Properties of Optimal Test Channels for Distributed Source Coding with Decoder Side Information for Multivariate Gaussian Sources with Square-Error Fidelity},
author = {Michail Gkagkos and Charalambos D. Charalambous},
journal= {arXiv preprint arXiv:2011.10941},
year = {2020}
}