English

A Regression Approach to Certain Information Transmission Problems

Information Theory 2019-08-23 v2 Machine Learning math.IT

Abstract

A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual information. When the encoder and the decoder know the statistical channel model, it is found that the optimal channel output processing function is the conditional expectation operator, thus hinting a potential role of regression, a classical topic in machine learning, for this model. Without utilizing the statistical channel model, a problem formulation inspired by machine learning principles is established, with suitable performance metrics introduced. A data-driven inference algorithm is proposed to solve the problem, and the effectiveness of the algorithm is validated via numerical experiments. Extensions to more general information transmission models are also discussed.

Keywords

Cite

@article{arxiv.1906.03777,
  title  = {A Regression Approach to Certain Information Transmission Problems},
  author = {Wenyi Zhang and Yizhu Wang and Cong Shen and Ning Liang},
  journal= {arXiv preprint arXiv:1906.03777},
  year   = {2019}
}

Comments

To appear at IEEE JSAC. Code available at http://staff.ustc.edu.cn/~wenyizha/jsac19code.zip

R2 v1 2026-06-23T09:48:24.493Z