English

Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence

Signal Processing 2024-01-22 v2

Abstract

In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic relays and the adaptive adjustment capability of edge intelligence can be integrated to improve task performance. Specifically, we propose the key techniques in the framework, such as semantic alignment and complement, a semantic relay scheme for deep joint source-channel relay coding, and collaborative device-server optimization and inference. Furthermore, a multimodal classification task is used as an example to demonstrate the benefits of the proposed DTCN over existing methods. Numerical results validate that DTCN can significantly improve the accuracy of classification tasks, even in harsh communication scenarios (e.g., low signal-to-noise regime), thanks to multimodal semantic relay and edge intelligence.

Keywords

Cite

@article{arxiv.2401.09904,
  title  = {Distributed Task-Oriented Communication Networks with Multimodal Semantic Relay and Edge Intelligence},
  author = {Jie Guo and Hao Chen and Bin Song and Yuhao Chi and Chau Yuen and Fei Richard Yu and Geoffrey Ye Li and Dusit Niyato},
  journal= {arXiv preprint arXiv:2401.09904},
  year   = {2024}
}

Comments

7 pages, 5 figures, 1 table, accepted by IEEE Communications Magazine

R2 v1 2026-06-28T14:20:17.656Z