English

Semantic Communications using Foundation Models: Design Approaches and Open Issues

Signal Processing 2024-10-28 v1 Image and Video Processing

Abstract

Foundation models (FMs), including large language models, have become increasingly popular due to their wide-ranging applicability and ability to understand human-like semantics. While previous research has explored the use of FMs in semantic communications to improve semantic extraction and reconstruction, the impact of these models on different system levels, considering computation and memory complexity, requires further analysis. This study focuses on integrating FMs at the effectiveness, semantic, and physical levels, using universal knowledge to profoundly transform system design. Additionally, it examines the use of compact models to balance performance and complexity, comparing three separate approaches that employ FMs. Ultimately, the study highlights unresolved issues in the field that need addressing.

Keywords

Cite

@article{arxiv.2309.13315,
  title  = {Semantic Communications using Foundation Models: Design Approaches and Open Issues},
  author = {Peiwen Jiang and Chao-Kai Wen and Xinping Yi and Xiao Li and Shi Jin and Jun Zhang},
  journal= {arXiv preprint arXiv:2309.13315},
  year   = {2024}
}

Comments

This work has been submitted to the IEEE for possible publication

R2 v1 2026-06-28T12:30:18.509Z