English
Related papers

Related papers: Robust Semantic Communications with Masked VQ-VAE …

200 papers

Semantic communication has emerged as a promising paradigm for next-generation networks, yet several fundamental challenges remain unresolved. Building on the probabilistic model of semantic communication and leveraging the concept of…

Information Theory · Computer Science 2026-02-27 Javad Gholipour , Rafael F. Schaefer , Gerhard P. Fettweis

This work introduces Semantically Masked Vector Quantized Generative Adversarial Network (SQ-GAN), a novel approach integrating semantically driven image coding and vector quantization to optimize image compression for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Francesco Pezone , Sergio Barbarossa , Giuseppe Caire

Mixture-of-Experts (MoE) models have emerged as a promising direction for scaling vision architectures efficiently. Among them, Soft MoE improves training stability by assigning each token to all experts via continuous dispatch weights.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chengxi Min , Wei Wang , Yahui Liu , Weixin Ye , Enver Sangineto , Qi Wang , Yao Zhao

While current approaches for neural network training often aim at improving performance, less focus is put on training methods aiming at robustness towards varying noise conditions or directed attacks by adversarial examples. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Marvin Klingner , Andreas Bär , Tim Fingscheidt

A novel semantic communication (SC)-assisted secrecy transmission framework is proposed. In particular, the legitimate transmitter (Tx) sends the superimposed semantic and bit stream to the legitimate receiver (Rx), where the information…

Information Theory · Computer Science 2024-02-23 Xidong Mu , Yuanwei Liu

State-of-the-art high-spectral-efficiency communication systems employ high-order modulation formats coupled with high symbol rates to accommodate the ever-growing demand for data rate-hungry applications. However, such systems are more…

Signal Processing · Electrical Eng. & Systems 2023-02-24 Jinxiang Song , Vincent Lauinger , Yibo Wu , Christian Häger , Jochen Schröder , Alexandre Graell i Amat , Laurent Schmalen , Henk Wymeersch

Semantic communication is emerging as a promising paradigm that focuses on the extraction and transmission of semantic meanings using deep learning techniques. While current research primarily addresses the reduction of semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Hang Zhao , Hongru Li , Dongfang Xu , Shenghui Song , Khaled B. Letaief

Semantic communication (SemCom) significantly improves inter-vehicle interactions in intelligent connected vehicles (ICVs) within limited wireless spectrum. However, the open nature of wireless communications introduces eavesdropping risks.…

Cryptography and Security · Computer Science 2025-02-25 Bizhu Wang , Zhiqiang Bian , Yue Chen , Xiaodong Xu , Chen Sun , Wenqi Zhang , Ping Zhang

We present a new approach to disentangle speaker voice and phone content by introducing new components to the VQ-VAE architecture for speech synthesis. The original VQ-VAE does not generalize well to unseen speakers or content. To alleviate…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jennifer Williams , Yi Zhao , Erica Cooper , Junichi Yamagishi

Safety-critical applications like autonomous vehicles and industrial IoT are adopting semantic communication (SemCom) systems using deep neural networks to reduce bandwidth and increase transmission speed by transmitting only task-relevant…

Logic in Computer Science · Computer Science 2026-02-23 Thanh Le , Hai Duong , ThanhVu Nguyen , Takeshi Matsumura

With the aim of accomplishing intelligence tasks, semantic communications transmit task-related information only, yielding significant performance gains over conventional communications. To guarantee user requirements for different types of…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Lei Yan , Zhijin Qin , Rui Zhang , Yongzhao Li , Geoffrey Ye Li

Deep neural networks have been playing an essential role in many computer vision tasks including Visual Question Answering (VQA). Until recently, the study of their accuracy was the main focus of research but now there is a trend toward…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Jia-Hong Huang , Cuong Duc Dao , Modar Alfadly , Bernard Ghanem

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

In a noisy environment, a lossy speech signal can be automatically restored by a listener if he/she knows the language well. That is, with the built-in knowledge of a "language model", a listener may effectively suppress noise interference…

Machine Learning · Computer Science 2019-07-03 Chien-Feng Liao , Yu Tsao , Xugang Lu , Hisashi Kawai

Deep learning-empowered semantic communication is regarded as a promising candidate for future 6G networks. Although existing semantic communication systems have achieved superior performance compared to traditional methods, the end-to-end…

Artificial Intelligence · Computer Science 2023-11-07 Peng Yi , Yang Cao , Xin Kang , Ying-Chang Liang

Semantic communications conveys task-relevant meaning rather than focusing solely on message reconstruction, improving bandwidth efficiency and robustness for next-generation wireless systems. However, learned semantic representations can…

Networking and Internet Architecture · Computer Science 2026-01-01 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

This paper aims to design robust Edge Intelligence using semantic communication for time-critical IoT applications. We systematically analyze the effect of image DCT coefficients on inference accuracy and propose the channel-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Andrea Cavagna , Nan Li , Alexandros Iosifidis , Qi Zhang

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

Modern speaker verification systems primarily rely on speaker embeddings, followed by verification based on cosine similarity between the embedding vectors of the enrollment and test utterances. While effective, these methods struggle with…

Sound · Computer Science 2025-07-04 Wan Lin , Junhui Chen , Tianhao Wang , Zhenyu Zhou , Lantian Li , Dong Wang

Vector quantization-based image semantic communication systems have successfully boosted transmission efficiency, but face challenges with conflicting requirements between codebook design and digital constellation modulation. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yingbin Zhou , Yaping Sun , Guanying Chen , Xiaodong Xu , Hao Chen , Binhong Huang , Shuguang Cui , Ping Zhang