English
Related papers

Related papers: Language-oriented Semantic Communication for Image…

200 papers

We consider the image transmission problem over a noisy wireless channel via deep learning-based joint source-channel coding (DeepJSCC) along with a denoising diffusion probabilistic model (DDPM) at the receiver. Specifically, we are…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Selim F. Yilmaz , Xueyan Niu , Bo Bai , Wei Han , Lei Deng , Deniz Gunduz

Semantic communication is a new paradigm that aims at providing more efficient communication for the next-generation wireless network. It focuses on transmitting extracted, meaningful information instead of the raw data. However, deep…

Social and Information Networks · Computer Science 2025-01-09 Yang Li , Xinyu Zhou , Jun Zhao

Diffusion models have revolted the field of text-to-image generation recently. The unique way of fusing text and image information contributes to their remarkable capability of generating highly text-related images. From another…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Changming Xiao , Qi Yang , Feng Zhou , Changshui Zhang

In recent years, image generation has shown a great leap in performance, where diffusion models play a central role. Although generating high-quality images, such models are mainly conditioned on textual descriptions. This begs the…

Sound · Computer Science 2023-05-23 Guy Yariv , Itai Gat , Lior Wolf , Yossi Adi , Idan Schwartz

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

Signal Processing · Electrical Eng. & Systems 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus

This paper investigates distributed source-channel coding for correlated image semantic transmission over wireless channels. In this setup, correlated images at different transmitters are separately encoded and transmitted through dedicated…

Information Theory · Computer Science 2025-06-10 Yufei Bo , Meixia Tao , Kai Niu

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

In recent years, novel communication strategies have emerged to face the challenges that the increased number of connected devices and the higher quality of transmitted information are posing. Among them, semantic communication obtained…

Signal Processing · Electrical Eng. & Systems 2026-04-14 Eleonora Grassucci , Jinho Choi , Jihong Park , Riccardo F. Gramaccioni , Giordano Cicchetti , Danilo Comminiello

Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Gihyun Kwon , Jong Chul Ye

The Space-Air-Ground-Sea integrated network calls for more robust and secure transmission techniques against jamming. In this paper, we propose a textual semantic transmission framework for robust transmission, which utilizes the advanced…

Computation and Language · Computer Science 2023-07-25 Shicong Liu , Zhen Gao , Gaojie Chen , Yu Su , Lu Peng

Semantic communication emphasizes the transmission of meaning rather than raw symbols. It offers a promising solution to alleviate network congestion and improve transmission efficiency. In this paper, we propose a wireless image…

Signal Processing · Electrical Eng. & Systems 2025-07-17 Chen Zhu , Siyun Liang , Zhouxiang Zhao , Jianrong Bao , Zhaohui Yang , Zhaoyang Zhang , Dusit Niyato

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Semantic communication is a promising technique for emerging wireless applications, which reduces transmission overhead by transmitting only task-relevant features instead of raw data. However, existing methods struggle under extremely low…

Image and Video Processing · Electrical Eng. & Systems 2025-10-30 Peiwen Jiang , Jiajia Guo , Chao-Kai Wen , Shi Jin , Jun Zhang

Recent advances on text-to-image generation have witnessed the rise of diffusion models which act as powerful generative models. Nevertheless, it is not trivial to exploit such latent variable models to capture the dependency among discrete…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jianjie Luo , Yehao Li , Yingwei Pan , Ting Yao , Jianlin Feng , Hongyang Chao , Tao Mei

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-25 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Jun Zhang

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Existing text-to-image generation approaches have set high standards for photorealism and text-image correspondence, largely benefiting from web-scale text-image datasets, which can include up to 5~billion pairs. However, text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Minho Park , Jooyeol Yun , Seunghwan Choi , Jaegul Choo

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

In this paper, we introduce a large model-empowered streaming semantic communication system for speech transmission across various languages, named LSSC-ST. Specifically, we devise an edge-device collaborative semantic communication…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-24 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li