English
Related papers

Related papers: Generative Video Semantic Communication via Multim…

200 papers

Artificial Intelligence Generated Content (AIGC) Services have significant potential in digital content creation. The distinctive abilities of AIGC, such as content generation based on minimal input, hold huge potential, especially when…

Networking and Internet Architecture · Computer Science 2024-01-23 Guangyuan Liu , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim , Xuemin , Shen

Perceptual video compression leverages generative priors to reconstruct realistic textures and motions at low bitrates. However, existing perceptual codecs often lack native support for variable bitrate and progressive delivery, and their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Daowen Li , Ruixiao Dong , Ying Chen , Kai Li , Ding Ding , Li Li

Semantic communication emphasizes the transmission of meaning rather than raw symbols. It offers a promising solution to alleviate network congestion and improve transmission efficiency. In this paper, we propose a wireless image…

Signal Processing · Electrical Eng. & Systems 2025-07-17 Chen Zhu , Siyun Liang , Zhouxiang Zhao , Jianrong Bao , Zhaohui Yang , Zhaoyang Zhang , Dusit Niyato

Mobile Artificial Intelligence-Generated Content (AIGC) networks enable massive users to obtain customized content generation services. However, users still need to download a large number of AIGC outputs from mobile AIGC service providers,…

Networking and Internet Architecture · Computer Science 2024-09-27 Jian Liu , Ming Xiao , Jinbo Wen , Jiawen Kang , Ruichen Zhang , Tao Zhang , Dusit Niyato , Weiting Zhang , Ying Liu

With the booming development of generative artificial intelligence (GAI), semantic communication (SemCom) has emerged as a new paradigm for reliable and efficient communication. This paper considers a multi-user downlink SemCom system,…

Networking and Internet Architecture · Computer Science 2025-07-03 Jiayi Lu , Wanting Yang , Zehui Xiong , Rahim Tafazolli , Tony Q. S. Quek , Mérouane Debbah , Dong In Kim

Semantic communications represent a new paradigm of next-generation networking that shifts bit-wise data delivery to conveying the semantic meanings for bandwidth efficiency. To effectively accommodate various potential downstream tasks at…

Computation and Language · Computer Science 2025-05-14 Fupei Guo , Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

In this paper, we address the task of semantic-guided image generation. One challenge common to most existing image-level generation methods is the difficulty in generating small objects and detailed local textures. To address this, in this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hao Tang , Ling Shao , Philip H. S. Torr , Nicu Sebe

Generative diffusion models (GDMs) have recently shown great success in synthesizing multimedia signals with high perceptual quality, enabling highly efficient semantic communications in future wireless networks. In this paper, we develop…

Information Theory · Computer Science 2026-01-27 Xinkai Liu , Mahdi Boloursaz Mashhadi , Li Qiao , Yi Ma , Rahim Tafazolli , Mehdi Bennis

Semantic information refers to the meaning conveyed through words, phrases, and contextual relationships within a given linguistic structure. Humans can leverage semantic information, such as familiar linguistic patterns and contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Jixun Yao , Hexin Liu , Chen Chen , Yuchen Hu , EngSiong Chng , Lei Xie

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Technological developments have produced methods that can generate educational videos from input text or sound. Recently, the use of deep learning techniques for image and video generation has been widely explored, particularly in…

Multimedia · Computer Science 2026-01-27 M. E. ElAlami , S. M. Khater , M. El. R. Rehan

Conventional communication systems, including both separation-based coding and AI-driven joint source-channel coding (JSCC), are largely guided by Shannon's rate-distortion theory. However, relying on generic distortion metrics fails to…

Information Theory · Computer Science 2026-01-21 Tong Wu , Zhiyong Chen , Guo Lu , Li Song , Feng Yang , Meixia Tao , Wenjun Zhang

As three-dimensional acquisition technologies like LiDAR cameras advance, the need for efficient transmission of 3D point clouds is becoming increasingly important. In this paper, we present a novel semantic communication (SemCom) approach…

Emerging Technologies · Computer Science 2025-05-13 Shangzhuo Xie , Qianqian Yang , Yuyi Sun , Tianxiao Han , Zhaohui Yang , Zhiguo Shi

Open-vocabulary 3D scene understanding presents a significant challenge in computer vision, with wide-ranging applications in embodied agents and augmented reality systems. Existing methods adopt neurel rendering methods as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jun Guo , Xiaojian Ma , Yue Fan , Huaping Liu , Qing Li

We present an AI-based framework for semantic transmission of multimedia data over band-limited, time-varying channels. The method targets scenarios where large content is split into multiple packets, with an unknown number potentially…

Multimedia · Computer Science 2026-01-29 Homa Esfahanizadeh , Nargis Fayaz , Jinfeng Du , Harish Viswanathan

This paper proposes a network architecture to perform variable length semantic video generation using captions. We adopt a new perspective towards video generation where we allow the captions to be combined with the long-term and short-term…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Tanya Marwah , Gaurav Mittal , Vineeth N. Balasubramanian

Semantic communication (SemCom) powered by generative artificial intelligence enables highly efficient and reliable information transmission. However, it still necessitates the transmission of substantial amounts of data when dealing with…

Information Theory · Computer Science 2025-06-17 Guojun Huang , Jiancheng An , Lu Gan , Dusit Niyato , Mérouane Debbah , Tie Jun Cui

With the advancement of Artificial Intelligence (AI) technology, next-generation wireless communication network is facing unprecedented challenge. Semantic communication has become a novel solution to address such challenges, with enhancing…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Zihe Zhao , Chunyue Wang