English
Related papers

Related papers: Generative Video Semantic Communication via Multim…

200 papers

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

This paper investigates semantic communications between a transmitter and a receiver, where original data, such as videos of interest to the receiver, is stored at the transmitter. Although significant process has been made in semantic…

Information Theory · Computer Science 2024-11-21 Xunze Liu , Yifei Sun , Zhaorui Wang , Lizhao You , Haoyuan Pan , Fangxin Wang , Shuguang Cui

Recent breakthroughs in generative artificial intelligence (AI) are transforming multimedia communication. This paper systematically reviews key recent advancements across generative AI for multimedia communication, emphasizing…

Multimedia · Computer Science 2025-08-26 Yili Jin , Xue Liu , Jiangchuan Liu

This paper proposes new framework of communication system leveraging promising generation capabilities of multi-modal generative models. Regarding nowadays smart applications, successful communication can be made by conveying the perceptual…

Signal Processing · Electrical Eng. & Systems 2023-09-11 Hyelin Nam , Jihong Park , Jinho Choi , Seong-Lyun Kim

Semantic communication (SemCom) has emerged as a promising paradigm for achieving unprecedented communication efficiency in sixth-generation (6G) networks by leveraging artificial intelligence (AI) to extract and transmit the underlying…

Machine Learning · Computer Science 2025-08-27 Jianhao Huang , Qunsong Zeng , Hongyang Du , Kaibin Huang

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Semantic communication is a promising technology to improve communication efficiency by transmitting only the semantic information of the source data. However, traditional semantic communication methods primarily focus on data…

Sound · Computer Science 2024-10-07 Jiahao Zheng , Jinke Ren , Peng Xu , Zhihao Yuan , Jie Xu , Fangxin Wang , Gui Gui , Shuguang Cui

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the…

Signal Processing · Electrical Eng. & Systems 2024-04-01 Shunpu Tang , Qianqian Yang , Deniz Gündüz , Zhaoyang Zhang

Semantic communication is considered the future of mobile communication, which aims to transmit data beyond Shannon's theorem of communications by transmitting the semantic meaning of the data rather than the bit-by-bit reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Maheshi Lokumarambage , Vishnu Gowrisetty , Hossein Rezaei , Thushan Sivalingam , Nandana Rajatheva , Anil Fernando

Satellite communications face severe bottlenecks in supporting high-fidelity synchronized audiovisual services, as conventional schemes struggle with cross-modal coherence under fluctuating channel conditions, limited bandwidth, and long…

Image and Video Processing · Electrical Eng. & Systems 2026-03-12 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Xiao Li , Shi Jin

This paper studies an end-to-end video semantic communication system for massive communication. In the considered system, the transmitter must continuously send the video to the receiver to facilitate character reconstruction in immersive…

Networking and Internet Architecture · Computer Science 2024-02-05 Haopeng Li , Haonan Tong , Sihua Wang , Nuocheng Yang , Zhaohui Yang , Changchuan Yin

Perceiving vehicles in a driver's blind spot is vital for safe driving. The detection of potentially dangerous vehicles in these blind spots can benefit from vehicular network semantic communication technology. However, efficient semantic…

Artificial Intelligence · Computer Science 2023-11-27 Hao Feng , Yi Yang , Zhu Han

As generative technologies advance, visual content has evolved into a complex mix of natural and AI-generated images, driving the need for more efficient coding techniques that prioritize perceptual quality. Traditional codecs and learned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jianhui Chang

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

This paper considers a video caption generating network referred to as Semantic Grouping Network (SGN) that attempts (1) to group video frames with discriminating word phrases of partially decoded caption and then (2) to decode those…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Hobin Ryu , Sunghun Kang , Haeyong Kang , Chang D. Yoo

With the rapid development of autonomous driving and extended reality, efficient transmission of point clouds (PCs) has become increasingly important. In this context, we propose a novel channel-adaptive cross-modal generative semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Wanting Yang , Zehui Xiong , Qianqian Yang , Ping Zhang , Merouane Debbah , Rahim Tafazolli

Semantic communication (SemCom) is expected to be a core paradigm in future communication networks, yielding significant benefits in terms of spectrum resource saving and information interaction efficiency. However, the existing SemCom…

Networking and Internet Architecture · Computer Science 2024-10-29 Le Xia , Yao Sun , Chengsi Liang , Lei Zhang , Muhammad Ali Imran , Dusit Niyato

Semantic knowledge bases are regarded as a promising technology for upcoming 6G communications. However, existing studies mainly focus on source-side semantic modeling while overlooking the structural impact of propagation environments on…

Information Theory · Computer Science 2026-04-08 Xudong Long , Hao Chen , Dan Wang , Chen Qiu , Nan Ma , Xiaodong Xu , Yubin Zhao

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

Semantic communication is poised to play a pivotal role in shaping the landscape of future AI-driven communication systems. Its challenge of extracting semantic information from the original complex content and regenerating semantically…

Machine Learning · Computer Science 2023-09-07 Eleonora Grassucci , Yuki Mitsufuji , Ping Zhang , Danilo Comminiello