English
Related papers

Related papers: MDVSC -- Wireless Model Division Video Semantic Co…

200 papers

Existing semantic communication schemes primarily focus on single-hop scenarios, overlooking the challenges of multi-hop wireless image transmission. As semantic communication is inherently lossy, distortion accumulates over multiple hops,…

Information Theory · Computer Science 2026-01-29 Bingyan Xie , Jihong Park , Yongpeng Wu , Wenjun Zhang , Tony Quek

Deep learning driven joint source-channel coding (JSCC) for wireless image or video transmission, also called DeepJSCC, has been a topic of interest recently with very promising results. The idea is to map similar source samples to nearby…

Cryptography and Security · Computer Science 2022-09-01 Tze-Yang Tung , Deniz Gunduz

Multi-channel deep clustering (MDC) has acquired a good performance for speech separation. However, MDC only applies the spatial features as the additional information. So it is difficult to learn mutual relationship between spatial and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-06 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen

Semantic communication technology emerges as a pivotal bridge connecting AI with classical communication. The current semantic communication systems are generally modeled as an Auto-Encoder (AE). AE lacks a deep integration of AI principles…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Yulong Feng , Jing Xu , Liujun Hu , Guanghui Yu , Xiangyang Duan

This paper proposes a novel vision-integrated neural speech codec (VNSC), which aims to enhance speech coding quality by leveraging visual modality information. In VNSC, the image analysis-synthesis module extracts visual features from lip…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Yao Guo , Yang Ai , Rui-Chen Zheng , Hui-Peng Du , Xiao-Hang Jiang , Zhen-Hua Ling

Different from data-oriented communication systems that primarily focus on how to accurately transmit every bit of data, task-oriented semantic communication systems only transmit the specific semantic information required by downstream…

Information Theory · Computer Science 2024-10-10 Wenbo Yu , Bin Chen , Qinshan Zhang , Shu-Tao Xia

We propose Vision-Language Feature-based Multimodal Semantic Communication (VLF-MSC), a unified system that transmits a single compact vision-language representation to support both image and text generation at the receiver. Unlike existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Gwangyeon Ahn , Jiwan Seo , Joonhyuk Kang

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Lightweight and efficient neural network models for deep joint source-channel coding (JSCC) are crucial for semantic communications. In this paper, we propose a novel JSCC architecture, named MambaJSCC, that achieves state-of-the-art…

Information Theory · Computer Science 2024-09-26 Tong Wu , Zhiyong Chen , Meixia Tao , Yaping Sun , Xiaodong Xu , Wenjun Zhang , Ping Zhang

Distributed Video Coding (DVC) is a new coding paradigm for video compression, based on Slepian- Wolf (lossless coding) and Wyner-Ziv (lossy coding) information theoretic results. DVC is useful for emerging applications such as wireless…

Multimedia · Computer Science 2011-03-25 Vijay Kumar Kodavalla , Dr. P. G. Krishna Mohan

The rapid development of artificial intelligence has driven smart health with next-generation wireless communication technologies, stimulating exciting applications in remote diagnosis and intervention. To enable a timely and effective…

Machine Learning · Computer Science 2025-08-04 Fupei Guo , Hao Zheng , Xiang Zhang , Li Chen , Yue Wang , Songyang Zhang

In the popular video coding trend, the encoder has the task to exploit both spatial and temporal redundancies present in the video sequence, which is a complex procedure. As a result almost all video encoders have five to ten times more…

Image and Video Processing · Electrical Eng. & Systems 2018-03-14 A. Banitalebi , H. R. Tohidypour

Multi-view clustering has attracted much attention thanks to the capacity of multi-source information integration. Although numerous advanced methods have been proposed in past decades, most of them generally overlook the significance of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Rui Chen , Yongqiang Tang , Wensheng Zhang , Wenlong Feng

An improved inference method for densely connected systems is presented. The approach is based on passing condensed messages between variables, representing macroscopic averages of microscopic messages. We extend previous work that showed…

Information Theory · Computer Science 2009-11-11 Juan P. Neirotti , David Saad

Deep learning-based joint source-channel coding (JSCC) is emerging as a potential technology to meet the demand for effective data transmission, particularly for image transmission. Nevertheless, most existing advancements only consider…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Pujing Yang , Guangyi Zhang , Yunlong Cai

Video conferencing has become a popular mode of meeting even if it consumes considerable communication resources. Conventional video compression causes resolution reduction under limited bandwidth. Semantic video conferencing maintains high…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

This paper focuses on a typical uplink transmission scenario over multiple-input multiple-output multiple access channel (MIMO-MAC) and thus propose a multi-user learnable CSI fusion semantic communication (MU-LCFSC) framework. It…

Networking and Internet Architecture · Computer Science 2025-04-14 Bingyan Xie , Yongpeng Wu , Feng Shu , Jiangzhou Wang , Wenjun Zhang

Discretization of semantic features enables interoperability between semantic and digital communication systems, showing significant potential for practical applications. The fundamental difficulty in digitizing semantic features stems from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jianqiao Chen , Tingting Zhu , Huishi Song , Nan Ma , Xiaodong Xu

With the recent advancements in edge artificial intelligence (AI), future sixth-generation (6G) networks need to support new AI tasks such as classification and clustering apart from data recovery. Motivated by the success of deep learning,…

Networking and Internet Architecture · Computer Science 2023-04-06 Zhonghao Lyu , Guangxu Zhu , Jie Xu , Bo Ai , Shuguang Cui