English
Related papers

Related papers: Perception-Aware Video Semantic Communication

200 papers

Joint source-channel coding (JSCC) is a promising paradigm for next-generation communication systems, particularly in challenging transmission environments. In this paper, we propose a novel standard-compatible JSCC framework for the…

Information Theory · Computer Science 2025-01-07 Xue Han , Yongpeng Wu , Zhen Gao , Biqian Feng , Yuxuan Shi , Deniz Gündüz , Wenjun Zhang

The rapid progress of artificial intelligence (AI) and computer vision (CV) has facilitated the development of computation-intensive applications like Visual Question Answering (VQA), which integrates visual perception and natural language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Sige Liu , Nan Li , Yansha Deng , Tony Q. S. Quek

To provide users with more realistic visual experiences, videos are developing in the trends of Ultra High Definition (UHD), High Frame Rate (HFR), High Dynamic Range (HDR), Wide Color Gammut (WCG) and high clarity. However, the data amount…

Multimedia · Computer Science 2022-11-17 Yun Zhang , Linwei Zhu , Gangyi Jiang , Sam Kwong , C. -C. Jay Kuo

Semantic communication (SemCom) demonstrates strong superiority over conventional bit-level accurate transmission, by only attempting to recover the essential semantic information of data. In this paper, in order to tackle the…

Information Theory · Computer Science 2023-10-02 Siyu Tong , Xiaoxue Yu , Rongpeng Li , Kun Lu , Zhifeng Zhao , Honggang Zhang

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Han-Yu Lin , Li-Wei Chen , Hung-Shin Lee

Unsupervised video semantic compression (UVSC), i.e., compressing videos to better support various analysis tasks, has recently garnered attention. However, the semantic richness of previous methods remains limited, due to the single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Yuan Tian , Guo Lu , Guangtao Zhai

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Efficient multi-user multi-task video transmission is an important research topic within the realm of current wireless communication systems. To reduce the transmission burden and save communication resources, we propose a goal-oriented…

Image and Video Processing · Electrical Eng. & Systems 2026-03-26 Yujie Xu , Shutong Chen , Nan Li , Yansha Deng , Jinhong Yuan , Robert Schober

Semantic scene completion (SSC) has recently gained popularity because it can provide both semantic and geometric information that can be used directly for autonomous vehicle navigation. However, there are still challenges to overcome. SSC…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Yuanfang Zhang , Junxuan Li , Kaiqing Luo , Yiying Yang , Jiayi Han , Nian Liu , Denghui Qin , Peng Han , Chengpei Xu

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

Reliable detection of surrounding objects is critical for the safe operation of connected automated vehicles (CAVs). However, inherent limitations such as the restricted perception range and occlusion effects compromise the reliability of…

Signal Processing · Electrical Eng. & Systems 2025-07-02 Jipeng Gan , Yucheng Sheng , Hua Zhang , Le Liang , Hao Ye , Chongtao Guo , Shi Jin

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

Recently, content-aware methods have been employed to reduce bandwidth and enhance the quality of Internet video delivery. These methods involve training distinct content-aware super-resolution (SR) models for each video chunk on the…

Networking and Internet Architecture · Computer Science 2025-09-18 Rongyu Zhang , Xize Duan , Jiaming Liu , Li Du , Yuan Du , Dan Wang , Shanghang Zhang , Fangxin Wang

Perceptual optimization is widely recognized as essential for neural compression, yet balancing the rate-distortion-perception tradeoff remains challenging. This difficulty is especially pronounced in video compression, where frame-wise…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Zongyu Guo , Zhaoyang Jia , Jiahao Li , Xiaoyi Zhang , Bin Li , Yan Lu

While distributed device-edge speculative decoding enhances resource utilization across heterogeneous nodes, its performance is often bottlenecked by conventional token-level verification strategies. Such rigid alignment leads to excessive…

Information Theory · Computer Science 2026-04-21 Zixuan Liu , Zhiyong Chen , Nan Xue , Shengkang Chen , Jiangchao Yao , Meixia Tao , Wenjun Zhang

Virtual and augmented reality (VR/AR) systems are emerging technologies requiring data rates of multiple Gbps. Existing high quality VR headsets require connections through HDMI cables to a computer rendering rich graphic contents to meet…

Networking and Internet Architecture · Computer Science 2019-04-09 Mahmudur Khan , Jacob Chakareski

Semantic Communication (SemCom) is a promising new paradigm for next-generation communication systems, emphasizing the transmission of core information, particularly in environments characterized by uncertainty, noise, and bandwidth…

Information Theory · Computer Science 2025-02-25 Feibo Jiang , Siwei Tu , Li Dong , Kezhi Wang , Kun Yang , Ruiqi Liu , Cunhua Pan , Jiangzhou Wang

Large Vision-Language Models (VLMs) have been extended to understand both images and videos. Visual token compression is leveraged to reduce the considerable token length of visual inputs. To meet the needs of different tasks, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Chenyu Yang , Xuan Dong , Xizhou Zhu , Weijie Su , Jiahao Wang , Hao Tian , Zhe Chen , Wenhai Wang , Lewei Lu , Jifeng Dai

Real-time transmission of video over wireless networks remains highly challenging, even with advanced deep models, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In this paper, we propose…

Information Theory · Computer Science 2025-10-30 Zhenyu Liu , Yi Ma , Rahim Tafazolli , Zhi Ding

End-to-end image transmission has recently become a crucial trend in intelligent wireless communications, driven by the increasing demand for high bandwidth efficiency. However, existing methods primarily optimize the trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Kailin Tan , Jincheng Dai , Zhenyu Liu , Sixian Wang , Xiaoqi Qin , Wenjun Xu , Kai Niu , Ping Zhang