English
Related papers

Related papers: Video Semantic Communication with Major Object Ext…

200 papers

Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the…

Information Theory · Computer Science 2024-02-23 Francesco Pezone , Osman Musa , Giuseppe Caire , Sergio Barbarossa

With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens of minutes has become both feasible and increasingly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Yuxiao Chen , Jue Wang , Zhikang Zhang , Jingru Yi , Xu Zhang , Yang Zou , Zhaowei Cai , Jianbo Yuan , Xinyu Li , Hao Yang , Davide Modolo

Recently, the ever-increasing demand for bandwidth in multi-modal communication systems requires a paradigm shift. Powered by deep learning, semantic communications are applied to multi-modal scenarios to boost communication efficiency and…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Yangshuo He , Guanding Yu , Yunlong Cai

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

This paper presents a video encoding method in which noise is encoded using a novel parametric model representing spectral envelope and spatial distribution of energy. The proposed method has been experimentally assessed using video test…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Olgierd Stankiewicz

Learning a data-driven spatio-temporal semantic representation of the objects is the key to coherent and consistent labelling in video. This paper proposes to achieve semantic video object segmentation by learning a data-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Tinghuai Wang

Semantic communication has become a popular research area due its high spectrum efficiency and error-correction performance. Some studies use deep learning to extract semantic features, which usually form end-to-end semantic communication…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Semantic communications have shown promising advancements by optimizing source and channel coding jointly. However, the dynamics of these systems remain understudied, limiting research and performance gains. Inspired by the robustness of…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Hanju Yoo , Linglong Dai , Songkuk Kim , Chan-Byoung Chae

Accurate and timely image transmission is critical for emerging time-sensitive applications such as remote sensing in satellite-assisted Internet of Things. However, the bandwidth limitation poses a significant challenge in existing…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Xiaolei Yang , Zijing Wang , Zhijin Qin , Xiaoming Tao

The Space-Air-Ground-Sea integrated network calls for more robust and secure transmission techniques against jamming. In this paper, we propose a textual semantic transmission framework for robust transmission, which utilizes the advanced…

Computation and Language · Computer Science 2023-07-25 Shicong Liu , Zhen Gao , Gaojie Chen , Yu Su , Lu Peng

Spurred by a huge interest in the post-Shannon communication, it has recently been shown that leveraging semantics can significantly improve the communication effectiveness across many tasks. In this article, inspired by human…

Information Theory · Computer Science 2023-03-10 Hyowoon Seo , Jihong Park , Mehdi Bennis , Mérouane Debbah

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

With technology advancing and the pursuit of new audiovisual experiences strengthening, the metaverse has gained surging enthusiasm. However, it faces practical hurdles as substantial data like high-resolution virtual scenes must be…

Multimedia · Computer Science 2025-06-13 Yuxuan Li , Sheng Jinag , Bizhu Wang

Recent advances in Large Language Models (LLMs) have led to significant breakthroughs in video understanding. However, existing models still struggle with long video processing due to the context length constraint of LLMs and the vast…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haoran Hao , Jiaming Han , Yiyuan Zhang , Xiangyu Yue

Recently, semantic communications have drawn great attention as the groundbreaking concept surpasses the limited capacity of Shannon's theory. Specifically, semantic communications probably become crucial in realizing visual tasks that…

Networking and Internet Architecture · Computer Science 2025-10-23 Jeonghun Park , Sung Whan Yoon

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

Emerging services such as augmented reality (AR) and virtual reality (VR) have increased the volume of data transmitted in wireless communication systems, revealing the limitations of traditional Shannon theory. To address these…

Networking and Internet Architecture · Computer Science 2025-04-15 Shavbo Salehi , Melike Erol-Kantarci , Dusit Niyato

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

For speech-related applications in IoT environments, identifying effective methods to handle interference noises and compress the amount of data in transmissions is essential to achieve high-quality services. In this study, we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 You-Jin Li , Syu-Siang Wang , Yu Tsao , Borching Su

In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic…

Networking and Internet Architecture · Computer Science 2025-05-30 Guangyuan Liu , Yinqiu Liu , Jiacheng Wang , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Abbas Jamalipour