English
Related papers

Related papers: Editable-DeepSC: Reliable Cross-Modal Semantic Com…

200 papers

Task-oriented semantic communication (ToSC) emerges as an innovative approach in the 6G landscape, characterized by the transmission of only vital information that is directly pertinent to a specific task. While ToSC offers an efficient…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Shuaishuai Guo , Anbang Zhang , Yanhu Wang , Chenyuan Feng , Tony Q. S. Quek

Point cloud, as a 3D representation, is widely used in autonomous driving, virtual reality (VR), and augmented reality (AR). However, traditional communication systems think that the point cloud's semantic information is irrelevant to…

Multimedia · Computer Science 2023-07-13 Xiaoyi Liu , Haotai Liang , Zhicheng Bao , Chen Dong , Xiaodong Xu

Deep learning based joint source-channel coding (JSCC) has demonstrated significant advancements in data reconstruction compared to separate source-channel coding (SSCC). This superiority arises from the suboptimality of SSCC when dealing…

Machine Learning · Computer Science 2023-08-23 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Cross-technology communication (CTC) is a promising technique that enables direct communications among incompatible wireless technologies without needing hardware modification. However, it has not been widely adopted in real-world…

Information Theory · Computer Science 2024-02-16 Shumin Yao , Xiaodong Xu , Hao Chen , Yaping Sun , Qinglin Zhao

Establishing semantic correspondence is a core problem in computer vision and remains challenging due to large intra-class variations and lack of annotated data. In this paper, we aim to incorporate global semantic context in a flexible…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Shuaiyi Huang , Qiuyue Wang , Songyang Zhang , Shipeng Yan , Xuming He

This paper explores the concept of information importance in multi-modal task-oriented semantic communication systems, emphasizing the need for high accuracy and efficiency to fulfill task-specific objectives. At the transmitter, generative…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yi Ma , Chunmei Xu , Zhenyu Liu , Siqi Zhang , Rahim Tafazolli

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Digital mapping of semantic features is essential for achieving interoperability between semantic communication and practical digital infrastructure. However, current research efforts predominantly concentrate on analog semantic…

Information Theory · Computer Science 2026-02-18 Jianqiao Chen , Nan Ma , Xiaodong Xu , Tingting Zhu , Huishi Song , Chen Dong , Wenkai Liu , Rui Meng , Ping Zhang

Deep neural networks have recently been used to edit images with great success, in particular for faces. However, they are often limited to only being able to work at a restricted range of resolutions. Many methods are so flexible that face…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Gara Dorta , Sara Vicente , Neill D. F. Campbell , Ivor J. A. Simpson

This paper aims to design robust Edge Intelligence using semantic communication for time-critical IoT applications. We systematically analyze the effect of image DCT coefficients on inference accuracy and propose the channel-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Andrea Cavagna , Nan Li , Alexandros Iosifidis , Qi Zhang

Semantic communications have shown promising advancements by optimizing source and channel coding jointly. However, the dynamics of these systems remain understudied, limiting research and performance gains. Inspired by the robustness of…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Hanju Yoo , Linglong Dai , Songkuk Kim , Chan-Byoung Chae

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

Different from Visual Question Answering task that requires to answer only one question about an image, Visual Dialogue involves multiple questions which cover a broad range of visual content that could be related to any objects,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Xiaoze Jiang , Jing Yu , Zengchang Qin , Yingying Zhuang , Xingxing Zhang , Yue Hu , Qi Wu

To reduce network traffic and support environments with limited resources, a method for transmitting images with minimal transmission data is required. Several machine learning-based image compression methods, which compress the data size…

Networking and Internet Architecture · Computer Science 2024-08-06 Eri Hosonuma , Taku Yamazaki , Takumi Miyoshi , Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

Semantically guided conditional Generative Adversarial Networks (cGANs) have become a popular approach for face editing in recent years. However, most existing methods introduce semantic masks as direct conditional inputs to the generator…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Jiaze Sun , Binod Bhattarai , Zhixiang Chen , Tae-Kyun Kim

Though achieving marvelous progress in various scenarios, existing semantic communication frameworks mainly consider single-input single-output Gaussian channels or Rayleigh fading channels, neglecting the widely-used multiple-input…

Information Theory · Computer Science 2024-06-12 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Wenjun Zhang , Shuguang Cui , Merouane Debbah

Due to the challenges of satisfying the demands for communication efficiency and intelligent connectivity, sixth-generation (6G) wireless network requires new communication frameworks to enable effective information exchange and the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Wei Zhang , Jingqing Wang

This paper proposes new framework of communication system leveraging promising generation capabilities of multi-modal generative models. Regarding nowadays smart applications, successful communication can be made by conveying the perceptual…

Signal Processing · Electrical Eng. & Systems 2023-09-11 Hyelin Nam , Jihong Park , Jinho Choi , Seong-Lyun Kim

Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Ho Hin Lee , Yucheng Tang , Qi Yang , Xin Yu , Shunxing Bao , Leon Y. Cai , Lucas W. Remedios , Bennett A. Landman , Yuankai Huo

We propose a general method for semantic representation of images and other data using progressive coding. Semantic coding allows for specific pieces of information to be selectively encoded into a set of measurements that can be highly…

Signal Processing · Electrical Eng. & Systems 2023-09-29 Eva Riherd , Raghu Mudumbai , Weiyu Xu