English
Related papers

Related papers: Deep Joint Source-Channel Coding Based on Semantic…

200 papers

Joint source and channel coding (JSCC) for image transmission has attracted increasing attention due to its robustness and high efficiency. However, the existing deep JSCC research mainly focuses on minimizing the distortion between the…

Information Theory · Computer Science 2023-05-30 Lunan Sun , Yang Yang , Mingzhe Chen , Caili Guo , Walid Saad , H. Vincent Poor

Joint source-channel coding schemes based on deep neural networks (DeepJSCC) have recently achieved remarkable performance for wireless image transmission. However, these methods usually focus only on the distortion of the reconstructed…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Jiakang Chen , Di You , Deniz Gündüz , Pier Luigi Dragotti

We propose a hybrid joint source-channel coding (JSCC) scheme, in which the conventional digital communication scheme is complemented with a generative refinement component to improve the perceptual quality of the reconstruction. The input…

Information Theory · Computer Science 2023-08-17 Xueyan Niu , Xu Wang , Deniz Gündüz , Bo Bai , Weichao Chen , Guohua Zhou

Significant progress has been made in wireless Joint Source-Channel Coding (JSCC) using deep learning techniques. The latest DL-based image JSCC methods have demonstrated exceptional performance during transmission, while also avoiding…

Signal Processing · Electrical Eng. & Systems 2023-08-29 Hongjie Yuan , Weizhang Xu , Yuhuan Wang , Xingxing Wang

Accurate and timely image transmission is critical for emerging time-sensitive applications such as remote sensing in satellite-assisted Internet of Things. However, the bandwidth limitation poses a significant challenge in existing…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Xiaolei Yang , Zijing Wang , Zhijin Qin , Xiaoming Tao

This paper introduces a deep learning approach to dynamic spectrum access, leveraging the synergy of multi-modal image and spectrum data for the identification of potential transmitters. We consider an edge device equipped with a camera…

Networking and Internet Architecture · Computer Science 2023-12-22 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

Semantic segmentation is a critical task in computer vision aiming to identify and classify individual pixels in an image, with numerous applications in for example autonomous driving and medical image analysis. However, semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prügel-Bennett

Small satellites are widely used today as cost effective means to perform Earth observation and other tasks that generate large amounts of high-dimensional data, such as multi-spectral imagery. These satellites typically operate in low…

Networking and Internet Architecture · Computer Science 2024-03-12 Olga Kondrateva , Stefan Dietzel , Björn Scheuermann

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

The key to integrating visual language tasks is to establish a good alignment strategy. Recently, visual semantic representation has achieved fine-grained visual understanding by dividing grids or image patches. However, the coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Siyu Zhang , Yeming Chen , Yaoru Sun , Fang Wang , Jun Yang , Lizhi Bai , Shangce Gao

Modern Earth Observation (EO) systems increasingly rely on high-resolution imagery to support critical applications such as environmental monitoring, disaster response, and land-use analysis. Although these applications benefit from…

Recent advances in text-guided image compression have shown great potential to enhance the perceptual quality of reconstructed images. These methods, however, tend to have significantly degraded pixel-wise fidelity, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hagyeong Lee , Minkyu Kim , Jun-Hyuk Kim , Seungeon Kim , Dokwan Oh , Jaeho Lee

Recent developments in Deep learning based Joint Source-Channel Coding (DeepJSCC) have demonstrated impressive capabilities within wireless semantic communications system. However, existing DeepJSCC methodologies exhibit limited…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Liang Zhang , Danlan Huang , Xinyi Zhou , Feng Ding , Sheng Wu , Zhiqing Wei

Most contemporary robots have depth sensors, and research on semantic segmentation with RGBD images has shown that depth images boost the accuracy of segmentation. Since it is time-consuming to annotate images with semantic labels per…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Kohei Watanabe , Kuniaki Saito , Yoshitaka Ushiku , Tatsuya Harada

Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Andriy Enttsel , Weichen Wang , Mauro Mangia , Riccardo Rovatti , Deniz Gündüz

Recent progress in deep learning (DL)-based joint source-channel coding (DeepJSCC) has led to a new paradigm of semantic communications. Two salient features of DeepJSCC-based semantic communications are the exploitation of semantic-aware…

Information Theory · Computer Science 2023-01-02 Yulin Shao , Deniz Gunduz

We present a novel adaptive deep joint source-channel coding (JSCC) scheme for wireless image transmission. The proposed scheme supports multiple rates using a single deep neural network (DNN) model and learns to dynamically control the…

Signal Processing · Electrical Eng. & Systems 2021-10-12 Mingyu Yang , Hun-Seok Kim

The latest deep learning-based approaches have shown promising results for the challenging task of inpainting missing regions of an image. However, the existing methods often generate contents with blurry textures and distorted structures…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Hongyu Liu , Bin Jiang , Yi Xiao , Chao Yang

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

We present a deep learning based joint source channel coding (JSCC) scheme for wireless image transmission over multipath fading channels with non-linear signal clipping. The proposed encoder and decoder use convolutional neural networks…

Signal Processing · Electrical Eng. & Systems 2021-05-25 Mingyu Yang , Chenghong Bian , Hun-Seok Kim