English
Related papers

Related papers: Learned Image Transmission with Hierarchical Varia…

200 papers

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

Modern Earth Observation (EO) systems increasingly rely on high-resolution imagery to support critical applications such as environmental monitoring, disaster response, and land-use analysis. Although these applications benefit from…

Deep learning (DL)-based joint source-channel coding (JSCC) methods have achieved remarkable success in wireless image transmission. However, these methods either focus on conventional distortion metrics that do not necessarily yield high…

Image and Video Processing · Electrical Eng. & Systems 2026-02-27 Ming Ye , Kui Cai , Cunhua Pan , Zhen Mei , Wanting Yang , Chunguo Li

We present a deep learning based joint source channel coding (JSCC) scheme for wireless image transmission over multipath fading channels with non-linear signal clipping. The proposed encoder and decoder use convolutional neural networks…

Signal Processing · Electrical Eng. & Systems 2021-05-25 Mingyu Yang , Chenghong Bian , Hun-Seok Kim

We consider distributed image transmission over a noisy multiple access channel (MAC) using deep joint source-channel coding (DeepJSCC). It is known that Shannon's separation theorem holds when transmitting independent sources over a MAC in…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Selim F. Yilmaz , Can Karamanli , Deniz Gunduz

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

Machine Learning · Computer Science 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

To enable critical applications such as remote diagnostics, image classification must be guaranteed under bandwidth constraints and unreliable wireless channels through joint source and channel coding (JSCC) design. However, most existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Wenchao Wu , Min Qiu , Yansha Deng , Jinhong Yuan

Models of human motion commonly focus either on trajectory prediction or action classification but rarely both. The marked heterogeneity and intricate compositionality of human motion render each task vulnerable to the data degradation and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Anthony Bourached , Robert Gray , Xiaodong Guan , Ryan-Rhys Griffiths , Ashwani Jha , Parashkev Nachev

Joint source-channel coding (JSCC) offers a promising avenue for enhancing transmission efficiency by jointly incorporating source and channel statistics into the system design. A key advancement in this area is the deep joint source and…

Information Theory · Computer Science 2025-07-22 Maojun Zhang , Haotian Wu , Guangxu Zhu , Richeng Jin , Xiaoming Chen , Deniz Gündüz

Diffusion models have attained impressive visual quality for image synthesis. However, how to interpret and manipulate the latent space of diffusion models has not been extensively explored. Prior work diffusion autoencoders encode the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Zeyu Lu , Chengyue Wu , Xinyuan Chen , Yaohui Wang , Lei Bai , Yu Qiao , Xihui Liu

In this paper, we propose a novel joint source-channel coding (JSCC) approach for channel-adaptive digital semantic communications. In semantic communication systems with digital modulation and demodulation, robust design of JSCC encoder…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Joohyuk Park , Yongjeong Oh , Seonjung Kim , Yo-Seb Jeon

In this paper, we propose a class of high-efficiency deep joint source-channel coding methods that can closely adapt to the source distribution under the nonlinear transform, it can be collected under the name nonlinear transform…

Information Theory · Computer Science 2022-11-03 Jincheng Dai , Sixian Wang , Kailin Tan , Zhongwei Si , Xiaoqi Qin , Kai Niu , Ping Zhang

We consider low-latency image transmission over a noisy wireless channel when correlated side information is present only at the receiver side (the Wyner-Ziv scenario). In particular, we are interested in developing practical schemes using…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Selim F. Yilmaz , Ezgi Ozyilkan , Deniz Gunduz , Elza Erkip

Lightweight and efficient deep joint source-channel coding (JSCC) is a key technology for semantic communications. In this paper, we design a novel JSCC scheme named MambaJSCC, which utilizes a visual state space model with channel…

Information Theory · Computer Science 2024-05-07 Tong Wu , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Wenjun Zhang , Ping Zhang

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Dooseop Choi , KyoungWook Min

This paper investigates a key challenge faced by joint source-channel coding (JSCC) in digital semantic communication (SemCom): the incompatibility between existing JSCC schemes that yield continuous encoded representations and digital…

Information Theory · Computer Science 2025-11-12 Yujie Zhou , Rulong Wang , Yong Xiao , Yingyu Li , Guangming Shi

This paper presents a novel wireless image transmission paradigm that can exploit feedback from the receiver, called DeepJSCC-ViT-f. We consider a block feedback channel model, where the transmitter receives noiseless/noisy channel output…

Information Theory · Computer Science 2024-02-16 Haotian Wu , Yulin Shao , Emre Ozfatura , Krystian Mikolajczyk , Deniz Gündüz

Recent research on joint source channel coding (JSCC) for wireless communications has achieved great success owing to the employment of deep learning (DL). However, the existing work on DL based JSCC usually trains the designed network to…

Information Theory · Computer Science 2022-04-13 Jialong Xu , Bo Ai , Wei Chen , Ang Yang , Peng Sun , Miguel Rodrigues

While hierarchical variational autoencoders (VAEs) have achieved great density estimation on image modeling tasks, samples from their prior tend to look less convincing than models with similar log-likelihood. We attribute this to learned…

Machine Learning · Computer Science 2022-10-20 Eric Luhman , Troy Luhman