English
Related papers

Related papers: DiT-JSCC: Rethinking Deep JSCC with Diffusion Tran…

200 papers

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Deep learning-based joint source-channel coding (JSCC) is emerging as a potential technology to meet the demand for effective data transmission, particularly for image transmission. Nevertheless, most existing advancements only consider…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Pujing Yang , Guangyi Zhang , Yunlong Cai

Diffusion models have gained tremendous success in text-to-image generation, yet still lag behind with visual understanding tasks, an area dominated by autoregressive vision-language models. We propose a large-scale and fully end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zijie Li , Henry Li , Yichun Shi , Amir Barati Farimani , Yuval Kluger , Linjie Yang , Peng Wang

Semantic communications (SCs) play a central role in shaping the future of the sixth generation (6G) wireless systems, which leverage rapid advances in deep learning (DL). In this regard, end-to-end optimized DL-based joint source-channel…

Information Theory · Computer Science 2025-05-02 Mahmoud M. Salim , Mohamed S. Abdalzaher , Ali H. Muqaibel , Hussein A. Elsayed , Inkyu Lee

Generative models capture the true distribution of data, yielding semantically rich representations. Denoising diffusion models (DDMs) exhibit superior generative capabilities, though efficient representation learning for them are lacking.…

Machine Learning · Computer Science 2025-05-12 Limai Jiang , Yunpeng Cai

Recent advances in deep learning have led to increased interest in solving high-efficiency end-to-end transmission problems using methods that employ the nonlinear property of neural networks. These techniques, we call neural joint…

Signal Processing · Electrical Eng. & Systems 2023-06-26 Sixian Wang , Jincheng Dai , Xiaoqi Qin , Kai Niu , Ping Zhang

Semantic knowledge bases are regarded as a promising technology for upcoming 6G communications. However, existing studies mainly focus on source-side semantic modeling while overlooking the structural impact of propagation environments on…

Information Theory · Computer Science 2026-04-08 Xudong Long , Hao Chen , Dan Wang , Chen Qiu , Nan Ma , Xiaodong Xu , Yubin Zhao

Generative diffusion models, famous for their performance in image generation, are popular in various cross-domain applications. However, their use in the communication community has been mostly limited to auxiliary tasks like data modeling…

Networking and Internet Architecture · Computer Science 2025-03-11 Ruihuai Liang , Bo Yang , Zhiwen Yu , Bin Guo , Xuelin Cao , Mérouane Debbah , H. Vincent Poor , Chau Yuen

In recent years, the Transformer architecture has achieved outstanding performance across a wide range of tasks and modalities. Token is the unified input and output representation in Transformer-based models, which has become a fundamental…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Jingkai Ying , Zhijin Qin , Yulong Feng , Liejun Wang , Xiaoming Tao

Efficient image transmission is essential for seamless communication and collaboration within the visually-driven digital landscape. To achieve low latency and high-quality image reconstruction over a bandwidth-constrained noisy wireless…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Nan Li , Yansha Deng

Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Mengyang Wang , Zhicong Zhang , Jiahui Li , Mengyao Ma , Xiaopeng Fan

We propose a novel hybrid joint source-channel coding (JSCC) scheme for robust image transmission over multi-hop networks. In the considered scenario, a mobile user wants to deliver an image to its destination over a mobile cellular…

Signal Processing · Electrical Eng. & Systems 2024-02-09 Chenghong Bian , Yulin Shao , Deniz Gunduz

Semantic communication (SemCom) has recently emerged as a promising paradigm for next-generation wireless systems. Empowered by advanced artificial intelligence (AI) technologies, SemCom has achieved significant improvements in transmission…

Information Theory · Computer Science 2026-01-12 Shunpu Tang , Yuanyuan Jia , Qianqian Yang , Ruichen Zhang , Jihong Park , Dusit Niyato

We propose a joint source-channel-network coding scheme, based on compressive sensing principles, for wireless networks with AWGN channels (that may include multiple access and broadcast), with sources exhibiting temporal and spatial…

Information Theory · Computer Science 2011-10-04 Soheil Feizi , Muriel Medard

We consider image transmission via deep joint source-channel coding (DeepJSCC) over multi-hop additive white Gaussian noise (AWGN) channels by training a DeepJSCC encoder-decoder pair with a pre-trained deep hash distillation (DHD) module…

Information Theory · Computer Science 2026-02-25 Didrik Bergström , Deniz Gündüz , Onur Günlü

The sixth-generation mobile communication system proposes the vision of smart interconnection of everything, which requires accomplishing communication tasks while ensuring the performance of intelligent tasks. A joint source-channel coding…

Image and Video Processing · Electrical Eng. & Systems 2023-02-07 Qizheng Sun , Caili Guo , Yang Yang , Jiujiu Chen , Rui Tang , Chuanhong Liu

From the perspective of joint source-channel coding (JSCC), there has been significant research on utilizing semantic communication, which inherently possesses analog characteristics, within digital device environments. However, a…

Signal Processing · Electrical Eng. & Systems 2025-02-04 Yoon Huh , Hyowoon Seo , Wan Choi

End-to-end visual communication systems typically optimize a trade-off between channel bandwidth costs and signal-level distortion metrics. However, under challenging physical conditions, this traditional coding and transmission paradigm…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Sixian Wang , Jincheng Dai , Kailin Tan , Xiaoqi Qin , Kai Niu , Ping Zhang

Semantic communication is proposed and expected to improve the efficiency of massive data transmission over sixth generation (6G) networks. However, existing image semantic communication schemes are primarily focused on optimizing…

Multimedia · Computer Science 2025-06-09 Zehao Chen , Xinfeng Wei , Haonan Tong , Zhaohui Yang , Changchuan Yin

Diffusion models are highly regarded for their controllability and the diversity of images they generate. However, class-conditional generation methods based on diffusion models often focus on more common categories. In large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Kun Wang , Donglin Di , Tonghua Su , Lei Fan