English
Related papers

Related papers: Rate-Distortion-Perception Controllable Joint Sour…

200 papers

Deep learning-based joint source-channel coding (JSCC) is emerging as a promising technology for effective image transmission. However, most existing approaches focus on transmitting clear images, overlooking real-world challenges such as…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Pujing Yang , Guangyi Zhang , Yunlong Cai , Lei Yu , Guanding Yu

We propose joint transmission-recognition schemes for efficient inference at the wireless edge. Motivated by the surveillance applications with wireless cameras, we consider the person classification task over a wireless channel carried out…

Machine Learning · Computer Science 2020-11-04 Ezgi Ozyilkan , Mikolaj Jankowski

This paper introduces a vision transformer (ViT)-based deep joint source and channel coding (DeepJSCC) scheme for wireless image transmission over multiple-input multiple-output (MIMO) channels, denoted as DeepJSCC-MIMO. We consider…

Information Theory · Computer Science 2024-07-16 Haotian Wu , Yulin Shao , Chenghong Bian , Krystian Mikolajczyk , Deniz Gündüz

Recently, the field of Image Coding for Machines (ICM) has garnered heightened interest and significant advances thanks to the rapid progress of learning-based techniques for image compression and analysis. Previous studies often require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jinming Liu , Ruoyu Feng , Yunpeng Qi , Qiuyu Chen , Zhibo Chen , Wenjun Zeng , Xin Jin

Descriptive region features extracted by object detection networks have played an important role in the recent advancements of image captioning. However, they are still criticized for the lack of contextual information and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Yunpeng Luo , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Yongjian Wu , Feiyue Huang , Chia-Wen Lin , Rongrong Ji

This paper investigates an information-theoretic model of secure semantic-aware communication. For this purpose, we consider the lossy joint source-channel coding (JSCC) of a memoryless semantic source transmitted over a memoryless wiretap…

Information Theory · Computer Science 2026-05-26 Denis Kozlov , Mahtab Mirmohseni , Rahim Tafazolli

Linear block transform coding remains a fundamental component of image and video compression. Although the Discrete Cosine Transform (DCT) is widely employed in all current compression standards, its sub-optimality has sparked ongoing…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Alessandro Gnutti , Chia-Hao Kao , Wen-Hsiao Peng , Riccardo Leonardi

We present a learning-based channel-adaptive joint source and channel coding (CA-JSCC) scheme for wireless image transmission over multipath fading channels. The proposed method is an end-to-end autoencoder architecture with a…

Information Theory · Computer Science 2022-09-09 Haotian Wu , Yulin Shao , Krystian Mikolajczyk , Deniz Gündüz

In this paper, we consider the rate-distortion-perception (RDP) trade-off for the lossy compression of a Bernoulli vector source, which is a finite collection of independent binary random variables. The RDP function quantifies in a way the…

Information Theory · Computer Science 2025-01-22 Praneeth Kumar Vippathalla , Mihai-Alin Badiu , Justin P. Coon

Recent works have shown that the task of wireless transmission of images can be learned with the use of machine learning techniques. Very promising results in end-to-end image quality, superior to popular digital schemes that utilize source…

Image and Video Processing · Electrical Eng. & Systems 2021-11-29 Tze-Yang Tung , David Burth Kurka , Mikolaj Jankowski , Deniz Gündüz

Recent works have shown that modern machine learning techniques can provide an alternative approach to the long-standing joint source-channel coding (JSCC) problem. Very promising initial results, superior to popular digital schemes that…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Tze-Yang Tung , David Burth Kurka , Mikolaj Jankowski , Deniz Gunduz

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

Current region feature-based image captioning methods have progressed rapidly and achieved remarkable performance. However, they are still prone to generating irrelevant descriptions due to the lack of contextual information and the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jun Wan , Jun Liu , Zhihui lai , Jie Zhou

Rate-distortion optimization (RDO) of codecs, where distortion is quantified by the mean-square error, has been a standard practice in image/video compression over the years. RDO serves well for optimization of codec performance for…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 Ogun Kirmemis , A. Murat Tekalp

Guided depth super-resolution (GDSR) is an essential topic in multi-modal image processing, which reconstructs high-resolution (HR) depth maps from low-resolution ones collected with suboptimal conditions with the help of HR RGB images of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zixiang Zhao , Jiangshe Zhang , Shuang Xu , Zudi Lin , Hanspeter Pfister

Ultra-high-resolution streaming and emerging immersive services are driving rapidly increasing wireless video traffic. However, perceptually pleasing video transmission over bandwidth-limited and latency-constrained wireless links remains…

Image and Video Processing · Electrical Eng. & Systems 2026-05-20 Yinhuan Huang , Zhijin Qin

We propose deep learning based communication methods for adaptive-bandwidth transmission of images over wireless channels. We consider the scenario in which images are transmitted progressively in layers over time or frequency, and such…

Information Theory · Computer Science 2021-06-15 David Burth Kurka , Deniz Gündüz

Deep learning-based joint source-channel coding (DJSCC) is expected to be a key technique for {the} next-generation wireless networks. However, the existing DJSCC schemes still face the challenge of channel adaptability as they are…

Information Theory · Computer Science 2024-01-23 Songjie Xie , Hengtao He , Hongru Li , Shenghui Song , Jun Zhang , Ying-Jun Angela Zhang , Khaled B. Letaief

A communication setup is considered where a transmitter wishes to convey a message to a receiver and simultaneously estimates the state of that receiver through a common waveform. The state is estimated at the transmitter by means of…

Information Theory · Computer Science 2022-06-03 Mehrasa Ahmadipour , Mari Kobayashi , Miche`le Wigger , Giuseppe Caire

Semantic communications (SemComs) have emerged as a promising paradigm for joint data and task-oriented transmissions, combining the demands for both the bit-accurate delivery and end-to-end (E2E) distortion minimization. However, current…

Information Theory · Computer Science 2025-08-12 Dongxu Li , Kai Yuan , Jianhao Huang , Chuan Huang , Xiaoqi Qin , Shuguang Cui , Ping Zhang