English
Related papers

Related papers: Separate Source Channel Coding Is Still What You N…

200 papers

Semantic communications have shown great potential to boost the end-to-end transmission performance. To further improve the system efficiency, in this paper, we propose a class of novel semantic coded transmission (SCT) schemes over…

Information Theory · Computer Science 2022-11-01 Shengshi Yao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

We propose a joint source and channel coding (JSCC) technique for wireless image transmission that does not rely on explicit codes for either compression or error correction; instead, it directly maps the image pixel values to the…

Information Theory · Computer Science 2020-04-10 Eirina Bourtsoulatze , David Burth Kurka , Deniz Gunduz

Channel prediction is an effective approach for reducing the feedback or estimation overhead in massive multi-input multi-output (m-MIMO) systems. However, existing channel prediction methods lack precision due to model mismatch errors or…

Signal Processing · Electrical Eng. & Systems 2024-06-21 Boxun Liu , Xuanyu Liu , Shijian Gao , Xiang Cheng , Liuqing Yang

We investigate the computation of Csiszar's bounds for the joint source-channel coding (JSCC) error exponent, E_J, of a communication system consisting of a discrete memoryless source and a discrete memoryless channel. We provide equivalent…

Information Theory · Computer Science 2007-07-13 Y. Zhong , F. Alajaji , L. L. Campbell

Task-oriented semantic communications (TSC) enhance radio resource efficiency by transmitting task-relevant semantic information. However, current research often overlooks the inherent semantic distinctions among encoded features. Due to…

Information Theory · Computer Science 2024-05-02 Shuai Lyu , Yao Sun , Linke Guo , Xiaoyong Yuan , Fang Fang , Lan Zhang , Xianbin Wang

The verbosity of Chain-of-Thought (CoT) reasoning hinders its mass deployment in efficiency-critical applications. Recently, implicit CoT approaches have emerged, which encode reasoning steps within LLM's hidden embeddings (termed…

Computation and Language · Computer Science 2026-01-28 Yinhan He , Wendy Zheng , Yaochen Zhu , Zaiyi Zheng , Lin Su , Sriram Vasudevan , Qi Guo , Liangjie Hong , Jundong Li

Analog joint source-channel coding (JSCC) has demonstrated superior performance for semantic communications through graceful degradation across channel conditions. However, a fundamental hardware-software mismatch prevents deployment on…

Information Theory · Computer Science 2026-03-11 Shumin Yao , Hao Chen , Yaping Sun , Nan Ma , Xiaodong Xu , Qinglin Zhao , Shuguang Cui

We consider transmitting a source across a pair of independent, non-ergodic channels with random states (e.g., slow fading channels) so as to minimize the average distortion. The general problem is unsolved. Hence, we focus on comparing two…

Information Theory · Computer Science 2009-09-29 J. Nicholas Laneman , Emin Martinian , Gregory W. Wornell , John G. Apostolopoulos

Despite significant advancements in deep learning based CSI compression, some key limitations remain unaddressed. Current approaches predominantly treat CSI compression as a source-coding problem, thereby neglecting transmission errors.…

Information Theory · Computer Science 2026-02-19 Sravan Kumar Ankireddy , Heasung Kim , Joonyoung Cho , Hyeji Kim

We study reliable transmission of arbitrarily correlated sources over multiple-access relay channels (MARCs) and multiple-access broadcast relay channels (MABRCs). In MARCs only the destination is interested in reconstructing the sources,…

Information Theory · Computer Science 2016-11-17 Yonathan Murin , Ron Dabora , Deniz Gündüz

Random Linear Network Coding (RLNC) has emerged as a powerful tool for robust high-throughput multicast. Projection analysis - a recently introduced technique - shows that the distributed packetized RLNC protocol achieves (order) optimal…

Information Theory · Computer Science 2011-02-17 Bernhard Haeupler , Muriel Médard

The secure multiplex coding (SMC) is a technique to remove rate loss in the coding for wire-tap channels and broadcast channels with confidential messages caused by the inclusion of random bits into transmitted signals. SMC replaces the…

Information Theory · Computer Science 2016-09-28 Masahito Hayashi , Ryutaroh Matsumoto

In Earth observation (EO) missions with Low Earth orbit (LEO) satellites, high-resolution image acquisition generates a massive data volume that poses a significant challenge for transmission under the limited satellite power budget, while…

Signal Processing · Electrical Eng. & Systems 2026-03-13 Hung Nguyen-Kha , Ti Ti Nguyen , Vu Nguyen Ha , Eva Lagunas , Symeon Chatzinotas , Bjorn Ottersten

Large language models (LLMs) have revolutionized code generation, significantly enhancing developer productivity. However, for a vast number of users with minimal coding knowledge, LLMs provide little support, as they primarily generate…

Software Engineering · Computer Science 2025-04-02 Hongru Ma , Yanjie Liang , Jiasheng Si , Weiyu Zhang , Hongjiao Guan , Chaoqun Zheng , Bing Xu , Wenpeng Lu

With the recent unprecedented advancements in Artificial Intelligence (AI) computing, progress in Large Language Models (LLMs) is accelerating rapidly, presenting challenges in establishing clear guidelines, particularly in the field of…

Cryptography and Security · Computer Science 2024-09-04 Nafis Tanveer Islam , Joseph Khoury , Andrew Seong , Elias Bou-Harb , Peyman Najafirad

Motivated by surveillance applications with wireless cameras or drones, we consider the problem of image retrieval over a wireless channel. Conventional systems apply lossy compression on query images to reduce the data that must be…

Information Theory · Computer Science 2020-10-21 Mikolaj Jankowski , Deniz Gunduz , Krystian Mikolajczyk

The problem of goal-oriented semantic filtering and timely source coding in multiuser communication systems is considered here. We study a distributed monitoring system in which multiple information sources, each observing a physical…

Information Theory · Computer Science 2024-02-16 Pouya Agheli , Nikolaos Pappas , Marios Kountouris

Recent developments in Deep learning based Joint Source-Channel Coding (DeepJSCC) have demonstrated impressive capabilities within wireless semantic communications system. However, existing DeepJSCC methodologies exhibit limited…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Liang Zhang , Danlan Huang , Xinyi Zhou , Feng Ding , Sheng Wu , Zhiqing Wei

Pre-trained language models based on masked language modeling (MLM) excel in natural language understanding (NLU) tasks. While fine-tuned MLM-based encoders consistently outperform causal language modeling decoders of comparable size,…

Computation and Language · Computer Science 2024-06-07 David Dukić , Jan Šnajder

The problem of source coding with side information (SCSI) is closely related to channel coding. Therefore, existing literature focuses on using the most successful channel codes namely, LDPC codes, turbo codes, and their variants, to solve…

Information Theory · Computer Science 2010-01-19 Mortuza Ali , Margreta Kuijper