English
Related papers

Related papers: Information Rates and Error Exponents for Probabil…

200 papers

The joint source-channel coding (JSCC) framework leverages deep learning to learn from data the best codes for source and channel coding. When the output signal, rather than being binary, is directly mapped onto the IQ domain…

Machine Learning · Computer Science 2024-06-07 Junli Fang , João F. C. Mota , Baoshan Lu , Weicheng Zhang , Xuemin Hong

A pinching-antenna system (PASS)-enhanced mobile edge computing (MEC) architecture is investigated to improve the task offloading efficiency and latency performance in dynamic wireless environments. By leveraging dielectric waveguides and…

Signal Processing · Electrical Eng. & Systems 2025-10-28 Zhaoming Hu , Ruikang Zhong , Xidong Mu , Dengao Li , Yuanwei Liu

Forward Error Correction (FEC) is used ubiquitously in the communication pipeline. We explore noncooperative decoding where we aim to recover the code rate of a linear block code. We present a metric to characterize the quality of the code…

Information Theory · Computer Science 2026-03-03 Atreya Vedantam , Radha Krishna Ganti

This paper proposed the application of post-encryption-compression (PEC) to strengthen the secrecy in the case of distributed encryption where the encryption keys are correlated to each other. We derive the universal code construction for…

Information Theory · Computer Science 2018-01-17 Bagus Santoso , Yasutada Oohama

We discuss a method to construct quantum codes correcting amplitude damping errors via code concatenation. The inner codes are chosen as asymmetric Calderbank-Shor-Steane (CSS) codes. By concatenating with outer codes correcting symmetric…

Quantum Physics · Physics 2016-10-31 Tyler Jackson , Markus Grassl , Bei Zeng

Speculative Decoding is a prominent technique for accelerating the autoregressive inference of large language models (LLMs) by employing a fast draft model to propose candidate token sequences and a large target model to verify them in…

Computation and Language · Computer Science 2025-12-18 Chendong Sun , Ali Mao , Lei Xu , mingmin Chen

Deep learning-based joint source-channel coding (JSCC) has shown excellent performance in image and feature transmission. However, the output values of the JSCC encoder are continuous, which makes the constellation of modulation complex and…

Information Theory · Computer Science 2022-07-13 Mengyang Wang , Jiahui Li , Mengyao Ma , Xiaopeng Fan

This is a tutorial and survey paper on factor analysis, probabilistic Principal Component Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods, which are tightly related, are dimensionality reduction and…

Machine Learning · Statistics 2022-05-25 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Belief propagation applied to iterative decoding and sparse recovery through approximate message passing (AMP) are two research areas that have seen monumental progress in recent decades. Inspired by these advances, this article introduces…

Information Theory · Computer Science 2023-01-06 Jamison R. Ebert , Jean-Francois Chamberland , Krishna R. Narayanan

A new class of folded subspace codes for noncoherent network coding is presented. The codes can correct insertions and deletions beyond the unique decoding radius for any code rate $R\in[0,1]$. An efficient interpolation-based decoding…

Information Theory · Computer Science 2015-04-22 Hannes Bartz , Vladimir Sidorenko

A reconfigurable pinching-antenna system (PASS) is presented, endowing pinching antennas (PAs) with both amplitude- and phase-controllable radiation beyond conventional implementations. To characterize this feature, a general and physically…

Information Theory · Computer Science 2025-09-09 Zhaolin Wang , Jiaqi Xu , Chongjun Ouyang , Xidong Mu , Yuanwei Liu

In this work we address the issues of probabilistic modelling of the decoding errors in hybrid ARQ (HARQ) rounds. In particular we i) claim that the assumption of independence of decoding errors, used implicitly in various works on this…

Information Theory · Computer Science 2015-12-09 Redouane Sassioui , Etienne Pierre-Doray , Leszek Szczecinski , Benoit Pelletier

We propose a novel neural sequence prediction method based on \textit{error-correcting output codes} that avoids exact softmax normalization and allows for a tradeoff between speed and performance. Instead of minimizing measures between the…

Machine Learning · Computer Science 2019-09-06 James O' Neill , Danushka Bollegala

Typical random codes (TRC) in a communication scenario of source coding with side information at the decoder is the main subject of this work. We study the semi-deterministic code ensemble, which is a certain variant of the ordinary random…

Information Theory · Computer Science 2021-01-29 Ran Tamir , Neri Merhav

Conventional synthetic aperture radar (SAR) imaging systems typically employ deterministic signal designs, which lack the capability to convey communication information and are thus not suitable for integrated sensing and communication…

Signal Processing · Electrical Eng. & Systems 2024-03-27 Bowen Zheng , Fan Liu

A new deep-neural-network (DNN) based error correction encoder architecture for channels with feedback, called Deep Extended Feedback (DEF), is presented in this paper. The encoder in the DEF architecture transmits an information message…

Information Theory · Computer Science 2021-05-05 Anahid Robert Safavi , Alberto G. Perotti , Branislav M. Popovic , Mahdi Boloursaz Mashhadi , Deniz Gunduz

I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin…

Condensed Matter · Physics 2016-08-31 Nicolas Sourlas

For communication systems with heavy burst noise, an optimal Forward Error Correction (FEC) scheme is expected to have a large burst error correction capacity while simultaneously owning moderate random error correction capability. This…

Information Theory · Computer Science 2015-01-27 Z. Wang , A. Chini , M. Kilani , J. Zhou

In this work, geometric shaping (GS) and probabilistic shaping (PS) for the AWGN channel is reviewed. Both approaches are investigated in terms of symbol-metric decoding (SMD) and bit-metric decoding (BMD). For GS, an optimization algorithm…

Information Theory · Computer Science 2016-08-16 Fabian Steiner , Georg Böcherer

State-constrained signal codes directly encode modulation signals using signal processing filters, the coefficients of which are constrained over the rings of formal power series. Although the performance of signal codes is defined by these…

Information Theory · Computer Science 2019-01-08 Manato Takai , Koji Ishibashi