English
Related papers

Related papers: Information Rates and Error Exponents for Probabil…

200 papers

Error exponents characterize the exponential decay, when increasing message length, of the probability of error of many error-correcting codes. To tackle the long standing problem of computing them exactly, we introduce a general,…

Disordered Systems and Neural Networks · Physics 2007-07-16 Thierry Mora , Olivier Rivoire

We initiate the probabilistic analysis of linear programming (LP) decoding of low-density parity-check (LDPC) codes. Specifically, we show that for a random LDPC code ensemble, the linear programming decoder of Feldman et al. succeeds in…

Information Theory · Computer Science 2016-11-15 Constantinos Daskalakis , Alexandros G. Dimakis , Richard M. Karp , Martin J. Wainwright

We propose a probabilistic shaping approach for region-of-interest signaling, where a low-rate signal controls the desired probabilistic ranges of a high-rate data stream using a flexible distribution controller. In addition, we introduce…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Duc-Phuc Nguyen , Yoshifumi Shiraki , Jun Muramatsu , Takehiro Moriya

Integrated sensing and communications (ISAC) promises new use cases for mobile communication systems by reusing the communication signal for radar-like sensing. However, sensing and communications (S&C) impose conflicting requirements on…

Signal Processing · Electrical Eng. & Systems 2026-02-23 Benedikt Geiger , Fan Liu , Shihang Lu , Andrej Rode , Daniel Gil Gaviria , Charlotte Muth , Laurent Schmalen

Sparse superposition codes, or sparse regression codes (SPARCs), are a recent class of codes for reliable communication over the AWGN channel at rates approaching the channel capacity. Approximate message passing (AMP) decoding, a…

Information Theory · Computer Science 2019-04-24 Cynthia Rush , Ramji Venkataramanan

This paper studies random-coding error exponents of randomised list decoding, in which the decoder randomly selects $L$ messages with probabilities proportional to the decoding metric of the codewords. The exponents (or bounds) are given…

Information Theory · Computer Science 2026-01-15 Henrique K. Miyamoto , Sheng Yang

An end-to-end learning method for constellation shaping with a shaping-encoder assisted transceiver architecture is presented. The shaping encoder, which produces shaping bits with a higher probability of zeros, is used to produce an…

Information Theory · Computer Science 2025-10-28 Harindu Jayarathne , Dileepa Marasinghe , Nandana Rajatheva , Matti Latva-aho

Optical orthogonal frequency-division multiplexing (OFDM) and probabilistic constellation shaping (PCS) have emerged as powerful techniques to enhance the performance of optical wireless communications (OWC) systems. While PCS improves…

Systems and Control · Electrical Eng. & Systems 2025-07-11 Thanh V. Pham , Susumu Ishihara

High-throughput optical communication systems utilize binary soft-decision forward error correction (SD-FEC) with bit interleaving over the bit channels. The generalized mutual information (GMI) is an achievable information rate (AIR) in…

Information Theory · Computer Science 2024-01-30 Tsuyoshi Yoshida , Magnus Karlsson , Erik Agrell

A non-uniform channel input distribution is key for achieving the capacity of arbitrary channels. However, message bits are generally assumed to follow a uniform distribution which must first be transformed to a non-uniform distribution by…

Information Theory · Computer Science 2025-12-19 Frederik Ritter , Andrej Rode , Laurent Schmalen

The implementation difficulties of combining distribution matching (DM) and dematching (invDM) for probabilistic shaping (PS) with soft-decision forward error correction (FEC) coding can be relaxed by reverse concatenation, for which the…

Signal Processing · Electrical Eng. & Systems 2024-01-25 Tsuyoshi Yoshida , Magnus Karlsson , Erik Agrell

The choice of constellations largely affects the performance of communication systems. When designing constellations, both the locations and probability of occurrence of the points can be optimized. These approaches are referred to as…

Information Theory · Computer Science 2019-08-30 Maximilian Stark , Fayçal Ait Aoudia , Jakob Hoydis

Convolutional precoding in polarization-adjusted convolutional (PAC) codes can reduce the number of minimum weight codewords (a.k.a error coefficient) of polar codes. This can result in improving the error correction performance of (near)…

Information Theory · Computer Science 2022-12-02 Xinyi Gu , Mohammad Rowshan , Jinhong Yuan

In this work, the design of robust, protograph-based low-density parity-check (LDPC) codes for rate-adaptive communication via probabilistic shaping is considered. Recently, probabilistic amplitude shaping (PAS) by B\"ocherer et al. has…

Information Theory · Computer Science 2016-07-04 Fabian Steiner , Patrick Schulte

In this letter, we propose a symbol-wise puncturing scheme to support hybrid automatic repeat request (HARQ) integrated probabilistic amplitude shaping (PAS). To prevent the probability distribution distortion caused by the traditional…

Information Theory · Computer Science 2022-07-26 Li Shen , Yongpeng Wu , Derrick Wing Kwan Ng , Wenjun Zhang , Xiang-Gen Xia

Principal Component Analysis (PCA) minimizes the reconstruction error given a class of linear models of fixed component dimensionality. Probabilistic PCA adds a probabilistic structure by learning the probability distribution of the PCA…

Machine Learning · Computer Science 2022-09-20 Vanessa Böhm , Uroš Seljak

Probabilistic Answer Set Programming under the credal semantics (PASP) extends Answer Set Programming with probabilistic facts that represent uncertain information. The probabilistic facts are discrete with Bernoulli distributions. However,…

Artificial Intelligence · Computer Science 2025-02-19 Damiano Azzolini , Fabrizio Riguzzi

We derive a sphere-packing error exponent for coded transmission over discrete memoryless channels with a fixed decoding metric. By studying the error probability of the code over an auxiliary channel, we find a lower bound to the…

Information Theory · Computer Science 2022-12-29 Ehsan Asadi Kangarshahi , Albert Guillén i Fàbregas

Recently, a novel variation of polar codes known as polarization-adjusted convolutional (PAC) codes has been introduced by Ar{\i}kan. These codes significantly outperform conventional polar and convolutional codes, particularly for short…

Information Theory · Computer Science 2025-08-15 Mohsen Moradi , Hessam Mahdavifar

We present the first neural probabilistic amplitude shaping that outperforms existing methods while accounting for all implementation losses, using a block-less, easily implementable sequential autoregressive encoder compatible with…

Machine Learning · Computer Science 2026-05-28 Mohammad Taha Askari , Lutz Lampe , Amirhossein Ghazisaeidi