English
Related papers

Related papers: Interpreting Neural Min-Sum Decoders

200 papers

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

We consider a trainable point-to-point communication system, where both transmitter and receiver are implemented as neural networks (NNs), and demonstrate that training on the bit-wise mutual information (BMI) allows seamless integration…

Information Theory · Computer Science 2020-06-08 Sebastian Cammerer , Fayçal Ait Aoudia , Sebastian Dörner , Maximilian Stark , Jakob Hoydis , Stephan ten Brink

We introduce a novel algorithm for decoding binary linear codes by linear programming. We build on the LP decoding algorithm of Feldman et al. and introduce a post-processing step that solves a second linear program that reweights the…

Information Theory · Computer Science 2011-03-16 Amin Khajehnejad , Alexandros G. Dimakis , Babak Hassibi , Benjamin Vigoda , William Bradley

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We revisit the idea of using deep neural networks for one-shot decoding of random and structured codes, such as polar codes. Although it is possible to achieve maximum a posteriori (MAP) bit error rate (BER) performance for both code…

Information Theory · Computer Science 2017-01-27 Tobias Gruber , Sebastian Cammerer , Jakob Hoydis , Stephan ten Brink

We present a new decoder for the surface code, which combines the accuracy of the tensor-network decoders with the efficiency and parallelism of the belief-propagation algorithm. Our main idea is to replace the expensive tensor-network…

Quantum Physics · Physics 2024-04-17 Aviad Kaufmann , Itai Arad

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

The development of practical, high-performance decoding algorithms reduces the resource cost of fault-tolerant quantum computing. Here we propose a decoder for the surface code that finds low-weight correction operators for errors produced…

Quantum Physics · Physics 2025-02-19 Asmae Benhemou , Kaavya Sahay , Lingling Lao , Benjamin J. Brown

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-28 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink

Reliably transmitting messages despite information loss due to a noisy channel is a core problem of information theory. One of the most important aspects of real world communication, e.g. via wifi, is that it may happen at varying levels of…

Machine Learning · Computer Science 2020-04-02 Karen Ullrich , Fabio Viola , Danilo Jimenez Rezende

A scheme is proposed that combines probabilistic signal shaping with bit-metric decoding. The transmitter generates symbols according to a distribution on the channel input alphabet. The symbols are labeled by bit strings. At the receiver,…

Information Theory · Computer Science 2014-04-22 Georg Böcherer

The performance of maximum-likelihood (ML) decoded binary linear block codes is addressed via the derivation of tightened upper bounds on their decoding error probability. The upper bounds on the block and bit error probabilities are valid…

Information Theory · Computer Science 2007-07-13 M. Twitto , I. Sason , S. Shamai

The quality and quantity of data used for training greatly influence the performance and effectiveness of deep learning models. In the context of error correction, it is essential to generate high-quality samples that are neither…

Information Theory · Computer Science 2026-03-23 Hassan Noghrei , Mohammad-Reza Sadeghi , Wai Ho Mow

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

Recently, neural networks have improved MinSum message-passing decoders for low-density parity-check (LDPC) codes by multiplying or adding weights to the messages, where the weights are determined by a neural network. The neural network…

Signal Processing · Electrical Eng. & Systems 2023-12-06 Linfang Wang , Caleb Terrill , Richard Wesel , Dariush Divsalar

We present an approach to showing that a linear code is resilient to random errors. We use this approach to obtain decoding results for both transitive codes and Reed-Muller codes. We give three kinds of results about linear codes in…

Information Theory · Computer Science 2025-02-27 Anup Rao , Oscar Sprumont

We introduce a sliding window decoder based on belief propagation (BP) with guided decimation for the purposes of decoding quantum low-density parity-check codes in the presence of circuit-level noise. Windowed decoding keeps the decoding…

Quantum Physics · Physics 2024-03-29 Anqi Gong , Sebastian Cammerer , Joseph M. Renes

Predictive coding networks are neural models that perform inference through an iterative energy minimization process, whose operations are local in space and time. While effective in shallow architectures, they suffer significant…

Machine Learning · Computer Science 2025-10-13 Chang Qi , Matteo Forasassi , Thomas Lukasiewicz , Tommaso Salvatori

Transformer-based neural decoders have emerged as a promising approach to error correction coding, combining data-driven adaptability with efficient modeling of long-range dependencies. This paper presents a novel decoder architecture that…

Information Theory · Computer Science 2025-09-22 Chin Wa Lau , Xiang Shi , Ziyan Zheng , Haiwen Cao , Nian Guo