English
Related papers

Related papers: Interpreting Neural Min-Sum Decoders

200 papers

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

In this paper, the performance limits and the computational complexity of the lattice sequential decoder are analyzed for the unconstrained additive white Gaussian noise channel. The performance analysis available in the literature for such…

Information Theory · Computer Science 2013-04-11 Walid Abediseid , Mohamed-Slim Alouini

Applying the max-product (and belief-propagation) algorithms to loopy graphs is now quite popular for best assignment problems. This is largely due to their low computational complexity and impressive performance in practice. Still, there…

Information Theory · Computer Science 2011-07-19 Yung-Yih Jian , Henry D. Pfister

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

We focus on designing error-correcting codes for the symmetric Gaussian broadcast channel with feedback. Feedback not only expands the capacity region of the broadcast channel but also enhances transmission reliability. In this work, we…

Information Theory · Computer Science 2025-03-04 Yingyao Zhou , Natasha Devroye

Quantum low-density parity-check (QLDPC) codes have emerged as a promising technique for quantum error correction. A variety of decoders have been proposed for QLDPC codes and many of them utilize belief propagation (BP) decoding in some…

Information Theory · Computer Science 2024-06-25 Hanwen Yao , Waleed Abu Laban , Christian Häger , Alexandre Graell i Amat , Henry D. Pfister

We introduce an algorithm where the individual bits representing the weights of a neural network are learned. This method allows training weights with integer values on arbitrary bit-depths and naturally uncovers sparse networks, without…

Machine Learning · Computer Science 2022-02-22 Cristian Ivan

In this work, we investigate the decoding of Low-Density Parity-Check (LDPC) codes using informed dynamic scheduling algorithms that require a reduced number of iterations. In particular, we devise the weighted residual layered belief…

Information Theory · Computer Science 2024-10-18 H. Touati , R. C. de Lamare

Fault-tolerant quantum computing demands decoders that are fast, accurate, and adaptable to circuit structure and realistic noise. While machine learning (ML) decoders have demonstrated impressive performance for quantum memory, their use…

Quantum Physics · Physics 2025-09-16 J. Pablo Bonilla Ataides , Andi Gu , Susanne F. Yelin , Mikhail D. Lukin

Errors in surface code have typically been decoded by Minimum Weight Perfect Matching (MWPM) based method. Recently, neural-network-based Machine Learning (ML) techniques have been employed for this purpose. Here we propose a two-level (low…

Polar codes have drawn much attention and been adopted in 5G New Radio (NR) due to their capacity-achieving performance. Recently, as the emerging deep learning (DL) technique has breakthrough achievements in many fields, neural network…

Signal Processing · Electrical Eng. & Systems 2019-02-05 Chieh-Fang Teng , Chen-Hsi Wu , Kuan-Shiuan Ho , An-Yeu Wu

This paper presents an enhanced belief propagation (BP) decoding algorithm and a reinforcement learning-based BP decoding algorithm for polar codes. The enhanced BP algorithm weighs each Processing Element (PE) input based on their signals…

Information Theory · Computer Science 2021-11-02 L. M. Oliveira , R. M. Oliveira , R. C. de Lamare

In this paper, we study the problem of latency and reliability trade-off in ultra-reliable low-latency communication (URLLC) in the presence of decoding complexity constraints. We consider linear block encoded codewords transmitted over a…

Information Theory · Computer Science 2021-01-08 Hasan Basri Celebi , Antonios Pitarokoilis , Mikael Skoglund

Constrained sequence codes have been widely used in modern communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel, hence enabling efficient and reliable…

Information Theory · Computer Science 2018-09-07 Congzhe Cao , Duanshun Li , Ivan Fair

An essential goal in mechanistic interpretability to decode a network, i.e., to convert a neural network's raw weights to an interpretable algorithm. Given the difficulty of the decoding problem, progress has been made to understand the…

Machine Learning · Computer Science 2023-12-07 Isaac Liao , Ziming Liu , Max Tegmark

Recent advances in deep learning have achieved impressive gains in classification accuracy on a variety of types of data, including images and text. Despite these gains, however, concerns have been raised about the calibration, robustness,…

Machine Learning · Computer Science 2018-11-20 Dallas Card , Michael Zhang , Noah A. Smith

A novel and efficient neural decoder algorithm is proposed. The proposed decoder is based on the neural Belief Propagation algorithm and the Automorphism Group. By combining neural belief propagation with permutations from the Automorphism…

Information Theory · Computer Science 2018-01-10 Eliya Nachmani , Yaron Bachar , Elad Marciano , David Burshtein , Yair Be'ery

Just as the Hamming weight spectrum of a linear block code sheds light on the performance of a maximum likelihood decoder, the pseudo-weight spectrum provides insight into the performance of a linear programming decoder. Using properties of…

Information Theory · Computer Science 2016-11-17 Panu Chaichanavong , Paul H. Siegel

Binary message-passing decoders for low-density parity-check (LDPC) codes are studied by using extrinsic information transfer (EXIT) charts. The channel delivers hard or soft decisions and the variable node decoder performs all computations…

Information Theory · Computer Science 2016-11-18 Gottfried Lechner , Troels Pedersen , Gerhard Kramer

We propose a novel method for interpreting neural networks, focusing on convolutional neural network-based receiver model. The method identifies which unit or units of the model contain most (or least) information about the channel…

Machine Learning · Computer Science 2025-05-26 Marko Tuononen , Dani Korpi , Ville Hautamäki
‹ Prev 1 3 4 5 6 7 10 Next ›