English
Related papers

Related papers: Interpreting Neural Min-Sum Decoders

200 papers

In order to understand the performance of a code under maximum-likelihood (ML) decoding, it is crucial to know the minimal codewords. In the context of linear programming (LP) decoding, it turns out to be necessary to know the minimal…

Information Theory · Computer Science 2016-11-17 Pascal O. Vontobel , Roxana Smarandache , Negar Kiyavash , Jason Teutsch , Dejan Vukobratovic

We consider a windowed decoding scheme for LDPC convolutional codes that is based on the belief-propagation (BP) algorithm. We discuss the advantages of this decoding scheme and identify certain characteristics of LDPC convolutional code…

Information Theory · Computer Science 2016-11-17 Aravind Iyengar , Marco Papaleo , Paul Siegel , Jack Wolf , Alessandro Vanelli-Coralli , Giovanni Corazza

The problem of transmitting a parameter value over an additive white Gaussian noise (AWGN) channel is considered, where, in addition to the transmitter and the receiver, there is a helper that observes the noise non-causally and provides a…

Information Theory · Computer Science 2024-10-28 Anatoly Khina , Neri Merhav

Coding theory is a central discipline underpinning wireline and wireless modems that are the workhorses of the information age. Progress in coding theory is largely driven by individual human ingenuity with sporadic breakthroughs over the…

Machine Learning · Statistics 2018-05-24 Hyeji Kim , Yihan Jiang , Ranvir Rana , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

When it comes to the classification of brain signals in real-life applications, the training and the prediction data are often described by different distributions. Furthermore, diverse data sets, e.g., recorded from various subjects or…

In this paper we construct low-density parity-check (LDPC) codes from transversal designs with low error-floors over the additive white Gaussian noise (AWGN) channel. The constructed codes are based on transversal designs that arise from…

Information Theory · Computer Science 2014-03-20 Alexander Gruner , Michael Huber

Detectability of failures of linear programming (LP) decoding and the potential for improvement by adding new constraints motivate the use of an adaptive approach in selecting the constraints for the underlying LP problem. In this paper, we…

Information Theory · Computer Science 2007-07-13 Mohammad H. Taghavi , Paul H. Siegel

With the ever-increasing complexity of neural language models, practitioners have turned to methods for understanding the predictions of these models. One of the most well-adopted approaches for model interpretability is feature-based…

Computation and Language · Computer Science 2021-06-10 Muhammad Bilal Zafar , Michele Donini , Dylan Slack , Cédric Archambeau , Sanjiv Das , Krishnaram Kenthapadi

Reed-Muller (RM) codes achieve the capacity of general binary-input memoryless symmetric channels and are conjectured to have a comparable performance to that of random codes in terms of scaling laws. However, such results are established…

Information Theory · Computer Science 2023-08-02 Mohammad Vahid Jamali , Xiyang Liu , Ashok Vardhan Makkuva , Hessam Mahdavifar , Sewoong Oh , Pramod Viswanath

Dense prediction tasks have enjoyed a growing complexity of encoder architectures, decoders, however, have remained largely the same. They rely on individual blocks decoding intermediate feature maps sequentially. We introduce banks, shared…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Frederik Laboyrie , Mehmet Kerim Yucel , Albert Saa-Garriga

The problem of blind identification of channel codes at a receiver involves identifying a code chosen by a transmitter from a known code-family, by observing the transmitted codewords through the channel. Most existing approaches for…

Information Theory · Computer Science 2026-03-04 Pramod Singh , Prasad Krishnan , Arti Yardi

We propose a novel binary message passing decoding algorithm for product-like codes based on bounded distance decoding (BDD) of the component codes. The algorithm, dubbed iterative BDD with scaled reliability (iBDD-SR), exploits the channel…

Information Theory · Computer Science 2019-09-20 Alireza Sheikh , Alexandre Graell i Amat , Gianluigi Liva

This work introduces a novel, fully differentiable linear-time complexity transformer decoder and a transformer decoder to correct 5G New Radio (NR) LDPC. We propose a scalable approach to decode linear block codes with $O(n)$ complexity…

Machine Learning · Computer Science 2025-01-27 Mario Hernandez , Fernando Pinero

In order to understand the performance of a code under maximum-likelihood (ML) decoding, one studies the codewords, in particular the minimal codewords, and their Hamming weights. In the context of linear programming (LP) decoding, one's…

Information Theory · Computer Science 2007-07-13 Roxana Smarandache , Pascal O. Vontobel

In this paper, the performance of quadratic residue (QR) codes of lengths within 100 is given and analyzed when the hard decoding, soft decoding, and linear programming decoding algorithms are utilized. We develop a simple method to…

Information Theory · Computer Science 2014-08-26 Yong Li , Qianbin Chen , Hongqing Liu , Trieu-Kien Truong

There has been a rise in decoding quantum error correction codes with neural network based decoders, due to the good decoding performance achieved and adaptability to any noise model. However, the main challenge is scalability to larger…

Quantum Physics · Physics 2019-02-07 Savvas Varsamopoulos , Koen Bertels , Carmen G. Almudever

Many different deep networks have been used to approximate, accelerate or improve traditional image operators. Among these traditional operators, many contain parameters which need to be tweaked to obtain the satisfactory results, which we…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Qingnan Fan , Dongdong Chen , Lu Yuan , Gang Hua , Nenghai Yu , Baoquan Chen

In this work, we investigate the problem of neural-based error correction decoding, and more specifically, the new so-called syndrome-based decoding technique introduced to tackle scalability in the training phase for larger code sizes. We…

Information Theory · Computer Science 2024-03-06 Gastón De Boni Rovella , Meryem Benammar

Effective iterative decoding of short BCH codes faces two primary challenges: identifying an appropriate parity-check matrix and accelerating decoder convergence. To address these issues, we propose a systematic scheme to derive an…

Information Theory · Computer Science 2024-11-22 Guangwen Li , Xiao Yu

The sum-rank metric generalizes the Hamming and rank metric by partitioning vectors into blocks and defining the total weight as the sum of the rank weights of these blocks, based on their matrix representation. In this work, we explore…

Information Theory · Computer Science 2024-10-22 Thomas Jerkovits , Hannes Bartz , Antonia Wachter-Zeh
‹ Prev 1 8 9 10 Next ›