English
Related papers

Related papers: Sparsifying Parity-Check Matrices

200 papers

A new construction is proposed for low density parity check (LDPC) codes using quadratic permutation polynomials over finite integer rings. The associated graphs for the new codes have both algebraic and pseudo-random nature, and the new…

Information Theory · Computer Science 2007-07-13 Oscar Y. Takeshita

Current research proposes a natural environment for the space-time codes and in this context it is obtained a new design criterion for space-time codes in multi-antenna communication channels. The objective of this criterion is to minimize…

Information Theory · Computer Science 2014-07-16 Carlos A. R. Martins , Eduardo Brandani da Silva

In this paper, a new method for decoding Low Density Parity Check (LDPC) codes, based on Multi-Layer Perceptron (MLP) neural networks is proposed. Due to the fact that in neural networks all procedures are processed in parallel, this method…

Information Theory · Computer Science 2014-11-14 Alireza Karami , Mahmoud Ahmadian Attari

The Consultative Committee for Space Data Systems (CCSDS) 141.11-O-1 Line Product Code (LPC) provides a rare opportunity to compare maximum-likelihood decoding and message passing. The LPC considered in this paper is intended to serve as…

Information Theory · Computer Science 2021-11-16 Jonathan Nguyen , Linfang Wang , Chester Hulse , Sahil Dani , Amaael Antonini , Todd Chauvin , Divsalar Dariush , Richard Wesel

Low-density parity-check (LDPC) codes are one of the most promising families of codes to replace the Goppa codes originally used in the McEliece cryptosystem. In fact, it has been shown that by using quasi-cyclic low-density parity-check…

Information Theory · Computer Science 2016-11-15 Marco Baldi , Marco Bianchi , Franco Chiaraluce

Iterative decoding and linear programming decoding are guaranteed to converge to the maximum-likelihood codeword when the underlying Tanner graph is cycle-free. Therefore, cycles are usually seen as the culprit of low-density parity-check…

Information Theory · Computer Science 2017-06-22 Wittawat Kositwattanarerk

Large Language Models (LLMs) as stochastic systems may generate numbers that deviate from available data, a failure known as \emph{numeric hallucination}. Existing safeguards -- retrieval-augmented generation, citations, and uncertainty…

Computation and Language · Computer Science 2025-09-09 Aivin V. Solatorio

A generic $(r,m)$-erasure correcting set is a collection of vectors in $\bF_2^r$ which can be used to generate, for each binary linear code of codimension $r$, a collection of parity check equations that enables iterative decoding of all…

Information Theory · Computer Science 2007-07-13 Henk D. L. Hollmann , Ludo M. G. M. Tolhuizen

Hinging on ideas from physical-layer network coding, some promising proposals of coded random access systems seek to improve system performance (while preserving low complexity) by means of packet repetitions and decoding of linear…

Information Theory · Computer Science 2018-05-30 Adriano Pastore , Paul de Kerret , Monica Navarro , David Gregoratti , David Gesbert

Achieving high image quality is an important aspect in an increasing number of wireless multimedia applications. These applications require resource efficient error correction hardware to detect and correct errors introduced by the…

Information Theory · Computer Science 2013-08-02 Vikram Arkalgud Chandrasetty , Syed Mahfuzul Aziz

In this paper, we present an improved union bound on the Linear Programming (LP) decoding performance of the binary linear codes transmitted over an additive white Gaussian noise channels. The bounding technique is based on the second-order…

Information Theory · Computer Science 2012-03-09 Ohad Gidon , Yair Be'ery

Non-binary low-density parity-check (LDPC) codes have some advantages over their binary counterparts, but unfortunately their decoding complexity is a significant challenge. The iterative hard- and soft-reliability based majority-logic…

Information Theory · Computer Science 2015-06-22 Chenrong Xiong , Zhiyuan Yan

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

While low-density parity-check (LDPC) codes are near capacity-achieving when paired with iterative decoders, these decoders may not output a codeword due to the existence of pseudocodewords. Thus, pseudocodewords have been studied to give…

Information Theory · Computer Science 2025-12-03 Wittawat Kositwattanarerk , Gretchen L. Matthews , Emily McMillon , Tunchanok Yutitumsatit

Mathematical programming is a branch of applied mathematics and has recently been used to derive new decoding approaches, challenging established but often heuristic algorithms based on iterative message passing. Concepts from mathematical…

Information Theory · Computer Science 2014-04-29 Michael Helmling , Stefan Ruzika , Akin Tanatmis

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix…

Information Theory · Computer Science 2019-05-17 Wei-Ting Chang , Ravi Tandon

Neural networks in modern communication systems can be susceptible to internal numerical errors that can drastically effect decision results. Such structures are composed of many sections each of which generally contain weighting operations…

Signal Processing · Electrical Eng. & Systems 2023-06-16 George Redinbo

In order to understand the performance of a code under maximum-likelihood (ML) decoding, one studies the codewords, in particular the minimal codewords, and their Hamming weights. In the context of linear programming (LP) decoding, one's…

Information Theory · Computer Science 2007-07-13 Roxana Smarandache , Pascal O. Vontobel

A variation of Gallager error-correcting codes is investigated using statistical mechanics. In codes of this type, a given message is encoded into a codeword which comprises Boolean sums of message bits selected by two randomly constructed…

Disordered Systems and Neural Networks · Physics 2009-10-31 Tatsuto Murayama , Yoshiyuki Kabashima , David Saad , Renato Vicente

Matrix multiplication over the real field constitutes a foundational operation in the training of deep learning models, serving as a computational cornerstone for both forward and backward propagation processes. However, the presence of…

Information Theory · Computer Science 2025-08-07 Hao Shi , Zhengyi Jiang , Zhongyi Huang , Bo Bai , Gong Zhang , Hanxu Hou