English
Related papers

Related papers: Block Markov Superposition Transmission of BCH Cod…

200 papers

We consider near maximum-likelihood (ML) decoding of short linear block codes based on neural belief propagation (BP) decoding recently introduced by Nachmani et al.. While this method significantly outperforms conventional BP decoding, the…

Information Theory · Computer Science 2020-10-26 Andreas Buchberger , Christian Häger , Henry D. Pfister , Laurent Schmalen , Alexandre Graell i Amat

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

High quality data is essential in deep learning to train a robust model. While in other fields data is sparse and costly to collect, in error decoding it is free to query and label thus allowing potential data exploitation. Utilizing this…

Information Theory · Computer Science 2019-11-22 Ishay Be'ery , Nir Raviv , Tomer Raviv , Yair Be'ery

Topological quantum codes, such as toric and surface codes, are excellent candidates for hardware implementation due to their robustness against errors and their local interactions between qubits. However, decoding these codes efficiently…

Quantum Physics · Physics 2024-09-16 Michele Pacenti , Mark F. Flanagan , Dimitris Chytas , Bane Vasic

Minimum Bayes Risk (MBR) decoding is a powerful decoding strategy widely used for text generation tasks, but its quadratic computational complexity limits its practical application. This paper presents a novel approach for approximating MBR…

Computation and Language · Computer Science 2024-06-06 Firas Trabelsi , David Vilar , Mara Finkelstein , Markus Freitag

In this paper, we propose a systematic low density generator matrix (LDGM) code ensemble, which is defined by the Bernoulli process. We prove that, under maximum likelihood (ML) decoding, the proposed ensemble can achieve the capacity of…

Information Theory · Computer Science 2020-01-10 Suihua Cai , Wenchao Lin , Xinyuanmeng Yao , Baodian Wei , Xiao Ma

This paper presents a new class of sparse superposition codes for low-rates and short-packet communications over the additive white Gaussian noise channel. The new code is orthogonal sparse superposition (OSS) code. A codeword of OSS codes…

Information Theory · Computer Science 2020-11-24 Yunseo Nam , Jeonghun Park , Songnam Hong , Namyoon Lee

Algebraic decoding algorithms are commonly applied for the decoding of Reed-Solomon codes. Their main advantages are low computational complexity and predictable decoding capabilities. Many algorithms can be extended for correction of both…

Information Theory · Computer Science 2015-03-19 Christian Senger , Vladimir R. Sidorenko , Steffen Schober , Martin Bossert , Victor V. Zyablov

In this paper the choice of the Bernoulli distribution as biased distribution for importance sampling (IS) Monte-Carlo (MC) simulation of linear block codes over binary symmetric channels (BSCs) is studied. Based on the analytical…

Information Theory · Computer Science 2013-11-07 Gianmarco Romano , Domenico Ciuonzo

Quantum computers are highly vulnerable to noise, necessitating the use of error-correcting codes to protect stored data. Errors must be continuously corrected over time to counteract decoherence using appropriate decoders. Therefore, fast…

Quantum Physics · Physics 2025-04-03 Diego Forlivesi , Lorenzo Valentini , Marco Chiani

In this paper, we propose a new class of quantized message-passing decoders for LDPC codes over the BSC. The messages take values (or levels) from a finite set. The update rules do not mimic belief propagation but instead are derived using…

Information Theory · Computer Science 2016-11-15 Shiva Kumar Planjery , David Declercq , Shashi Kiran Chilappagari , Bane Vasić

With the popularity of the recent Transformer-based models represented by BERT, GPT-3 and ChatGPT, there has been state-of-the-art performance in a range of natural language processing tasks. However, the massive computations, huge memory…

Computation and Language · Computer Science 2023-04-04 Gaochen Dong , Wei Chen

A novel adaptive binary decoding algorithm for LDPC codes is proposed, which reduces the decoding complexity while having a comparable or even better performance than corresponding non-adaptive alternatives. In each iteration the variable…

Information Theory · Computer Science 2009-04-24 Ingmar Land , Gottfried Lechner , Lars K. Rasmussen

In the short block length regime, ensemble decoding schemes with their inherently parallel structure can improve error correction performance and reduce latency compared to stand-alone suboptimal decoders such as belief propagation (BP). In…

Information Theory · Computer Science 2026-04-09 Jonathan Mandelbaum , Paul Bezner , Holger Jäkel , Stephan ten Brink , Laurent Schmalen

In this paper, we propose a new method for calculating the output layer in neural machine translation systems. The method is based on predicting a binary code for each word and can reduce computation time/memory requirements of the output…

Computation and Language · Computer Science 2017-04-25 Yusuke Oda , Philip Arthur , Graham Neubig , Koichiro Yoshino , Satoshi Nakamura

The performance of algebraic soft-decision decoding of Reed-Solomon codes using bit-level soft information is investigated. Optimal multiplicity assignment strategies of algebraic soft-decision decoding with infinite cost are first studied…

Information Theory · Computer Science 2008-08-05 Jing Jiang , Krishna R. Narayanan

A new algorithm for efficient exact maximum likelihood decoding of polar codes (which may be CRC augmented), transmitted over the binary erasure channel, is presented. The algorithm applies a matrix triangulation process on a sparse polar…

Information Theory · Computer Science 2021-06-29 Yonatan Urman , David Burshtein

Cyclic codes are an interesting class of linear codes due to their efficient encoding and decoding algorithms as well as their theoretical importance. BCH codes form a subclass of cyclic codes and are very important in both theory and…

Information Theory · Computer Science 2016-08-09 Shuxing Li , Cunsheng Ding , Hao Liu

We propose four finite-length scaling laws to predict the frame error rate (FER) performance of spatially-coupled low-density parity-check codes under full belief propagation (BP) decoding with a limit on the number of decoding iterations…

Information Theory · Computer Science 2022-03-18 Roman Sokolovskii , Alexandre Graell i Amat , Fredrik Brännström

The medium-density parity-check (MDPC) code-based Bit Flipping Key Encapsulation (BIKE) mechanism remains a candidate of post-quantum cryptography standardization. The latest version utilizes a new bit-flipping (BF) decoding algorithm,…

Cryptography and Security · Computer Science 2024-12-17 Jiaxuan Cai , Xinmiao Zhang
‹ Prev 1 8 9 10 Next ›