English
Related papers

Related papers: Neural-Network-Optimized Degree-Specific Weights f…

200 papers

Neural-network decoders can achieve a lower logical error rate compared to conventional decoders, like minimum-weight perfect matching, when decoding the surface code. Furthermore, these decoders require no prior information about the…

Quantum Physics · Physics 2025-07-30 Boris M. Varbanov , Marc Serra-Peralta , David Byfield , Barbara M. Terhal

Reed-Muller (RM) codes exhibit good performance under maximum-likelihood (ML) decoding due to their highly-symmetric structure. In this paper, we explore the question of whether the code symmetry of RM codes can also be exploited to achieve…

Information Theory · Computer Science 2018-04-30 Elia Santi , Christian Häger , Henry D. Pfister

Neural network decoding algorithms are recently introduced by Nachmani et al. to decode high-density parity-check (HDPC) codes. In contrast with iterative decoding algorithms such as sum-product or min-sum algorithms in which the weight of…

Information Theory · Computer Science 2018-09-14 Mohammad-Reza Sadeghi , Farzane Amirzade , Daniel Panario , Amin Sakzad

The problem of low complexity, close to optimal, channel decoding of linear codes with short to moderate block length is considered. It is shown that deep learning methods can be used to improve a standard belief propagation decoder,…

Information Theory · Computer Science 2018-03-14 Eliya Nachmani , Elad Marciano , Loren Lugosch , Warren J. Gross , David Burshtein , Yair Beery

In this paper, we propose a novel message-passing decoding approach that leverages the degeneracy of quantum low-density parity-check codes to enhance decoding performance, eliminating the need for serial scheduling or post-processing. Our…

Quantum Physics · Physics 2025-01-10 Dimitris Chytas , Nithin Raveendran , Bane Vasic

Foundation models and their checkpoints have significantly advanced deep learning, boosting performance across various applications. However, fine-tuned models often struggle outside their specific domains and exhibit considerable…

We introduce a two-stage decimation process to improve the performance of neural belief propagation (NBP), recently introduced by Nachmani et al., for short low-density parity-check (LDPC) codes. In the first stage, we build a list by…

Information Theory · Computer Science 2020-11-05 Andreas Buchberger , Christian Häger , Henry D. Pfister , Laurent Schmalen , Alexandre Graell i Amat

The nuclear norm minimization (NNM) is commonly used to approximate the matrix rank by shrinking all singular values equally. However, the singular values have clear physical meanings in many practical problems, and NNM may not be able to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Zhiyuan Zha , Bihan Wen , Jiachao Zhang , Jiantao Zhou , Ce Zhu

In decoding linear block codes, it was shown that noticeable reliability gains can be achieved by introducing learnable parameters to the Belief Propagation (BP) decoder. Despite the success of these methods, there are two key open…

Information Theory · Computer Science 2023-04-13 Sravan Kumar Ankireddy , Hyeji Kim

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

Machine Learning · Statistics 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

Ordered statistics decoding has been instrumental in addressing decoding failures that persist after normalized min-sum decoding in short low-density parity-check codes. Despite its benefits, the high computational complexity of effective…

Information Theory · Computer Science 2025-06-23 Guangwen Li , Xiao Yu

This paper introduces a new approach to cost-effective, high-throughput hardware designs for Low Density Parity Check (LDPC) decoders. The proposed approach, called Non-Surjective Finite Alphabet Iterative Decoders (NS-FAIDs), exploits the…

Signal Processing · Electrical Eng. & Systems 2017-10-02 Thien Truong Nguyen-Ly , Valentin Savin , Khoa Le , David Declercq , Fakhreddine Ghaffari , Oana Boncalo

In this paper, we propose a low latency, robust and scalable neural net based decoder for convolutional and low-density parity-check (LPDC) coding schemes. The proposed decoders are demonstrated to have bit error rate (BER) and block error…

Signal Processing · Electrical Eng. & Systems 2019-08-21 Kumar Yashashwi , Deepak Anand , Sibi Raj B Pillai , Prasanna Chaporkar , K Ganesh

Min-Sum (MS) decoding is a popular low-complexity alternative to belief propagation (BP), retaining only the minimum incoming message magnitude during check-node (CN) processing, at the cost of systematic message magnitude overestimation.…

Information Theory · Computer Science 2026-05-12 Hernan Cordova , Alexios Balatsoukas-Stimming , Yunus Can Gültekin , Gabriele Liga , Alex Alvarado

The min-sum (MS) algorithm is arguably the second most fundamental algorithm in the realm of message passing due to its optimality (for a tree code) with respect to the {\em block error} probability \cite{Wiberg}. There also seems to be a…

Information Theory · Computer Science 2007-07-13 Kapil Bhattad , Vishwambhar Rathi , Ruediger Urbanke

The training complexity of deep learning-based channel decoders scales exponentially with the codebook size and therefore with the number of information bits. Thus, neural network decoding (NND) is currently only feasible for very short…

Information Theory · Computer Science 2017-02-23 Sebastian Cammerer , Tobias Gruber , Jakob Hoydis , Stephan ten Brink

Applying the max-product (and belief-propagation) algorithms to loopy graphs is now quite popular for best assignment problems. This is largely due to their low computational complexity and impressive performance in practice. Still, there…

Information Theory · Computer Science 2011-07-19 Yung-Yih Jian , Henry D. Pfister

Neural networks are trained by choosing an architecture and training the parameters. The choice of architecture is often by trial and error or with Neural Architecture Search (NAS) methods. While NAS provides some automation, it often…

Machine Learning · Computer Science 2024-10-14 Zitong Huang , Mansooreh Montazerin , Ajitesh Srivastava

Rank minimization methods have attracted considerable interest in various areas, such as computer vision and machine learning. The most representative work is nuclear norm minimization (NNM), which can recover the matrix rank exactly under…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Zhiyuan Zha , Xin Yuan , Bei Li , Xinggan Zhang , Xin Liu , Lan Tang , Ying-Chang Liang

Errors in surface code have typically been decoded by Minimum Weight Perfect Matching (MWPM) based method. Recently, neural-network-based Machine Learning (ML) techniques have been employed for this purpose. Here we propose a two-level (low…