English
Related papers

Related papers: Learned Belief-Propagation Decoding with Simple Sc…

200 papers

We present the tree-structure expectation propagation (Tree-EP) algorithm to decode low-density parity-check (LDPC) codes over discrete memoryless channels (DMCs). EP generalizes belief propagation (BP) in two ways. First, it can be used…

Information Theory · Computer Science 2015-03-19 Pablo M. Olmos , Juan José Murillo-Fuentes , Fernando Pérez-Cruz

Speech dereverberation aims to alleviate the negative impact of late reverberant reflections. The weighted prediction error (WPE) method is a well-established technique known for its superior performance in dereverberation. However, in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-07 Ziye Yang , Mengfei Zhang , Jie Chen

In the context of inference with expectation constraints, we propose an approach based on the "loopy belief propagation" algorithm LBP, as a surrogate to an exact Markov Random Field MRF modelling. A prior information composed of…

Machine Learning · Computer Science 2015-05-13 Cyril Furtlehner , Jean-Marc Lasgouttes , Anne Auger

Max-product Belief Propagation (BP) is a popular message-passing algorithm for computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented by a Graphical Model (GM). It has been shown that BP can solve a number of…

Data Structures and Algorithms · Computer Science 2015-09-24 Sungsoo Ahn , Sejun Park , Michael Chertkov , Jinwoo Shin

Decoding sparse quantum codes can be accomplished by syndrome-based decoding using a belief propagation (BP) algorithm.We significantly improve this decoding scheme by developing a new feedback adjustment strategy for the standard BP…

Quantum Physics · Physics 2013-09-25 Yun-Jiang Wang , Barry C. Sanders , Bao-Ming Bai , Xin-Mei Wang

The recent development of deep learning methods provides a new approach to optimize the belief propagation (BP) decoding of linear codes. However, the limitation of existing works is that the scale of neural networks increases rapidly with…

Information Theory · Computer Science 2021-02-11 Jincheng Dai , Kailin Tan , Zhongwei Si , Kai Niu , Mingzhe Chen , H. Vincent Poor , Shuguang Cui

Short survey about code on the graph by example of hardware friendly quasi-cycle LDPC code. We consider two main properties of code: weight enumerator (well known from classic code theory) and Trapping sets pseudocodewords weight spectrum…

Information Theory · Computer Science 2015-11-25 Vasiliy Usatyuk

In this work, we investigate the fundamental trade-off regarding accuracy and parameter efficiency in the parameterization of neural network weights using predictor networks. We present a surprising finding that, when recovering the…

Machine Learning · Computer Science 2024-07-02 Hongjun Choi , Jayaraman J. Thiagarajan , Ruben Glatt , Shusen Liu

In this work, we analyze efficient window shift schemes for windowed decoding of spatially coupled low-density parity-check (SC-LDPC) codes, which is known to yield close-tooptimal decoding results when compared to full belief propagation…

Information Theory · Computer Science 2018-10-03 Kevin Klaiber , Sebastian Cammerer , Laurent Schmalen , Stephan ten Brink

Finding human-understandable circuits in language models is a central goal of the field of mechanistic interpretability. We train models to have more understandable circuits by constraining most of their weights to be zeros, so that each…

Machine Learning · Computer Science 2025-11-18 Leo Gao , Achyuta Rajaram , Jacob Coxon , Soham V. Govande , Bowen Baker , Dan Mossing

Belief-propagation (BP) decoding for quantum low-density parity-check (QLDPC) codes is appealing due to its low complexity, yet it often exhibits convergence issues due to quantum degeneracy and short cycles that exist in the Tanner graph.…

Information Theory · Computer Science 2026-03-12 Mohsen Moradi , Vahid Nourozi , Salman Habib , David G. M. Mitchell

Interfering sources, background noise and reverberation degrade speech quality and intelligibility in hearing aid applications. In this paper, we present an adaptive algorithm aiming at dereverberation, noise and interferer reduction and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Henri Gode , Simon Doclo

Deep neural network models have a complex architecture and are overparameterized. The number of parameters is more than the whole dataset, which is highly resource-consuming. This complicates their application and limits its usage on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Vasiliy Alekseev , Ilya Lukashevich , Ilia Zharikov , Ilya Vasiliev

Many different deep networks have been used to approximate, accelerate or improve traditional image operators. Among these traditional operators, many contain parameters which need to be tweaked to obtain the satisfactory results, which we…

Computer Vision and Pattern Recognition · Computer Science 2019-07-15 Qingnan Fan , Dongdong Chen , Lu Yuan , Gang Hua , Nenghai Yu , Baoquan Chen

Diffusion-weighted magnetic resonance imaging in brain white matter probes tissue microstructure and allows for the estimation of compartmental diffusion parameters. Recently, it became apparent that traditional single-direction diffusion…

Biological Physics · Physics 2018-09-20 Marco Reisert , Valerij G. Kiselev , Bibek Dhital

In this paper, we propose a belief-propagation (BP)-based decoder, termed the Multiple-Bases Belief-Propagation List Decoder (MBBP-LD), for quantum low-density parity-check (QLDPC) codes. The key idea is to generate \emph{structured…

Information Theory · Computer Science 2026-05-15 Sheida Rabeti , Hessam Mahdavifar

A new method for low-complexity near-maximum-likelihood (ML) decoding of low-density parity-check (LDPC) codes over the additive white Gaussian noise channel is presented. The proposed method termed belief-propagation--list erasure decoding…

Information Theory · Computer Science 2017-05-29 Irina E. Bocharova , Boris D. Kudryashov , Vitaly Skachek , Yauhen Yakimenka

Spiking neural networks (SNNs) are neural networks that enable energy-efficient signal processing due to their event-based nature. This paper proposes a novel decoding algorithm for low-density parity-check (LDPC) codes that integrates SNNs…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Alexander von Bank , Eike-Manuel Edelmann , Sisi Miao , Jonathan Mandelbaum , Laurent Schmalen

Limited precision of synaptic weights is a key aspect of both biological and hardware implementation of neural networks. To assign low-precise weights during learning is a non-trivial task, but may benefit from representing to-be-learned…

Disordered Systems and Neural Networks · Physics 2020-07-13 Zedong Bi , Changsong Zhou

Neural Normalized MinSum (N-NMS) decoding delivers better frame error rate (FER) performance on linear block codes than conventional normalized MinSum (NMS) by assigning dynamic multiplicative weights to each check-to-variable message in…

Information Theory · Computer Science 2021-07-12 Linfang Wang , Sean Chen , Jonathan Nguyen , Divsalar Dariush , Richard Wesel