English
Related papers

Related papers: Gradient Flow Decoding

200 papers

Motivated by recently derived fundamental limits on total (transmit + decoding) power for coded communication with VLSI decoders, this paper investigates the scaling behavior of the minimum total power needed to communicate over AWGN…

Information Theory · Computer Science 2018-04-02 Karthik Ganesan , Pulkit Grover , Jan Rabaey , Andrea Goldsmith

MLPGradientFlow is a software package to solve numerically the gradient flow differential equation $\dot \theta = -\nabla \mathcal L(\theta; \mathcal D)$, where $\theta$ are the parameters of a multi-layer perceptron, $\mathcal D$ is some…

Machine Learning · Computer Science 2023-01-26 Johanni Brea , Flavio Martinelli , Berfin Şimşek , Wulfram Gerstner

We provide a rigorous mathematical analysis of two communication strategies: soft decode-and-forward (soft-DF) for relay channels, and soft partial interference-cancelation (soft-IC) for interference channels. Both strategies involve soft…

Information Theory · Computer Science 2016-11-18 Amir Bennatan , Shlomo Shamai , A. Robert Calderbank

The performance of a deep learning model on a specific task and dataset depends heavily on its neural architecture, motivating considerable efforts to rapidly and accurately identify architectures suited to the target task and dataset. To…

Machine Learning · Computer Science 2025-10-22 Sunwoo Kim , Hyunjin Hwang , Kijung Shin

The GPU as a digital signal processing accelerator for cloud RAN is investigated. A new design for a 5G NR low density parity check code decoder running on a GPU is presented. The algorithm is flexibly adaptable to GPU architecture to…

Networking and Internet Architecture · Computer Science 2020-09-14 Jonathan Ling , Paul Cautereels

We consider the design of coding schemes for the wireless two-way relaying channel when there is no channel state information at the transmitter. In the spirit of the compute and forward paradigm, we present a multilevel coding scheme that…

Information Theory · Computer Science 2016-11-17 Brett Hern , Krishna Narayanan

Generalized frequency division multiplexing (GFDM) is considered a non-orthogonal waveform and known to encounter difficulties when using in the spatial multiplexing mode of multiple-input-multiple-output (MIMO) scenario. In this paper, a…

Information Theory · Computer Science 2024-10-30 Ching-Lun Tai , Borching Su , Cai Jia

In this paper, we investigate the joint design of channel and network coding in bi-directional relaying systems and propose a combined low complexity physical network coding and LDPC decoding scheme. For the same LDPC codes employed at both…

Information Theory · Computer Science 2013-02-21 Kui Xu , Zhenxing Lv , Youyun Xu , Dongmei Zhang , Xinyi Zhong , Wenwen Liang

In this work, we propose the integration of GLDPC codes with short polar-like component codes, termed GLDPC codes with polar component codes (GLDPC-PC). This approach leverages the good distance properties of polar-like codes and mitigates…

Information Theory · Computer Science 2024-05-10 Binghui Shi , Yongpeng Wu , Yin Xu , Xiqi Gao , Xiaohu You , Wenjun Zhang

We discuss the performance of Low-Density-Parity-Check (LDPC) codes decoded by means of Linear Programming (LP) at moderate and large Signal-to-Noise-Ratios (SNR). Utilizing a combination of the previously introduced pseudo-codeword-search…

Information Theory · Computer Science 2007-07-13 Michael Chertkov , Mikhail Stepanov

We show in this work that reinforcement learning can be successfully applied to decoding short to moderate length sparse graph-based channel codes. Specifically, we focus on low-density parity check (LDPC) codes, which for example have been…

Information Theory · Computer Science 2020-10-20 Salman Habib , Allison Beemer , Joerg Kliewer

Belief Propagation (BP) decoding of LDPC codes is extended to the case of Joint Source-Channel coding. The uncompressed source is treated as a Markov process, characterized by a transition matrix, T, which is utilized as side information…

Disordered Systems and Neural Networks · Physics 2007-05-23 Haggai Kfir , Eyal Shpilman , Ido Kanter

In this paper, we propose a novel decoding method for Quantum Low-Density Parity-Check (QLDPC) codes based on Graph Neural Networks (GNNs). Similar to the Belief Propagation (BP)-based QLDPC decoders, the proposed GNN-based QLDPC decoder…

Finding latent structures in data is drawing increasing attention in diverse fields such as image and signal processing, fluid dynamics, and machine learning. In this work we examine the problem of finding the main modes of gradient flows.…

Dynamical Systems · Mathematics 2020-12-29 Ido Cohen , Omri Azencot , Pavel Lifshitz , Guy Gilboa

Efficient deep learning traditionally relies on static heuristics like weight magnitude or activation awareness (e.g., Wanda, RIA). While successful in unstructured settings, we observe a critical limitation when applying these metrics to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Tianhao Qian , Zhuoxuan Li , Jinde Cao , Xinli Shi , Leszek Rutkowski

We propose a novel optimization-based decoding algorithm for LDPC-coded massive MIMO channels. The proposed decoding algorithm is based on a proximal gradient method for solving an approximate maximum a posteriori (MAP) decoding problem.…

Information Theory · Computer Science 2021-02-11 Tadashi Wadayama , Satoshi Takabe

Deep learning based decoding networks have shown significant improvement in decoding LDPC codes, but the neural decoders are limited by rate-matching operations such as puncturing or extending, thus needing to train multiple decoders with…

Signal Processing · Electrical Eng. & Systems 2023-10-11 Yukun Cheng , Wei Chen , Lun Li , Bo Ai

In distributed computing, slower nodes (stragglers) usually become a bottleneck. Gradient Coding (GC), introduced by Tandon et al., is an efficient technique that uses principles of error-correcting codes to distribute gradient computation…

Machine Learning · Computer Science 2023-06-29 M. Nikhil Krishnan , MohammadReza Ebrahimi , Ashish Khisti

The interpolation-based decoding that was developed for general evaluation AG codes is shown to be equally applicable to general differential AG codes. A performance analysis of the decoding algorithm, which is parallel to that of its…

Information Theory · Computer Science 2014-07-23 Kwankyu Lee

We propose the application of multiple-bases belief-propagation, an optimized iterative decoding method, to a set of rate-1/2 LDPC codes from the IEEE 802.16e WiMAX standard. The presented approach allows for improved decoding performance…

Information Theory · Computer Science 2008-09-09 Thorsten Hehn , Johannes B. Huber , Stefan Laendner