English
Related papers

Related papers: Gradient Flow Decoding

200 papers

Channel Coding has been one of the central disciplines driving the success stories of current generation LTE systems and beyond. In particular, turbo codes are mostly used for cellular and other applications where a reliable data transfer…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Raja Sattiraju , Andreas Weinand , Hans D. Schotten

We propose a new class of efficient decoding algorithms for Reed-Muller (RM) codes over binary-input memoryless channels. The algorithms are based on projecting the code on its cosets, recursively decoding the projected codes (which are…

Information Theory · Computer Science 2020-02-27 Min Ye , Emmanuel Abbe

Guessing random additive noise decoding (GRAND) is a noise-centric decoding method, which is suitable for ultra-reliable low-latency communications, as it supports high-rate error correction codes that generate short-length codewords. GRAND…

Information Theory · Computer Science 2022-12-12 Ioannis Chatzigeorgiou , Francisco A. Monteiro

This paper introduces feature gradient flow, a new technique for interpreting deep learning models in terms of features that are understandable to humans. The gradient flow of a model locally defines nonlinear coordinates in the input data…

Image and Video Processing · Electrical Eng. & Systems 2023-07-26 Yinzhu Jin , Jonathan C. Garneau , P. Thomas Fletcher

We address in this paper decoding aspects of the Compute-and-Forward (CF) physical-layer network coding strategy. It is known that the original decoder for the CF is asymptotically optimal. However, its performance gap to optimal decoders…

Information Theory · Computer Science 2014-04-18 Asma Mejri , Ghaya Rekaya-Ben Othman

Narrowing the performance gap between optimal and feasible detection in inter-symbol interference (ISI) channels, this paper proposes to use graph neural networks (GNNs) for detection that can also be used to perform joint detection and…

Information Theory · Computer Science 2025-07-16 Jannis Clausius , Marvin Rübenacke , Daniel Tandler , Stephan ten Brink

In this paper, we consider joint network and LDPC coding for practically implementing the denosie-and-forward protocol over bi-directional relaying. the closed-form expressions for computing the log-likelihood ratios of the network-coded…

Information Theory · Computer Science 2011-05-13 Xiaofu Wu , Weijun Zeng , Chunming Zhao , Xiaohu You

We propose a technique to design finite-length irregular low-density parity-check (LDPC) codes over the binary-input additive white Gaussian noise (AWGN) channel with good performance in both the waterfall and the error floor region. The…

Information Theory · Computer Science 2016-11-17 Reza Asvadi , Amir H. Banihashemi , Mahmoud Ahmadian-Attari

To address the challenges of wireless video transmission over multipath fading channels, we propose a robust deep joint source-channel coding (DeepJSCC) framework by effectively exploiting temporal redundancy and incorporating robust…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Bohuai Xiao , Jian Zou , Fanyang Meng , Wei Liu , Yongsheng Liang

Quantum low-density parity-check (LDPC) codes are a promising family of quantum error-correcting codes for fault tolerant quantum computing with low overhead. Decoding quantum LDPC codes on quantum erasure channels has received more…

Information Theory · Computer Science 2024-11-20 Mert Gökduman , Hanwen Yao , Henry D. Pfister

In this paper, we study the performance of finite-length LDPC codes in the waterfall region. We propose an algorithm to predict the error performance of finite-length LDPC codes over various binary memoryless channels. Through numerical…

Information Theory · Computer Science 2013-09-30 Md. Noor-A-Rahim , Khoa D. Nguyen , Gottfried Lechner

Scalable coding, which can adapt to channel bandwidth variation, performs well in today's complex network environment. However, most existing scalable compression methods face two challenges: reduced compression performance and insufficient…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Yongqi Zhai , Yi Ma , Luyang Tang , Wei Jiang , Ronggang Wang

Guessing Random Additive Noise Decoding (GRAND) is a family of hard- and soft-detection error correction decoding algorithms that provide accurate decoding of any moderate redundancy code of any length. Here we establish a method through…

Information Theory · Computer Science 2023-08-11 Kevin Galligan , Peihong Yuan , Muriel Médard , Ken R. Duffy

For a multiple-input multiple-output (MIMO) system with unknown channel state information (CSI), a novel low-density parity check (LDPC)-coded transmission (LCT) scheme with joint pilot and data channel estimation is proposed. To fine-tune…

Information Theory · Computer Science 2023-11-14 Binghui Shi , Yongpeng Wu , Peihong Yuan , Derrick Wing Kwan Ng , Xiang-Gen Xia , Wenjun Zhang

In distributed optimization problems, a technique called gradient coding, which involves replicating data points, has been used to mitigate the effect of straggling machines. Recent work has studied approximate gradient coding, which…

Machine Learning · Statistics 2021-08-09 Margalit Glasgow , Mary Wootters

We prove that the standard gradient flow in parameter space that underlies many training algorithms in deep learning can be continuously deformed into an adapted gradient flow which yields (constrained) Euclidean gradient flow in output…

Machine Learning · Computer Science 2026-02-02 Thomas Chen , Patrícia Muñoz Ewald

Generative neural network is a new category of neural networks and it has been widely utilized in applications such as content generation, unsupervised learning, segmentation and pose estimation. It typically involves massive…

Machine Learning · Computer Science 2020-04-30 Dawen Xu , Ying Wang , Kaijie Tu , Cheng Liu , Bingsheng He , Lei Zhang

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

The recipe behind the success of deep learning has been the combination of neural networks and gradient-based optimization. Understanding the behavior of gradient descent however, and particularly its instability, has lagged behind its…

Machine Learning · Statistics 2023-09-15 Mihaela Rosca , Yan Wu , Chongli Qin , Benoit Dherin

In this paper, we use reinforcement learning to find effective decoding strategies for binary linear codes. We start by reviewing several iterative decoding algorithms that involve a decision-making process at each step, including…

Information Theory · Computer Science 2019-12-10 Fabrizio Carpi , Christian Häger , Marco Martalò , Riccardo Raheli , Henry D. Pfister