English
Related papers

Related papers: LEARN Codes: Inventing Low-latency Codes via Recur…

200 papers

Channel coding plays a pivotal role in ensuring reliable communication over wireless channels. With the growing need for ultra-reliable communication in emerging wireless use cases, the significance of channel coding has amplified.…

Information Theory · Computer Science 2024-05-14 Mohammad Rowshan , Min Qiu , Yixuan Xie , Xinyi Gu , Jinhong Yuan

Deep learning methods have recently been used to construct non-linear codes for the additive white Gaussian noise (AWGN) channel with feedback. However, there is limited understanding of how these black-box-like codes with many learned…

Information Theory · Computer Science 2024-06-06 Yingyao Zhou , Natasha Devroye , Gyorgy Turan , Milos Zefran

We focus on designing error-correcting codes for the symmetric Gaussian broadcast channel with feedback. Feedback not only expands the capacity region of the broadcast channel but also enhances transmission reliability. In this work, we…

Information Theory · Computer Science 2025-03-04 Yingyao Zhou , Natasha Devroye

Code generation maps a program description to executable source code in a programming language. Existing approaches mainly rely on a recurrent neural network (RNN) as the decoder. However, we find that a program contains significantly more…

Machine Learning · Computer Science 2018-11-19 Zeyu Sun , Qihao Zhu , Lili Mou , Yingfei Xiong , Ge Li , Lu Zhang

To advance Polar code design for 6G applications, we develop a reinforcement learning-based universal sequence design framework that is extensible and adaptable to diverse channel conditions and decoding strategies. Crucially, our method…

Machine Learning · Computer Science 2026-01-29 David Kin Wai Ho , Arman Fazeli , Mohamad M. Mansour , Louay M. A. Jalloul

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Neural networks (NNs) struggle to efficiently solve certain problems, such as learning parities, even when there are simple learning algorithms for those problems. Can NNs discover learning algorithms on their own? We exhibit a NN…

Machine Learning · Computer Science 2023-01-18 Surbhi Goel , Sham Kakade , Adam Tauman Kalai , Cyril Zhang

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

Luby Transform (LT) codes are a class of fountain codes that have proved to perform very efficiently over the erasure channel. These codes are rateless in the sense that an infinite stream of encoded symbols can be generated on the fly.…

Signal Processing · Electrical Eng. & Systems 2020-02-21 M. Usman , J. Dunlop

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

We put forth new models for universal channel coding. Unlike standard codes which are designed for a specific type of channel, our most general universal code makes communication resilient on every channel, provided the noise level is below…

Information Theory · Computer Science 2022-12-12 Bruno Bauwens , Marius Zimand

Error correction techniques traditionally focus on the co-design of restricted code-structures in tandem with code-specific decoders that are computationally efficient when decoding long codes in hardware. Modern applications are, however,…

Information Theory · Computer Science 2022-10-12 Ken R. Duffy , Wei An , Muriel Medard

Channel estimation is crucial in wireless communications. However, in many papers neural networks are frequently tested by training and testing on one example channel or similar channels. This is because data-driven methods often degrade on…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Dianxin Luan , John Thompson

Many approaches to transform classification problems from non-linear to linear by feature transformation have been recently presented in the literature. These notably include sparse coding methods and deep neural networks. However, many of…

Machine Learning · Computer Science 2015-07-08 Alessandro Montalto , Giovanni Tessitore , Roberto Prevete

Progress in designing channel codes has been driven by human ingenuity and, fittingly, has been sporadic. Polar codes, developed on the foundation of Arikan's polarization kernel, represent the latest breakthrough in coding theory and have…

Information Theory · Computer Science 2024-06-06 S Ashwin Hebbar , Sravan Kumar Ankireddy , Hyeji Kim , Sewoong Oh , Pramod Viswanath

Convolutional neural networks (CNNs) have achieved great success on grid-like data such as images, but face tremendous challenges in learning from more generic data such as graphs. In CNNs, the trainable local filters enable the automatic…

Machine Learning · Computer Science 2018-09-05 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

This paper reviews the potential channel decoding techniques for ultra-reliable low-latency communications (URLLC). URLLC is renowned for its stringent requirements including ultra-reliability, low end-to-end transmission latency, and…

Information Theory · Computer Science 2022-12-26 Chentao Yue , Vera Miloslavskaya , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

As deep learning models scale, their training cost has surged significantly. Due to both hardware advancements and limitations in current software stacks, the need for data efficiency has risen. Data efficiency refers to the effective…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-09 Kun Wu

Future beyond-5G and 6G systems demand ultra-reliable, low-latency communication with short blocklengths, motivating the development of universal decoding algorithms. Guessing decoding, which infers the noise or codeword candidate in order…

Information Theory · Computer Science 2025-11-24 Qianfan Wang , Jifan Liang , Peihong Yuan , Ken R. Duffy , Muriel Médard , Xiao Ma

Coded recurrent neural networks with three levels of sparsity are introduced. The first level is related to the size of messages, much smaller than the number of available neurons. The second one is provided by a particular coding rule,…

Machine Learning · Computer Science 2011-02-22 Vincent Gripon , Claude Berrou