English
Related papers

Related papers: Bitwise Over-Parameterized Neural Polar Decoding: …

200 papers

Recent theoretical work has established connections between over-parametrized neural networks and linearized models governed by he Neural Tangent Kernels (NTKs). NTK theory leads to concrete convergence and generalization results, yet the…

Machine Learning · Computer Science 2020-02-18 Yu Bai , Jason D. Lee

Channel estimation is crucial in wireless communications. However, in many papers neural networks are frequently tested by training and testing on one example channel or similar channels. This is because data-driven methods often degrade on…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Dianxin Luan , John Thompson

Polar codes are the latest breakthrough in coding theory, as they are the first family of codes with explicit construction that provably achieve the symmetric capacity of discrete memoryless channels. Ar{\i}kan's polar encoder and…

Information Theory · Computer Science 2017-03-01 Mostafa El-Khamy , Hessam Mahdavifar , Gennady Feygin , Jungwon Lee , Inyup Kang

Speech coding facilitates the transmission of speech over low-bandwidth networks with minimal distortion. Neural-network based speech codecs have recently demonstrated significant improvements in quality over traditional approaches. While…

Sound · Computer Science 2022-07-07 Ali Siahkoohi , Michael Chinen , Tom Denton , W. Bastiaan Kleijn , Jan Skoglund

It is shown how to combine ordered statistics decoding (OSD) with CRC-aided belief propagation list (CBPL) decoding of polar codes. Even when the reprocessing order of the OSD is as low as one, the new decoder is shown to significantly…

Information Theory · Computer Science 2021-02-17 Guy Mogilevsky , David Burshtein

In response to the increasing number of devices expected in next-generation networks, a shift to over-the-air (OTA) computing has been proposed. By leveraging the superposition of multiple access channels, OTA computing enables efficient…

Neural-network decoders can achieve a lower logical error rate compared to conventional decoders, like minimum-weight perfect matching, when decoding the surface code. Furthermore, these decoders require no prior information about the…

Quantum Physics · Physics 2025-07-30 Boris M. Varbanov , Marc Serra-Peralta , David Byfield , Barbara M. Terhal

We consider the decoding of bit interleaved coded modulation (BICM) applied to multiband OFDM for practical scenarios where only a noisy (possibly very bad) estimate of the channel is available at the receiver. First, a decoding metric…

Networking and Internet Architecture · Computer Science 2007-08-13 Sajad Sadough , Pablo Piantanida , Pierre Duhamel

We study the training dynamics of a shallow neural network with quadratic activation functions and quadratic cost in a teacher-student setup. In line with previous works on the same neural architecture, the optimization is performed…

Optimization and Control · Mathematics 2023-11-08 Simon Martin , Francis Bach , Giulio Biroli

Binary memristive crossbars have gained huge attention as an energy-efficient deep learning hardware accelerator. Nonetheless, they suffer from various noises due to the analog nature of the crossbars. To overcome such limitations, most…

Neural and Evolutionary Computing · Computer Science 2022-01-06 Youngeun Kim , Hyunsoo Kim , Seijoon Kim , Sang Joon Kim , Priyadarshini Panda

Polar coding over a class of binary discrete memoryless channels with channel knowledge at the encoder is studied. It is shown that polar codes achieve the capacity of convex and one-sided classes of symmetric channels.

Information Theory · Computer Science 2013-12-02 Mine Alsan

This paper provides a statistical characterization of the individual achievable rates in bits/s/Hz and the spatial throughput of bipolar Poisson wireless networks in bits/s/Hz/m$^2$. We assume that all transmitters have a cognitive ability…

Information Theory · Computer Science 2014-04-29 Pedro H. J. Nardelli , Carlos H. Morais de Lima , Hirley Alves , Paulo Cardieri , Matti Latva-aho

Belief propagation (BP) is an iterative decoding algorithm for polar codes which can be parallelized effectively to achieve higher throughput. However, because of the presence of error floor due to cycles and stopping sets in the factor…

Information Theory · Computer Science 2020-03-05 Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-aho

In this paper, we present the first study that compares different models of Bayesian Neural Networks (BNNs) to predict the posterior distribution of the cosmological parameters directly from the Cosmic Microwave Background temperature and…

Instrumentation and Methods for Astrophysics · Physics 2020-11-13 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malagò

We present a novel distributed computing framework that is robust to slow compute nodes, and is capable of both approximate and exact computation of linear operations. The proposed mechanism integrates the concepts of randomized sketching…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Burak Bartan , Mert Pilanci

In the short block length regime, pre-transformed polar codes together with successive cancellation list (SCL) decoding possess excellent error correction capabilities. However, in practice, the list size is limited due to the suboptimal…

Information Theory · Computer Science 2025-04-25 Henning Lulei , Jonathan Mandelbaum , Marvin Rübenacke , Holger Jäkel , Stephan ten Brink , Laurent Schmalen

With the evolution from 5G to 6G, ultra-reliable low-latency communication (URLLC) faces increasingly stringent performance requirements. Lower latency constraints demand shorter channel coding lengths, which can severely degrade decoding…

Information Theory · Computer Science 2025-08-07 Yaqi Li , Xiaohu You , Jiamin Li , Chen Ji , Bin Sheng

We consider gradient-based optimisation of wide, shallow neural networks, where the output of each hidden node is scaled by a positive parameter. The scaling parameters are non-identical, differing from the classical Neural Tangent Kernel…

Machine Learning · Statistics 2025-02-19 Francois Caron , Fadhel Ayed , Paul Jung , Hoil Lee , Juho Lee , Hongseok Yang

In this paper, we present an optimal metric function on average, which leads to a significantly low decoding computation while maintaining the superiority of the polarization-adjusted convolutional (PAC) codes' error-correction performance.…

Information Theory · Computer Science 2020-12-11 Mohsen Moradi

A new algorithm for efficient exact maximum likelihood decoding of polar codes (which may be CRC augmented), transmitted over the binary erasure channel, is presented. The algorithm applies a matrix triangulation process on a sparse polar…

Information Theory · Computer Science 2021-06-29 Yonatan Urman , David Burshtein