English
Related papers

Related papers: Cyclically Equivariant Neural Decoders for Cyclic …

200 papers

Neural network decoding algorithms are recently introduced by Nachmani et al. to decode high-density parity-check (HDPC) codes. In contrast with iterative decoding algorithms such as sum-product or min-sum algorithms in which the weight of…

Information Theory · Computer Science 2018-09-14 Mohammad-Reza Sadeghi , Farzane Amirzade , Daniel Panario , Amin Sakzad

Deep neural networks perform well on classification tasks where data streams are i.i.d. and labeled data is abundant. Challenges emerge with non-stationary training data streams such as continual learning. One powerful approach that has…

Practically good error-correcting codes should have good parameters and efficient decoding algorithms. Some algebraically defined good codes such as cyclic codes, Reed-Solomon codes, and Reed-Muller codes have nice decoding algorithms.…

Information Theory · Computer Science 2019-11-19 Lucky Galvez , Jon-Lark Kim

In this article we see quasi-cyclic codes as block cyclic codes. We generalize some properties of cyclic codes to quasi-cyclic ones such as generator polynomials and ideals. Indeed we show a one-to-one correspondence between l-quasi-cyclic…

Information Theory · Computer Science 2012-05-30 Morgan Barbier , Christophe Chabot , Guillaume Quintin

Most previous work on neural text generation from graph-structured data relies on standard sequence-to-sequence methods. These approaches linearise the input graph to be fed to a recurrent neural network. In this paper, we propose an…

Computation and Language · Computer Science 2018-10-24 Diego Marcheggiani , Laura Perez-Beltrachini

We present a novel iterative decoding algorithm for Reed-Muller (RM) codes, which takes advantage of a graph representation of the code. Vertices of the considered graph correspond to codewords, with two vertices being connected by an edge…

Information Theory · Computer Science 2022-07-20 Mikhail Kamenev

Two new classes of skew codes over a finite field $\F$ are proposed, called skew convolutional codes and skew trellis codes. These two classes are defined by, respectively, left or right sub-modules over the skew fields of fractions of skew…

Information Theory · Computer Science 2021-02-03 Vladimir Sidorenko , Wenhui Li , Onur Günlü , Gerhard Kramer

Motivated by the need to communicate short control messages in 5G and beyond, this paper carefully designs codes for cyclic redundancy check (CRC)-aided list decoding of tail-biting convolutional codes (TBCCs) and polar codes. Both codes…

Information Theory · Computer Science 2023-02-16 Jacob King , Hanwen Yao , William Ryan , Richard D. Wesel

Sequential decoding, commonly applied to substitution channels, is a sub-optimal alternative to Viterbi decoding with significantly reduced memory costs. In this work, a sequential decoder for convolutional codes over channels that are…

Information Theory · Computer Science 2026-04-02 Anisha Banerjee , Andreas Lenz , Antonia Wachter-Zeh

A complexity-adaptive tree search algorithm is proposed for $\boldsymbol{G}_N$-coset codes that implements maximum-likelihood (ML) decoding by using a successive decoding schedule. The average complexity is close to that of the successive…

Information Theory · Computer Science 2021-09-03 Peihong Yuan , Mustafa Cemil Coşkun

Why do neurons encode information the way they do? Normative answers to this question model neural activity as the solution to an optimisation problem; for example, the celebrated efficient coding hypothesis frames neural activity as the…

Neurons and Cognition · Quantitative Biology 2026-03-06 William Dorrell , Peter E. Latham , James Whittington

Successive-cancellation list (SCL) decoding of polar codes has been adopted for 5G. However, the performance is not very satisfactory with moderate code length. Heuristic or deep-learning-aided (DL-aided) flip algorithms have been developed…

Information Theory · Computer Science 2021-06-25 Yaoyu Tao , Zhengya Zhang

A modified successive cancellation list (SCL) decoder is proposed for polar-coded probabilistic shaping. The decoder exploits the deterministic encoding rule for shaping bits to rule out candidate code words that the encoder would not…

Information Theory · Computer Science 2023-10-25 Constantin Runge , Thomas Wiegart , Diego Lentner

With the advent of noisy intermediate-scale quantum (NISQ) devices, practical quantum computing has seemingly come into reach. However, to go beyond proof-of-principle calculations, the current processing architectures will need to scale up…

Quantum Physics · Physics 2022-02-25 Kai Meinerz , Chae-Yeun Park , Simon Trebst

In training deep learning networks, the optimizer and related learning rate are often used without much thought or with minimal tuning, even though it is crucial in ensuring a fast convergence to a good quality minimum of the loss function…

Machine Learning · Computer Science 2020-04-07 Choon Meng Lee , Jianfeng Liu , Wei Peng

Networks of neurons in the brain encode preferred patterns of neural activity via their synaptic connections. Despite receiving considerable attention, the precise relationship between network connectivity and encoded patterns is still…

Neurons and Cognition · Quantitative Biology 2015-02-25 Carina Curto , Anda Degeratu , Vladimir Itskov

A deep-learning-aided successive-cancellation list (DL-SCL) decoding algorithm for polar codes is introduced with deep-learning-aided successive-cancellation (DL-SC) decoding being a specific case of it. The DL-SCL decoder works by allowing…

Information Theory · Computer Science 2019-12-04 Seyyed Ali Hashemi , Nghia Doan , Thibaud Tonnellier , Warren J. Gross

We propose a new family of polar coding which realizes high coding gain, low complexity, and high throughput by introducing a protograph-based design. The proposed technique called as quasi-cyclic (QC) polar codes can be highly parallelized…

Information Theory · Computer Science 2021-02-26 Toshiaki Koike-Akino , Ye Wang

Constrained sequence codes have been widely used in modern communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel, hence enabling efficient and reliable…

Information Theory · Computer Science 2018-09-07 Congzhe Cao , Duanshun Li , Ivan Fair

We study a class of linear network coding (LNC) schemes, called circular-shift LNC, whose encoding operations consist of only circular-shifts and bit-wise additions (XOR). Formulated as a special vector linear code over GF($2$), an…

Information Theory · Computer Science 2019-01-03 Hanqi Tang , Qifu Tyler Sun , Zongpeng Li , Xiaolong Yang , Keping Long