English
Related papers

Related papers: A Neural Network Lattice Decoding Algorithm

200 papers

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such…

Machine Learning · Computer Science 2017-11-15 Brandon Reagen , Udit Gupta , Robert Adolf , Michael M. Mitzenmacher , Alexander M. Rush , Gu-Yeon Wei , David Brooks

The rapidly improving performance of modern hardware renders convolutional codes obsolete, and allows for the practical implementation of more sophisticated correction codes such as low density parity check (LDPC) and turbo codes (TC). Both…

Information Theory · Computer Science 2015-03-20 Jarosław Duda , Paweł Korus

When a neural network (NN) is used to decode a polar code, its training complexity scales exponentially as the code block size (or to be precise, as a number of message bits) increases. Therefore, existing solutions that use a neural…

Information Theory · Computer Science 2022-11-10 Evgeny Stupachenko

Spiking neural networks (SNNs) are neural networks that enable energy-efficient signal processing due to their event-based nature. This paper proposes a novel decoding algorithm for low-density parity-check (LDPC) codes that integrates SNNs…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Alexander von Bank , Eike-Manuel Edelmann , Sisi Miao , Jonathan Mandelbaum , Laurent Schmalen

Achieving high image quality is an important aspect in an increasing number of wireless multimedia applications. These applications require resource efficient error correction hardware to detect and correct errors introduced by the…

Information Theory · Computer Science 2013-08-02 Vikram Arkalgud Chandrasetty , Syed Mahfuzul Aziz

This paper presents a new learning algorithm, termed Deep Bi-directional Predictive Coding (DBPC) that allows developing networks to simultaneously perform classification and reconstruction tasks using the same weights. Predictive Coding…

Machine Learning · Computer Science 2023-05-31 Senhui Qiu , Saugat Bhattacharyya , Damien Coyle , Shirin Dora

In this paper, a construction of constant weight codes based on the unique decomposition of elements in lattices is presented. The conditions for unique primary decomposition and unique irreducible decomposition in lattices are discussed…

Information Theory · Computer Science 2013-04-30 Anirban Ghatak

Recent developments have shown the existence of quantum low-density parity check (qLDPC) codes with constant rate and linear distance. A natural question concerns the efficient decodability of these codes. In this paper, we present a linear…

Quantum Physics · Physics 2022-06-15 Shouzhen Gu , Christopher A. Pattison , Eugene Tang

This paper studies coding schemes for the $q$-ary symmetric channel based on binary low-density parity-check (LDPC) codes that work for any alphabet size $q=2^m$, $m\in\mathbb{N}$, thus complementing some recently proposed packet-based…

Information Theory · Computer Science 2015-03-13 Claudio Weidmann , Gottfried Lechner

A novel method guaranteeing nondecreasing girth is presented for constructing longer low-density parity-check (LDPC) codes from shorter ones. The parity-check matrix of a shorter base code is decomposed into N (N>=2) non-overlapping…

Information Theory · Computer Science 2018-01-29 Guohua Zhang , Yulin Hu , Qinwei He

Due to the ability to provide superior error-correction performance, the successive cancellation list (SCL) algorithm is widely regarded as one of the most promising decoding algorithms for polar codes with short-to-moderate code lengths.…

Information Theory · Computer Science 2023-11-15 Yang Lu , Ming-Min Zhao , Ming Lei , Min-Jian Zhao

An algorithm for constructing parity-check matrices of non-binary quasi-cyclic low-density parity-check (NB QC-LDPC) codes is proposed. The algorithm finds short cycles in the base matrix and tries to eliminate them by selecting the…

Information Theory · Computer Science 2017-05-31 Stanislav Kruglik , Valeriya Potapova , Alexey Frolov

Predicting protein secondary structure using lattice model is one of the most studied computational problem in bioinformatics. Here secondary structure or three dimensional structure of protein is predicted from its amino acid sequence.…

Computational Engineering, Finance, and Science · Computer Science 2014-07-18 Dipan Lal Shaw , M. Sohel Rahman , A. S. M. Sohidull Islam , Shuvasish Karmaker

Recent learning-based lossless image compression methods encode an image in the unit of subimages and achieve comparable performances to conventional non-learning algorithms. However, these methods do not consider the performance drop in…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Hochang Rhee , Yeong Il Jang , Seyun Kim , Nam Ik Cho

Compressing DNNs is important for the real-world applications operating on resource-constrained devices. However, we typically observe drastic performance deterioration when changing model size after training is completed. Therefore,…

Machine Learning · Computer Science 2021-09-30 Atsushi Yaguchi , Taiji Suzuki , Shuhei Nitta , Yukinobu Sakata , Akiyuki Tanizawa

The computation and memory costs of large language models kept increasing over last decade, which reached over the scale of 1T parameters. To address the challenges from the large scale models, model compression techniques such as low-rank…

Hardware Architecture · Computer Science 2025-10-16 Faraz Tahmasebi , Michael Pelluer , Hyoukjun Kwon

In this paper, we introduce a novel class of pre-transformed polar codes, termed as deep polar codes. We first present a deep polar encoder that harnesses a series of multi-layered polar transformations with varying sizes. Our approach to…

Information Theory · Computer Science 2023-08-08 Geon Choi , Namyoon Lee

In this paper, we propose a linear complexity encoding method for arbitrary LDPC codes. We start from a simple graph-based encoding method ``label-and-decide.'' We prove that the ``label-and-decide'' method is applicable to Tanner graphs…

Information Theory · Computer Science 2016-11-18 Jin Lu , José M. F. Moura

We consider generalized low-density parity-check (GLDPC) codes with component codes that are duals of Cordaro-Wagner codes. Two efficient decoding algorithms are proposed: one based on Hartmann-Rudolph processing, analogous to Sum-Product…

Information Theory · Computer Science 2025-05-14 Dawit Simegn , Dmitry Artemasov , Kirill Andreev , Pavel Rybin , Alexey Frolov

Much progress has been made on decoding algorithms for error-correcting codes in the last decade. In this article, we give an introduction to some fundamental results on iterative, message-passing algorithms for low-density parity check…

Information Theory · Computer Science 2007-07-16 Venkatesan Guruswami