English
Related papers

Related papers: Deep Learning-Based Decoding of Linear Block Codes…

200 papers

The min-sum (MS) algorithm is arguably the second most fundamental algorithm in the realm of message passing due to its optimality (for a tree code) with respect to the {\em block error} probability \cite{Wiberg}. There also seems to be a…

Information Theory · Computer Science 2007-07-13 Kapil Bhattad , Vishwambhar Rathi , Ruediger Urbanke

Tensor-based modulation (TBM) has been proposed in the context of unsourced random access for massive uplink communication. In this modulation, transmitters encode data as rank-1 tensors, with factors from a discrete vector constellation.…

Information Theory · Computer Science 2021-11-04 Alexis Decurninge , Ingmar Land , Maxime Guillaud

In this paper, we present a sparse neural network decoder (SNND) of polar codes based on belief propagation (BP) and deep learning. At first, the conventional factor graph of polar BP decoding is converted to the bipartite Tanner graph…

Signal Processing · Electrical Eng. & Systems 2018-11-27 Weihong Xu , Xiaohu You , Chuan Zhang , Yair Be'ery

In decoding linear block codes, it was shown that noticeable reliability gains can be achieved by introducing learnable parameters to the Belief Propagation (BP) decoder. Despite the success of these methods, there are two key open…

Information Theory · Computer Science 2023-04-13 Sravan Kumar Ankireddy , Hyeji Kim

Finding efficient decoders for quantum error correcting codes adapted to realistic experimental noise in fault-tolerant devices represents a significant challenge. In this paper we introduce several decoding algorithms complemented by deep…

Quantum Physics · Physics 2018-08-01 Christopher Chamberland , Pooya Ronagh

Spiking neural networks (SNNs) are neural networks that enable energy-efficient signal processing due to their event-based nature. This paper proposes a novel decoding algorithm for low-density parity-check (LDPC) codes that integrates SNNs…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Alexander von Bank , Eike-Manuel Edelmann , Sisi Miao , Jonathan Mandelbaum , Laurent Schmalen

Magnetic Random-Access Memory (MRAM) based p-bit neuromorphic computing devices are garnering increasing interest as a means to compactly and efficiently realize machine learning operations in Restricted Boltzmann Machines (RBMs). When…

Emerging Technologies · Computer Science 2020-02-04 Paul Wood , Hossein Pourmeidani , Ronald F. DeMara

Neuromorphic architectures built with Non-Volatile Memory (NVM) can significantly improve the energy efficiency of machine learning tasks designed with Spiking Neural Networks (SNNs). A major source of voltage drop in a crossbar of these…

Neural and Evolutionary Computing · Computer Science 2020-09-29 Twisha Titirsha , Anup Das

Recent byte-level language models (LMs) match the performance of token-level models without relying on subword vocabularies, yet their utility is limited by slow, byte-by-byte autoregressive generation. We address this bottleneck in the…

Recurrent Neural Networks (RNNs) are powerful sequence modeling tools. However, when dealing with high dimensional inputs, the training of RNNs becomes computational expensive due to the large number of model parameters. This hinders RNNs…

Machine Learning · Computer Science 2018-05-23 Jinmian Ye , Linnan Wang , Guangxi Li , Di Chen , Shandian Zhe , Xinqi Chu , Zenglin Xu

We present a low-complexity and low-latency decoding algorithm for a class of Reed-Muller (RM) subcodes that are defined based on the product of smaller RM codes. More specifically, the input sequence is shaped as a multi-dimensional array,…

Information Theory · Computer Science 2022-02-09 Mohammad Vahid Jamali , Mohammad Fereydounian , Hessam Mahdavifar , Hamed Hassani

Low-depth random circuit codes possess many desirable properties for quantum error correction but have so far only been analyzed in the code capacity setting where it is assumed that encoding gates and syndrome measurements are noiseless.…

Quantum Physics · Physics 2023-12-01 Jon Nelson , Gregory Bentsen , Steven T. Flammia , Michael J. Gullans

Deep Neural Networks (DNNs) have emerged as the most effective programming paradigm for computer vision and natural language processing applications. With the rapid development of DNNs, efficient hardware architectures for deploying…

Hardware Architecture · Computer Science 2023-02-09 Thai-Hoang Nguyen , Muhammad Imran , Jaehyuk Choi , Joon-Sung Yang

Recently, deep neural networks (DNNs) have been regarded as the state-of-the-art classification methods in a wide range of applications, especially in image classification. Despite the success, the huge number of parameters blocks its…

Machine Learning · Statistics 2017-12-18 Guangxi Li , Jinmian Ye , Haiqin Yang , Di Chen , Shuicheng Yan , Zenglin Xu

Constrained sequence codes have been widely used in modern communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel, hence enabling efficient and reliable…

Information Theory · Computer Science 2018-09-07 Congzhe Cao , Duanshun Li , Ivan Fair

We examine encoding and decoding of transmitted sequences for the downlink time-offset faster than Nyquist signaling non-orthogonal multiple access NOMA (T-NOMA) channel. We employ a previously proposed singular value decomposition…

Signal Processing · Electrical Eng. & Systems 2024-03-04 Ahmed Aboutaleb , Mohammad Torabi , Benjamin Belzer , Krishnamoorthy Sivakumar

The memory physics induced unknown offset of the channel is a critical and difficult issue to be tackled for many non-volatile memories (NVMs). In this paper, we first propose novel neural network (NN) detectors by using the multilayer…

Information Theory · Computer Science 2019-02-19 Zhen Mei , Kui Cai , Xingwei Zhong

We present a new deep-neural-network (DNN) based error correction code for fading channels with output feedback, called deep SNR-robust feedback (DRF) code. At the encoder, parity symbols are generated by a long short term memory (LSTM)…

Information Theory · Computer Science 2021-12-23 Mahdi Boloursaz Mashhadi , Deniz Gunduz , Alberto Perotti , Branislav Popovic

In this paper, a modified extrinsic information transfer (EXIT) chart analysis that takes into account the relation between mutual information (MI) and bit-error-rate (BER) is presented to study the convergence behavior of block Markov…

Information Theory · Computer Science 2015-02-03 Kechao Huang , Xiao Ma , Daniel J. Costello

Spin-Transfer Torque Magnetic RAM (STT-MRAM) as one of the most promising replacements for SRAMs in on-chip cache memories benefits from higher density and scalability, near-zero leakage power, and non-volatility, but its reliability is…

Hardware Architecture · Computer Science 2026-01-05 Elham Cheshmikhani , Hamed Farbeh , Hossein Asadi