English
Related papers

Related papers: Transformer-Based Decoding in Concatenated Coding …

200 papers

Fault-tolerant quantum computers will depend crucially on the performance of the classical decoding algorithm which takes in the results of measurements and outputs corrections to the errors inferred to have occurred. Machine learning…

Quantum Physics · Physics 2025-04-18 John Blue , Harshil Avlani , Zhiyang He , Liu Ziyin , Isaac L. Chuang

Inspired by recent advances in deep learning, we propose a novel iterative BP-CNN architecture for channel decoding under correlated noise. This architecture concatenates a trained convolutional neural network (CNN) with a standard…

Machine Learning · Statistics 2018-03-14 Fei Liang , Cong Shen , Feng Wu

In this paper, we consider the outer channel for DNA-based data storage. When transmitting over the outer channel, each DNA string is treated as a unit/symbol that would be either correctly received, or erased, or corrupted by uniformly…

Information Theory · Computer Science 2025-09-23 Xuan He , Yi Ding , Kui Cai , Guanghui Song , Bin Dai , Xiaohu Tang

This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-21 Yi-Hsin Chen , Kuan-Wei Ho , Shiau-Rung Tsai , Guan-Hsun Lin , Alessandro Gnutti , Wen-Hsiao Peng , Riccardo Leonardi

Recently, Transformer-based encoder-decoder models have demonstrated strong performance in multilingual speech recognition. However, the decoder's autoregressive nature and large size introduce significant bottlenecks during inference.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-28 Yunkyu Lim , Jihwan Park , Hyung Yong Kim , Hanbin Lee , Byeong-Yeol Kim

We consider error-correcting coding for DNA-based storage. We model the DNA storage channel as a multi-draw IDS channel where the input data is chunked into $M$ short DNA strands, which are copied a random number of times, and the channel…

Information Theory · Computer Science 2023-06-22 Lorenz Welter , Issam Maarouf , Andreas Lenz , Antonia Wachter-Zeh , Eirik Rosnes , Alexandre Graell i Amat

We study the amount of reliable information that can be stored in a DNA-based storage system with noisy sequencing, where each codeword is composed of short DNA molecules. We analyze a concatenated coding scheme, where the outer code is…

Information Theory · Computer Science 2026-05-19 Ran Tamir , Nir Weinberger , Albert Guillén i Fàbregas

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2014-06-26 Yunghsiang Han , Hung-Ta Pai , Rong Zheng , Pramod K. Varshney

DNA has immense potential as an emerging data storage medium. The principle of DNA storage is the conversion and flow of digital information between binary code stream, quaternary base, and actual DNA fragments. This process will inevitably…

Information Retrieval · Computer Science 2022-10-21 Yun Qin , Fei Zhu , Bo Xi

In the Levenshtein's sequence reconstruction problem a codeword is transmitted through $N$ channels and in each channel a set of errors is introduced to the transmitted word. In previous works, the restriction that each channel provides a…

Information Theory · Computer Science 2024-06-21 Ville Junnila , Tero Laihonen , Tuomo Lehtilä

In this paper, we consider the decoding of fountain codes where the received symbols may have errors. It is motivated by the application of fountain codes in DNA-based data storage systems where the inner code decoding, which generally has…

Information Theory · Computer Science 2023-01-31 Xuan He , Kui Cai

Transformer-based neural decoders have emerged as a promising approach to error correction coding, combining data-driven adaptability with efficient modeling of long-range dependencies. This paper presents a novel decoder architecture that…

Information Theory · Computer Science 2025-09-22 Chin Wa Lau , Xiang Shi , Ziyan Zheng , Haiwen Cao , Nian Guo

The Burrows-Wheeler Transform (BWT) is among the most influential discoveries in text compression and DNA storage. It is a reversible preprocessing step that rearranges an $n$-letter string into runs of identical characters (by exploiting…

Data Structures and Algorithms · Computer Science 2018-12-06 Sandip Sinha , Omri Weinstein

We consider the design of regenerating codes for distributed storage systems at the minimum bandwidth regeneration (MBR) point. The codes allow for a repair process that is exact and uncoded, but table-based. These codes were introduced in…

Information Theory · Computer Science 2012-11-19 Oktay Olmez , Aditya Ramamoorthy

In this paper, iterative differential phase-shift keying (DPSK) demodulation and channel decoding scheme is investigated for the Joint Channel decoding and physical layer Network Coding (JCNC) approach in two-way relaying systems. The Bahl,…

Information Theory · Computer Science 2013-02-12 Weijun Zeng , Xiaofu Wu , Zhen Yang

Belief propagation (BP) is an iterative decoding algorithm for polar codes which can be parallelized effectively to achieve higher throughput. However, because of the presence of error floor due to cycles and stopping sets in the factor…

Information Theory · Computer Science 2020-03-05 Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-aho

In joint multiuser decoding, a receiver recovers a set of messages from a single noisy aggregate of many simultaneous transmissions. Classical decoders rely on rule-based mechanisms such as successive interference cancellation, joint belief…

Information Theory · Computer Science 2026-05-27 Taekyun Lee , Jiyoung Yun , Jeffrey G. Andrews , Hyeji Kim

We propose a new compression scheme for genomic data given as sequence fragments called reads. The scheme uses a reference genome at the decoder side only, freeing the encoder from the burdens of storing references and performing…

Information Theory · Computer Science 2023-02-10 Yotam Gershon , Yuval Cassuto

Noisy shuffling channels capture the main characteristics of DNA storage systems where distinct segments of data are received out of order, after being corrupted by substitution errors. For realistic schemes with short-length segments,…

Information Theory · Computer Science 2024-10-07 Javad Haghighat , Tolga M. Duman

Quantum stabilizer codes constructed from sparse matrices have good performance and can be efficiently decoded by belief propagation (BP). A conventional BP decoding algorithm treats binary stabilizer codes as additive codes over GF(4).…

Quantum Physics · Physics 2020-10-21 Kao-Yueh Kuo , Ching-Yi Lai