English
Related papers

Related papers: Error Correction Code Transformer

200 papers

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade

We describe a quantum error correction scheme aimed at protecting a flow of quantum information over long distance communication. It is largely inspired by the theory of classical convolutional codes which are used in similar circumstances…

Quantum Physics · Physics 2009-11-10 H. Ollivier , J. -P. Tillich

Communications in highly dynamic channels relying on training-based channel estimation experience a trade-off between increasing channel measurement accuracy by sending more frequent training sequences and increasing data rate by sending…

Information Theory · Computer Science 2026-05-04 Duschia Bodet , Muriel Médard , Muralidhar Rangaswamy , Ken Duffy

Finding efficient decoders for quantum error correcting codes adapted to realistic experimental noise in fault-tolerant devices represents a significant challenge. In this paper we introduce several decoding algorithms complemented by deep…

Quantum Physics · Physics 2018-08-01 Christopher Chamberland , Pooya Ronagh

A new deep-neural-network (DNN) based error correction encoder architecture for channels with feedback, called Deep Extended Feedback (DEF), is presented in this paper. The encoder in the DEF architecture transmits an information message…

Information Theory · Computer Science 2021-05-05 Anahid Robert Safavi , Alberto G. Perotti , Branislav M. Popovic , Mahdi Boloursaz Mashhadi , Deniz Gunduz

The use of deep neural network for decoding error control code will encounter two problems, namely, the high-precision requirements of the error control code and the complexity of the neural network due to the long code. In this paper, a…

Signal Processing · Electrical Eng. & Systems 2019-01-01 Jiang Xiaobo , Zhang Fang , Zeng Zhen

In recent years, widespread attention has been drawn to the challenge of correcting insertion, deletion, and substitution (IDS) errors in DNA-based data storage. Among various IDS-correcting codes, Varshamov-Tenengolts (VT) codes,…

Machine Learning · Computer Science 2026-04-02 Yali Wei , Alan J. X. Guo , Zihui Yan , Yufan Dai , Wenjia Fan

Error correcting codes (ECCs) are indispensable for reliable transmission in communication systems. The recent advancements in deep learning have catalyzed the exploration of ECC decoders based on neural networks. Among these,…

Machine Learning · Computer Science 2025-05-27 Seong-Joon Park , Hee-Youl Kwak , Sang-Hyo Kim , Yongjune Kim , Jong-Seon No

When data is stored, compressed, or communicated through a media such as cable or air, sources of noise and other parameters such as EMI, crosstalk, and distance can considerably affect the reliability of these data. Error detection and…

Information Theory · Computer Science 2016-11-18 Naima Kaabouch , Aparna Dhirde , Saleh Faruque

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

The advent of Transformer-based models has surpassed the barriers of text. When working with speech, we must face a problem: the sequence length of an audio input is not suitable for the Transformer. To bypass this problem, a usual approach…

Computation and Language · Computer Science 2021-07-08 Belen Alastruey , Gerard I. Gállego , Marta R. Costa-jussà

This paper proposes a method for designing error correction codes by combining a known coding scheme with an autoencoder. Specifically, we integrate an LDPC code with a trained autoencoder to develop an error correction code for intractable…

Information Theory · Computer Science 2020-03-03 Eren Balevi , Jeffrey G. Andrews

Quantum error correction is an essential technique for constructing a scalable quantum computer. In order to implement quantum error correction with near-term quantum devices, a fast and near-optimal decoding method is demanded. A decoder…

Quantum Physics · Physics 2020-09-16 Amarsanaa Davaasuren , Yasunari Suzuki , Keisuke Fujii , Masato Koashi

The rapidly improving performance of modern hardware renders convolutional codes obsolete, and allows for the practical implementation of more sophisticated correction codes such as low density parity check (LDPC) and turbo codes (TC). Both…

Information Theory · Computer Science 2015-03-20 Jarosław Duda , Paweł Korus

Error correcting codes play a central role in digital communication, ensuring that transmitted information can be accurately reconstructed despite channel impairments. Recently, autoencoder (AE) based approaches have gained attention for…

Information Theory · Computer Science 2025-11-13 Vukan Ninkovic , Dejan Vukobratovic

The decoding of error syndromes of surface codes with classical algorithms may slow down quantum computation. To overcome this problem it is possible to implement decoding algorithms based on artificial neural networks. This work reports a…

Quantum Physics · Physics 2026-04-21 Simone Bordoni , Stefano Giagu

We consider data transmission over a network where each edge is an erasure channel and where the inner nodes transmit a random linear combination of their incoming information. We distinguish two channel models in this setting, the row and…

Information Theory · Computer Science 2017-10-18 Heide Gluesing-Luerssen , Anna-Lena Horlemann-Trautmann

Low complexity error correction code is a key enabler for next generation ultra-reliable low-latency communications (xURLLC) in six generation (6G). Against this background, this paper proposes a decoding scheme for linear block code by…

Signal Processing · Electrical Eng. & Systems 2025-12-11 Di Zhang , Yinglei Yang , Zilong Liu , Shaobo Jia , Kyungchun Lee , Zhirong Zhang

Machine learning has the potential to become an important tool in quantum error correction as it allows the decoder to adapt to the error distribution of a quantum chip. An additional motivation for using neural networks is the fact that…

Quantum Physics · Physics 2019-09-18 Nikolas P. Breuckmann , Xiaotong Ni

In a digital communication system, information is sent from one place to another over a noisy communication channel. It may be possible to detect and correct errors that occur during the transmission if one encodes the original information…

Information Theory · Computer Science 2017-08-21 Banu Kabakulak , Z. Caner Taşkın , Ali Emre Pusane