English
Related papers

Related papers: TransCoder: A Neural-Enhancement Framework for Cha…

200 papers

Designing a practical, low complexity, close to optimal, channel decoder for powerful algebraic codes with short to moderate block length is an open research problem. Recently it has been shown that a feed-forward neural network…

Information Theory · Computer Science 2017-02-27 Eliya Nachmani , Elad Marciano , David Burshtein , Yair Be'ery

In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used…

Information Theory · Computer Science 2024-08-02 Behnam Behinaein Hamgini , Hossein Najafi , Ali Bakhshali , Zhuhong Zhang

This paper reviews the potential channel decoding techniques for ultra-reliable low-latency communications (URLLC). URLLC is renowned for its stringent requirements including ultra-reliability, low end-to-end transmission latency, and…

Information Theory · Computer Science 2022-12-26 Chentao Yue , Vera Miloslavskaya , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Neural codecs, comprising an encoder, quantizer, and decoder, enable signal transmission at exceptionally low bitrates. Training these systems requires techniques like the straight-through estimator, soft-to-hard annealing, or statistical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Wolfgang Mack , Ahmed Mustafa , Rafał Łaganowski , Samer Hijazy

Error-control-coding (ECC) techniques are widely used in modern digital communication systems to minimize the effect of noisy channels on the quality of received signals. Motivated by the fact that both communication and imaging can be…

Image and Video Processing · Electrical Eng. & Systems 2018-09-20 Xiaopeng Wang , Zunwang Bo , Zihuai Lin , Wenlin Gong , Branka Vucetic , Shensheng Han

Transformer-based neural decoders have emerged as a promising approach to error correction coding, combining data-driven adaptability with efficient modeling of long-range dependencies. This paper presents a novel decoder architecture that…

Information Theory · Computer Science 2025-09-22 Chin Wa Lau , Xiang Shi , Ziyan Zheng , Haiwen Cao , Nian Guo

Point-to-multipoint communications are expected to play a pivotal role in next-generation networks. This paper refers to a cellular system transmitting layered multicast services to a multicast group of users. Reliability of communications…

Information Theory · Computer Science 2016-11-17 Andrea Tassi , Ioannis Chatzigeorgiou , Daniel E. Lucani

The autoencoder concept has fostered the reinterpretation and the design of modern communication systems. It consists of an encoder, a channel, and a decoder block which modify their internal neural structure in an end-to-end learning…

Information Theory · Computer Science 2020-09-14 Nunzio A. Letizia , Andrea M. Tonello

Quantum error-correction is a prerequisite for reliable quantum computation. Towards this goal, we present a recurrent, transformer-based neural network which learns to decode the surface code, the leading quantum error-correction code. Our…

In this paper, we consider the ChannelComp framework, which facilitates the computation of desired functions by multiple transmitters over a common receiver using digital modulations across a multiple access channel. While ChannelComp…

Signal Processing · Electrical Eng. & Systems 2024-04-26 Xiaojing Yan , Saeed Razavikia , Carlo Fischione

The advent of Transformer-based models has surpassed the barriers of text. When working with speech, we must face a problem: the sequence length of an audio input is not suitable for the Transformer. To bypass this problem, a usual approach…

Computation and Language · Computer Science 2021-07-08 Belen Alastruey , Gerard I. Gállego , Marta R. Costa-jussà

Transformers are powerful neural architectures that allow integrating different modalities using attention mechanisms. In this paper, we leverage the neural transformer architectures for multi-channel speech recognition systems, where the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Brian King , Siegfried Kunzmann

This paper introduces a novel approach called "friendly attack" aimed at enhancing the performance of error correction channel codes. Inspired by the concept of adversarial attacks, our method leverages the idea of introducing slight…

Information Theory · Computer Science 2024-01-26 Anastasiia Kurmukova , Deniz Gunduz

We introduce Noise Recycling, a method that enhances decoding performance of channels subject to correlated noise without joint decoding. The method can be used with any combination of codes, code-rates and decoding techniques. In the…

Information Theory · Computer Science 2020-10-16 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard

In this paper, we design a deep learning-based convolutional autoencoder for channel coding and modulation. The objective is to develop an adaptive scheme capable of operating at various signal-to-noise ratios (SNR)s without the need for…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Ahmad Abdel-Qader , Anas Chaaban , Mohamed S. Shehata

Neural machine translation (NMT) typically adopts the encoder-decoder framework. A good understanding of the characteristics and functionalities of the encoder and decoder can help to explain the pros and cons of the framework, and design…

Computation and Language · Computer Science 2019-08-20 Tianyu He , Xu Tan , Tao Qin

Error Correction Codes (ECC) are fundamental to reliable digital communication, yet designing neural decoders that are both accurate and computationally efficient remains challenging. Recent denoising diffusion decoders achieve…

Machine Learning · Computer Science 2026-02-18 Haoyu Lei , Chin Wa Lau , Kaiwen Zhou , Nian Guo , Farzan Farnia

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

The ability to think abstractly and reason by analogy is a prerequisite to rapidly adapt to new conditions, tackle newly encountered problems by decomposing them, and synthesize knowledge to solve problems comprehensively. We present…

Artificial Intelligence · Computer Science 2024-10-08 Jakub Bednarek , Krzysztof Krawiec

Code translation is a crucial activity in the software development and maintenance process, and researchers have recently begun to focus on using pre-trained large language models (LLMs) for code translation. However, existing LLMs only…

Software Engineering · Computer Science 2025-09-30 Minghua He , Yue Chen , Fangkai Yang , Pu Zhao , Wenjie Yin , Yu Kang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang