English
Related papers

Related papers: Turbo Autoencoder with a Trainable Interleaver

200 papers

Next-generation communication networks are expected to exploit recent advances in data science and cutting-edge communications technologies to improve the utilization of the available communications resources. In this article, we introduce…

Signal Processing · Electrical Eng. & Systems 2024-01-15 Abdullah Zayat , Mahmoud A. Hasabelnaby , Mohanad Obeed , Anas Chaaban

It has been widely observed that there exists a fundamental trade-off between the minimum (Hamming) distance properties and the iterative decoding convergence behavior of turbo-like codes. While capacity achieving code ensembles typically…

The development of delay-sensitive applications that require ultra high reliability created an additional challenge for wireless networks. This led to Ultra-Reliable Low-Latency Communications, as a use case that 5G and beyond 5G systems…

Information Theory · Computer Science 2023-06-16 Nourhan Hesham , Mohamed Bouzid , Ahmad Abdel-Qader , Anas Chaaban

There have been significant research activities in recent years to automate the design of channel encoders and decoders via deep learning. Due the dimensionality challenge in channel coding, it is prohibitively complex to design and train…

Information Theory · Computer Science 2022-09-13 Mohammad Vahid Jamali , Hamid Saber , Homayoon Hatami , Jung Hyun Bae

End-to-end learning of communication systems enables joint optimization of transmitter and receiver, implemented as deep neural network-based autoencoders, over any type of channel and for an arbitrary performance metric. Recently, an…

Information Theory · Computer Science 2019-06-25 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis

This work presents StrAE: a Structured Autoencoder framework that through strict adherence to explicit structure, and use of a novel contrastive objective over tree-structured representations, enables effective learning of multi-level…

Computation and Language · Computer Science 2025-02-25 Mattia Opper , Victor Prokhorov , N. Siddharth

In this paper we present a new Turbo analog error correcting coding scheme for real valued signals that are corrupted by impulsive noise. This Turbo code improves Donoho's deterministic construction by using a probabilistic approach. More…

Information Theory · Computer Science 2009-12-23 Avi Zanko , Amir Leshem , Ephraim Zehavi

This paper proposes a novel deep learning-based error correction coding scheme for AWGN channels under the constraint of one-bit quantization in the receivers. Specifically, it is first shown that the optimum error correction code that…

Information Theory · Computer Science 2019-09-27 Eren Balevi , Jeffrey G. Andrews

The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

Information Theory · Computer Science 2018-12-06 Fayçal Ait Aoudia , Jakob Hoydis

Auto-encoder is a special kind of neural network based on reconstruction. De-noising auto-encoder (DAE) is an improved auto-encoder which is robust to the input by corrupting the original data first and then reconstructing the original…

Machine Learning · Computer Science 2014-04-24 Fu-qiang Chen , Yan Wu , Guo-dong Zhao , Jun-ming Zhang , Ming Zhu , Jing Bai

Turbo-Codes (TC) are a family of convolutional codes enabling Forward-Error-Correction (FEC) while approaching the theoretical limit of channel capacity predicted by Shannons theorem. One of the bottlenecks of a Turbo Encoder (TE) lies in…

Information Theory · Computer Science 2023-08-30 Ohad Boxerman , Moshe Bensimon , Shlomo Greenberg , Yehuda Ben-Shimol

Audio autoencoders learn useful, compressed audio representations, but their non-linear latent spaces prevent intuitive algebraic manipulation such as mixing or scaling. We introduce a simple training methodology to induce linearity in a…

Sound · Computer Science 2026-01-29 Bernardo Torres , Manuel Moussallam , Gabriel Meseguer-Brocal

Reliable communication over noisy channels requires the design of specialized error-correcting codes (ECCs) tailored to specific system requirements. Recently, neural network-based decoders have emerged as promising tools for enhancing ECC…

Information Theory · Computer Science 2025-12-01 Anastasiia Kurmukova , Selim F. Yilmaz , Emre Ozfatura , Deniz Gunduz

The structure and size of the interleaver used in a turbo code critically affect the distance spectrum and the covariance property of a component decoder's information input and soft output. This paper introduces a new class of…

Information Theory · Computer Science 2009-09-29 Yan-Xiu Zheng , Yu T. Su

This paper introduces the Descriptive Variational Autoencoder (DVAE), an unsupervised and end-to-end trainable neural network for predicting vehicle trajectories that provides partial interpretability. The novel approach is based on the…

Machine Learning · Computer Science 2021-06-25 Marion Neumeier , Andreas Tollkühn , Thomas Berberich , Michael Botsch

Generative autoencoders offer a promising approach for controllable text generation by leveraging their latent sentence representations. However, current models struggle to maintain coherent latent spaces required to perform meaningful text…

Machine Learning · Computer Science 2020-07-08 Tianxiao Shen , Jonas Mueller , Regina Barzilay , Tommi Jaakkola

The application of deep learning to the area of communications systems has been a growing field of interest in recent years. Forward-forward (FF) learning is an efficient alternative to the backpropagation (BP) algorithm, which is the…

Information Theory · Computer Science 2026-02-17 Daniel Seifert , Onur Günlü , Rafael F. Schaefer

Controllable text generation has taken a gigantic step forward these days. Yet existing methods are either constrained in a one-off pattern or not efficient enough for receiving multiple conditions at every generation stage. We propose a…

Computation and Language · Computer Science 2022-10-10 Haoqin Tu , Zhongliang Yang , Jinshuai Yang , Siyu Zhang , Yongfeng Huang

In this paper, we introduce a neural-augmented decoder for Turbo codes called TINYTURBO . TINYTURBO has complexity comparable to the classical max-log-MAP algorithm but has much better reliability than the max-log-MAP baseline and performs…

Information Theory · Computer Science 2022-10-03 S Ashwin Hebbar , Rajesh K Mishra , Sravan Kumar Ankireddy , Ashok V Makkuva , Hyeji Kim , Pramod Viswanath

We present a novel information-theoretic framework, termed as TURBO, designed to systematically analyse and generalise auto-encoding methods. We start by examining the principles of information bottleneck and bottleneck-based networks in…

Machine Learning · Computer Science 2023-11-14 Guillaume Quétant , Yury Belousov , Vitaliy Kinakh , Slava Voloshynovskiy