English
Related papers

Related papers: Rateless Autoencoder Codes: Trading off Decoding D…

200 papers

In our previous work, we proposed a discriminative autoencoder (DcAE) for speech recognition. DcAE combines two training schemes into one. First, since DcAE aims to learn encoder-decoder mappings, the squared error between the reconstructed…

Sound · Computer Science 2022-06-16 Hung-Shin Lee , Pin-Tuan Huang , Yao-Fei Cheng , Hsin-Min Wang

Reliable communication over noisy channels requires the design of specialized error-correcting codes (ECCs) tailored to specific system requirements. Recently, neural network-based decoders have emerged as promising tools for enhancing ECC…

Information Theory · Computer Science 2025-12-01 Anastasiia Kurmukova , Selim F. Yilmaz , Emre Ozfatura , Deniz Gunduz

With the massive developments of end-to-end (E2E) neural networks, recent years have witnessed unprecedented breakthroughs in automatic speech recognition (ASR). However, the codeswitching phenomenon remains a major obstacle that hinders…

Computation and Language · Computer Science 2024-02-28 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Chi-Han Lin , Berlin Chen

Regularized autoencoders learn the latent codes, a structure with the regularization under the distribution, which enables them the capability to infer the latent codes given observations and generate new samples given the codes. However,…

Machine Learning · Computer Science 2019-02-18 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Samples from a high-dimensional AR[1] process are observed by a sender which can communicate only finitely many bits per unit time to a receiver. The receiver seeks to form an estimate of the process value at every time instant in…

Information Theory · Computer Science 2022-02-01 Rooji Jinan , Parimal Parag , Himanshu Tyagi

An index code for broadcast channel with receiver side information is locally decodable if each receiver can decode its demand by observing only a subset of the transmitted codeword symbols instead of the entire codeword. Local decodability…

Information Theory · Computer Science 2020-07-31 Lakshmi Natarajan , Prasad Krishnan , V. Lalitha , Hoang Dau

Modern systems for automatic speech recognition, including the RNN-Transducer and Attention-based Encoder-Decoder (AED), are designed so that the encoder is not required to alter the time-position of information from the audio sequence into…

Sound · Computer Science 2025-02-11 Adam Stooke , Rohit Prabhavalkar , Khe Chai Sim , Pedro Moreno Mengibar

Adder MAC is a simple noiseless multiple-access channel (MAC), where if users send messages $X_1,\ldots,X_h\in \{0,1\}^n$, then the receiver receives $Y = X_1+\cdots+X_h$ with addition over $\mathbb{Z}$. Communication over the noiseless…

Information Theory · Computer Science 2018-09-21 Yuzhou Gu

In this paper, we examine a status updating system where updates generated by the source are sent to the monitor through an erasure channel. We assume each update consists of $k$ symbols and the symbol erasure in each time slot follows an…

Information Theory · Computer Science 2019-05-01 Songtao Feng , Jing Yang

State-of-the-art language models are autoregressive and operate on subword units known as tokens. Specifically, one must encode the conditioning string into a list of tokens before passing to the language models for next-token prediction.…

Computation and Language · Computer Science 2024-07-09 Buu Phan , Marton Havasi , Matthew Muckley , Karen Ullrich

One key requirement for fountain (rateless) coding schemes is to achieve a high intermediate symbol recovery rate. Recent coding schemes have incorporated the use of a feedback channel to improve intermediate performance of traditional…

Information Theory · Computer Science 2016-11-17 Morteza Hashemi , Yuval Cassuto , Ari Trachtenberg

With the increasing demands on future wireless systems, new design objectives become eminent. Low-density parity-check codes together with belief propagation (BP) decoding have outstanding performance for large block lengths. Yet, for…

Information Theory · Computer Science 2024-06-06 Jonathan Mandelbaum , Sisi Miao , Nils Albert Schwendemann , Holger Jäkel , Laurent Schmalen

We propose a network coded handover of a station moving between two IEEE 802.11 access points (AP). To address such novel proposed framework on a small cell WiFi to WiFi AP handoff, we propose a novel model for the Distributed Coordination…

Information Theory · Computer Science 2018-09-12 Samah A. M. Ghanem

Lattice codes with optimal decoding coefficient are capacity-achieving when dimension $N \rightarrow \infty$. In communications systems, finite dimensional lattice codes are considered, where the optimal decoding coefficients may still fail…

Information Theory · Computer Science 2025-01-09 Jiajie Xue , Brian M. Kurkoski

This paper considers the problem of securing a linear network coding system against an adversary that is both an eavesdropper and a jammer. The network is assumed to transport n packets from source to each receiver, and the adversary is…

Information Theory · Computer Science 2016-11-17 Danilo Silva , Frank R. Kschischang

It has been found that the signal can be encoded in the choice of the measurement basis of one of the communicating parties, while the outcomes of the measurement are irrelevant for the communication and therefore may be discarded. The…

Quantum Physics · Physics 2015-06-17 Dong Xie , An Min Wang

Traditional channel coding with feedback constructs and transmits a codeword only after all message bits are available at the transmitter. This paper joins Guo & Kostina and Lalitha et. al. in developing approaches for causal (or…

Information Theory · Computer Science 2021-04-30 Amaael Antonini , Rita Gimeshein , Richard D. Wesel

This paper presents a novel semantic-enhanced decoding scheme for transmitting natural language sentences with multiple short block codes over noisy wireless channels. After ASCII source coding, the natural language sentence message is…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Jiafu Hao , Chentao Yue , Hao Chang , Branka Vucetic , Yonghui Li

Distributed implementations of gradient-based methods, wherein a server distributes gradient computations across worker machines, need to overcome two limitations: delays caused by slow running machines called 'stragglers', and…

Information Theory · Computer Science 2020-05-15 Swanand Kadhe , O. Ozan Koyluoglu , Kannan Ramchandran

In this paper, we propose a Rectified Flow Auto Coder (RAC) inspired by Rectified Flow to replace the traditional VAE: 1. It achieves multi-step decoding by applying the decoder to flow timesteps. Its decoding path is straight and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Sen Fang , Yalin Feng , Yanxin Zhang , Dimitris N. Metaxas