English
Related papers

Related papers: Turbo Autoencoder with a Trainable Interleaver

200 papers

The purpose of this study is to construct a near capacity Irregular Turbo Code and to evaluate its performance over Gaussian channel. The methodology used to evaluate and measure the performance of the new design is by simulating the system…

Information Theory · Computer Science 2016-04-06 Abiodun Sholiyi , Jafar A. Alzubi , Omar A. Alzubi , Omar Almomani , Tim O'Farrell

Accurate and robust prediction of patient's response to drug treatments is critical for developing precision medicine. However, it is often difficult to obtain a sufficient amount of coherent drug response data from patients directly for…

Machine Learning · Computer Science 2021-02-02 Di He , Lei Xie

While decades of theoretical research have led to the invention of several classes of error-correction codes, the design of such codes is an extremely challenging task, mostly driven by human ingenuity. Recent studies demonstrate that such…

Information Theory · Computer Science 2024-08-20 Mohammad Vahid Jamali , Hamid Saber , Homayoon Hatami , Jung Hyun Bae

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

Neural network-based decoding methods show promise in enhancing error correction performance but face challenges with punctured codes. In particular, existing methods struggle to adapt to variable code rates or meet protocol compatibility…

Machine Learning · Computer Science 2025-10-31 Yongli Yan , Linglong Dai

Communication technologies like voice over IP operate under constrained real-time conditions, with voice packets being subject to delays and losses from the network. In such cases, the packet loss concealment (PLC) algorithm reconstructs…

Sound · Computer Science 2021-07-09 Santiago Pascual , Joan Serrà , Jordi Pons

This paper investigates a turbo receiver employing a variational quantum circuit (VQC). The VQC is configured with an ansatz of the quantum approximate optimization algorithm (QAOA). We propose a 'learning to learn' (L2L) framework to…

Signal Processing · Electrical Eng. & Systems 2022-05-19 Bryan Liu , Toshiaki Koike-Akino , Ye Wang , Kieran Parsons

There is a growing demand for deploying large generative AI models on mobile devices. For recent popular video generative models, however, the Variational AutoEncoder (VAE) represents one of the major computational bottlenecks. Both large…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Ya Zou , Jingfeng Yao , Siyuan Yu , Shuai Zhang , Wenyu Liu , Xinggang Wang

In the context of cellular networks, users located at the periphery of cells are particularly vulnerable to substantial interference from neighbouring cells, which can be represented as a two-user interference channel. This study introduces…

Information Theory · Computer Science 2024-10-29 Shubham Paul , Sudharsan Senthil , Preethi Seshadri , Nambi Seshadri , R David Koilpillai

This paper introduces an efficient and robust method for discovering interpretable circuits in large language models using discrete sparse autoencoders. Our approach addresses key limitations of existing techniques, namely computational…

Computation and Language · Computer Science 2024-05-22 Charles O'Neill , Thang Bui

Multimodal pre-training for audio-and-text has recently been proved to be effective and has significantly improved the performance of many downstream speech understanding tasks. However, these state-of-the-art pre-training audio-text models…

Sound · Computer Science 2022-04-12 Yu Kang , Tianqiao Liu , Hang Li , Yang Hao , Wenbiao Ding

The development of optimal and efficient machine learning-based communication systems is likely to be a key enabler of beyond 5G communication technologies. In this direction, physical layer design has been recently reformulated under a…

Information Theory · Computer Science 2021-11-16 Nunzio A. Letizia , Andrea M. Tonello

In this article we extend the idea of Turbo codes onto the Real Field. The channel is taken to result in block erasures and the only noise as being that due to quantization. The decoding in this case is reduced to reconstruction of the lost…

Combinatorics · Mathematics 2007-05-23 Animesh Datta

We propose an algorithm, guided variational autoencoder (Guided-VAE), that is able to learn a controllable generative model by performing latent representation disentanglement learning. The learning objective is achieved by providing…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Zheng Ding , Yifan Xu , Weijian Xu , Gaurav Parmar , Yang Yang , Max Welling , Zhuowen Tu

It has been recognized that the impulsive noise (IN) generated by power devices poses significant challenges to wireless receivers. In this paper, we comprehensively assess the achievable information rate (AIR) for the well-established…

Information Theory · Computer Science 2026-03-16 Chin-Hung Chen , Boris Karanov , Wim van Houtom , Yan Wu , Alex Alvarado

We consider compressive sensing as a source coding method for signal transmission. We concatenate a convolutional coding system with 1-bit compressive sensing to obtain a serial concatenated system model for sparse signal transmission over…

Information Theory · Computer Science 2014-03-14 Amin Movahed , Mark C. Reed

Human infant learning happens during exploration of the environment, by interaction with objects, and by listening to and repeating utterances casually, which is analogous to unsupervised learning. Only occasionally, a learning infant would…

Computation and Language · Computer Science 2023-02-23 Ozan Özdemir , Matthias Kerzel , Cornelius Weber , Jae Hee Lee , Muhammad Burhan Hafez , Patrick Bruns , Stefan Wermter

Data-driven fault diagnostics of safety-critical systems often faces the challenge of a complete lack of labeled data associated with faulty system conditions (i.e., fault types) at training time. Since an unknown number and nature of fault…

Machine Learning · Computer Science 2020-10-01 Manuel Arias Chao , Bryan T. Adey , Olga Fink

Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This…

Machine Learning · Statistics 2026-05-14 Gara Dorta , Sara Vicente , Lourdes Agapito , Neill D. F. Campbell , Ivor Simpson

LiDAR-based perception is central to autonomous driving and robotics, yet raw point clouds remain highly vulnerable to noise, occlusion, and adversarial corruptions. Autoencoders offer a natural framework for denoising and reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Susmit Neogi