English
Related papers

Related papers: Turbo Autoencoder with a Trainable Interleaver

200 papers

In order to meet the requirement of high data rates for the next generation wireless systems, the efficient implementation of receiver algorithms is essential. On the other hand, the rapid development of technology motivates the…

Hardware Architecture · Computer Science 2015-01-20 Shahriar Shahabuddin , Janne Janhunen , Markku Juntti

Deep generative neural networks, such as Variational AutoEncoders (VAEs), offer an opportunity to better understand and control language models from the perspective of sentence-level latent spaces. To combine the controllability of VAE…

Computation and Language · Computer Science 2023-12-21 Yingji Zhang , Danilo S. Carvalho , Ian Pratt-Hartmann , André Freitas

It has been previously observed that training Variational Recurrent Autoencoders (VRAE) for text generation suffers from serious uninformative latent variables problem. The model would collapse into a plain language model that totally…

Computation and Language · Computer Science 2019-11-20 Dayiheng Liu , Xu Yang , Feng He , Yuanyuan Chen , Jiancheng Lv

Artistic style transfer in generative models remains a significant challenge, as existing methods often introduce style only via model fine-tuning, additional adapters, or prompt engineering, all of which can be computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Raina Panda , Daniel Fein , Arpita Singhal , Mark Fiore , Maneesh Agrawala , Matyas Bohacek

Deep neural networks (NNs) have exhibited considerable potential for efficiently balancing the performance and complexity of multiple-input and multiple-output (MIMO) detectors. We propose a receiver framework that enables efficient online…

Signal Processing · Electrical Eng. & Systems 2020-12-09 Jing Zhang , Yunfeng He , Yu-Wen Li , Chao-Kai Wen , Shi Jin

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

Representation learning (RL) methods for cyberattack detection face the diversity and sophistication of attack data, leading to the issue of mixed representations of different classes, particularly as the number of classes increases. To…

Cryptography and Security · Computer Science 2025-04-30 Phai Vu Dinh , Quang Uy Nguyen , Thai Hoang Dinh , Diep N. Nguyen , Bao Son Pham , Eryk Dutkiewicz

Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. In this paper, we investigate several multi-level structures to learn a VAE model to generate…

Computation and Language · Computer Science 2019-06-21 Dinghan Shen , Asli Celikyilmaz , Yizhe Zhang , Liqun Chen , Xin Wang , Jianfeng Gao , Lawrence Carin

Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of…

Machine Learning · Computer Science 2024-11-07 Satya Narayan Shukla , Benjamin M. Marlin

Variational autoencoders (VAEs) are essential tools in end-to-end representation learning. However, the sequential text generation common pitfall with VAEs is that the model tends to ignore latent variables with a strong auto-regressive…

Machine Learning · Computer Science 2021-02-26 Yang Zhao , Ping Yu , Suchismit Mahapatra , Qinliang Su , Changyou Chen

Variational Auto-encoders (VAEs) are deep generative latent variable models consisting of two components: a generative model that captures a data distribution p(x) by transforming a distribution p(z) over latent space, and an inference…

Machine Learning · Computer Science 2022-08-25 Yaniv Yacoby , Weiwei Pan , Finale Doshi-Velez

In recent years, deep neural networks have yielded state-of-the-art performance on several tasks. Although some recent works have focused on combining deep learning with recommendation, we highlight three issues of existing models. First,…

Machine Learning · Computer Science 2018-12-20 Qibing Li , Xiaolin Zheng , Xinyue Wu

We present Turbo-Sim, a generalised autoencoder framework derived from principles of information theory that can be used as a generative model. By maximising the mutual information between the input and the output of both the encoder and…

Machine Learning · Computer Science 2021-12-22 Guillaume Quétant , Mariia Drozdova , Vitaliy Kinakh , Tobias Golling , Slava Voloshynovskiy

Denoising autoencoders (DAE) are trained to reconstruct their clean inputs with noise injected at the input level, while variational autoencoders (VAE) are trained with noise injected in their stochastic hidden layer, with a regularizer…

Machine Learning · Computer Science 2016-01-05 Daniel Jiwoong Im , Sungjin Ahn , Roland Memisevic , Yoshua Bengio

We propose Tree Variational Autoencoder (TreeVAE), a new generative hierarchical clustering model that learns a flexible tree-based posterior distribution over latent variables. TreeVAE hierarchically divides samples according to their…

Machine Learning · Computer Science 2023-11-20 Laura Manduchi , Moritz Vandenhirtz , Alain Ryser , Julia Vogt

Acoustic word embeddings (AWEs) aims to map a variable-length speech segment into a fixed-dimensional representation. High-quality AWEs should be invariant to variations, such as duration, pitch and speaker. In this paper, we introduce a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-20 Jingru Lin , Xianghu Yue , Junyi Ao , Haizhou Li

This paper addresses the problem of end-to-end (E2E) design of learning and communication in a task-oriented semantic communication system. In particular, we consider a multi-device cooperative edge inference system over a wireless…

Information Theory · Computer Science 2024-09-02 Chang Cai , Xiaojun Yuan , Ying-Jun Angela Zhang

Recent research has shown the advantages of using autoencoders based on deep neural networks for collaborative filtering. In particular, the recently proposed Mult-VAE model, which used the multinomial likelihood variational autoencoders,…

Information Retrieval · Computer Science 2019-12-25 Ilya Shenbin , Anton Alekseev , Elena Tutubalina , Valentin Malykh , Sergey I. Nikolenko

Developing effective representations of protein structures is essential for advancing protein science, particularly for protein generative modeling. Current approaches often grapple with the complexities of the SE(3) manifold, rely on…

Machine Learning · Computer Science 2025-10-14 Shaoning Li , Le Zhuo , Yusong Wang , Mingyu Li , Xinheng He , Fandi Wu , Hongsheng Li , Pheng-Ann Heng

The autoencoder concept has fostered the reinterpretation and the design of modern communication systems. It consists of an encoder, a channel, and a decoder block which modify their internal neural structure in an end-to-end learning…

Information Theory · Computer Science 2020-09-14 Nunzio A. Letizia , Andrea M. Tonello