English
Related papers

Related papers: Improving VAE generations of multimodal data throu…

200 papers

Data assimilation refers to a set of algorithms designed to compute the optimal estimate of a system's state by refining the prior prediction (known as background states) using observed data. Variational assimilation methods rely on the…

Machine Learning · Computer Science 2024-05-24 Yi Xiao , Qilong Jia , Wei Xue , Lei Bai

Extracting insight from the enormous quantity of data generated from molecular simulations requires the identification of a small number of collective variables whose corresponding low-dimensional free-energy landscape retains the essential…

Chemical Physics · Physics 2019-12-30 Yasemin Bozkurt Varolgunes , Tristan Bereau , Joseph F. Rudzinski

We propose a new family of optimization criteria for variational auto-encoding models, generalizing the standard evidence lower bound. We provide conditions under which they recover the data distribution and learn latent features, and…

Machine Learning · Computer Science 2017-03-01 Shengjia Zhao , Jiaming Song , Stefano Ermon

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Dooseop Choi , KyoungWook Min

Prior research has shown variational autoencoders (VAEs) to be useful for generating and blending game levels by learning latent representations of existing level data. We build on such models by exploring the level design affordances and…

Machine Learning · Computer Science 2020-10-16 Anurag Sarkar , Zhihan Yang , Seth Cooper

Vector Quantized-Variational AutoEncoders (VQ-VAE) are generative models based on discrete latent representations of the data, where inputs are mapped to a finite set of learned embeddings.To generate new samples, an autoregressive prior…

Machine Learning · Statistics 2022-08-04 Max Cohen , Guillaume Quispe , Sylvain Le Corff , Charles Ollion , Eric Moulines

Human behavior prediction models enable robots to anticipate how humans may react to their actions, and hence are instrumental to devising safe and proactive robot planning algorithms. However, modeling complex interaction dynamics and…

Robotics · Computer Science 2020-11-24 Boris Ivanovic , Karen Leung , Edward Schmerling , Marco Pavone

Variational Auto-Encoder (VAE) has been widely adopted in text generation. Among many variants, recurrent VAE learns token-wise latent variables with each conditioned on the preceding ones, which captures sequential variability better in…

Computation and Language · Computer Science 2022-11-24 Jinyi Hu , Xiaoyuan Yi , Wenhao Li , Maosong Sun , Xing Xie

Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn…

Machine Learning · Computer Science 2026-01-13 Ioannis Ziogas , Aamna Al Shehhi , Ahsan H. Khandoker , Leontios J. Hadjileontiadis

Generative modelling of multi-user datasets has become prominent in science and engineering. Generating a data point for a given user requires employing user information, and conventional generative models, including variational…

Machine Learning · Computer Science 2026-05-19 Kutay Bölat , Simon Tindemans

Variation Autoencoder (VAE) has become a powerful tool in modeling the non-linear generative process of data from a low-dimensional latent space. Recently, several studies have proposed to use VAE for unsupervised clustering by using…

Machine Learning · Computer Science 2021-06-29 Qingyu Zhao , Nicolas Honnorat , Ehsan Adeli , Kilian M. Pohl

Multimodal Variational Autoencoders have emerged as a popular tool to extract effective representations from rich multimodal data. However, such models rely on fusion strategies in latent space that destroy the joint statistical structure…

Machine Learning · Computer Science 2026-03-03 Federico Caretti , Guido Sanguinetti

Non-negative tensor factorization models enable predictive analysis on count data. Among them, Bayesian Poisson-Gamma models can derive full posterior distributions of latent factors and are less sensitive to sparse count data. However,…

Machine Learning · Computer Science 2020-12-15 Yuan Jin , Ming Liu , Yunfeng Li , Ruohua Xu , Lan Du , Longxiang Gao , Yong Xiang

Learning representations of underlying environmental dynamics from partial observations is a critical challenge in machine learning. In the context of Partially Observable Markov Decision Processes (POMDPs), state representations are often…

Machine Learning · Computer Science 2024-11-13 Chao Han , Debabrota Basu , Michael Mangan , Eleni Vasilaki , Aditya Gilra

Many factors influence speech yielding different renditions of a given sentence. Generative models, such as variational autoencoders (VAEs), capture this variability and allow multiple renditions of the same sentence via sampling. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Penny Karanasou , Sri Karlapati , Alexis Moinet , Arnaud Joly , Ammar Abbas , Simon Slangen , Jaime Lorenzo Trueba , Thomas Drugman

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

Machine Learning · Computer Science 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

This paper introduces a modified variational autoencoder (VAEs) that contains an additional neural network branch. The resulting branched VAE (BVAE) contributes a classification component based on the class labels to the total loss and…

Machine Learning · Computer Science 2024-01-08 Ahmed Salah , David Yevick

Variational autoencoders are powerful algorithms for identifying dominant latent structure in a single dataset. In many applications, however, we are interested in modeling latent structure and variation that are enriched in a target…

Machine Learning · Computer Science 2019-02-14 Abubakar Abid , James Zou

Posterior collapse plagues VAEs for text, especially for conditional text generation with strong autoregressive decoders. In this work, we address this problem in variational neural machine translation by explicitly promoting mutual…

Computation and Language · Computer Science 2019-09-23 Arya D. McCarthy , Xian Li , Jiatao Gu , Ning Dong

We present two deep generative models based on Variational Autoencoders to improve the accuracy of drug response prediction. Our models, Perturbation Variational Autoencoder and its semi-supervised extension, Drug Response Variational…

Machine Learning · Statistics 2017-07-07 Ladislav Rampasek , Daniel Hidru , Petr Smirnov , Benjamin Haibe-Kains , Anna Goldenberg