English
Related papers

Related papers: Exploring Social Posterior Collapse in Variational…

200 papers

Variational Autoencoder (VAE) and its variations are classic generative models by learning a low-dimensional latent representation to satisfy some prior distribution (e.g., Gaussian distribution). Their advantages over GAN are that they can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao

Deep latent variable models (DLVMs) are designed to learn meaningful representations in an unsupervised manner, such that the hidden explanatory factors are interpretable by independent latent variables (aka disentanglement). The…

Machine Learning · Computer Science 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than…

Machine Learning · Statistics 2022-05-31 Mingtian Zhang , Tim Z. Xiao , Brooks Paige , David Barber

Data preprocessing is a critical part of time series data analysis. Data from connected medical devices often have missing or abnormal values during acquisition. Handling such situations requires additional assumptions and domain knowledge.…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Ali AbuSaleh , Mehdi Rahim

Although the Conditional Variational AutoEncoder (CVAE) model can generate more diversified responses than the traditional Seq2Seq model, the responses often have low relevance with the input words or are illogical with the question. A…

Computation and Language · Computer Science 2022-10-12 Jiayi Liu , Wei Wei , Zhixuan Chu , Xing Gao , Ji Zhang , Tan Yan , Yulin Kang

The variational autoencoder (VAE) can learn the manifold of natural images on certain datasets, as evidenced by meaningful interpolating or extrapolating in the continuous latent space. However, on discrete data such as text, it is unclear…

Computation and Language · Computer Science 2020-08-10 Peng Xu , Jackie Chi Kit Cheung , Yanshuai Cao

Elucidating the functional mechanisms of the primary visual cortex (V1) remains a fundamental challenge in systems neuroscience. Current computational models face two critical limitations, namely the challenge of cross-modal integration…

Neurons and Cognition · Quantitative Biology 2024-12-20 Yu Zhu , Bo Lei , Chunfeng Song , Wanli Ouyang , Shan Yu , Tiejun Huang

Graph autoencoders (GAE) and variational graph autoencoders (VGAE) emerged as powerful methods for link prediction. Their performances are less impressive on community detection problems where, according to recent and concurring…

Variational autoencoders (VAEs) frequently suffer from posterior collapse, where the latent variables become uninformative as the approximate posterior degenerates to the prior. While recent work has characterized collapse as a phase…

Machine Learning · Computer Science 2026-05-19 Zegu Zhang , Jian Zhang

People can easily imagine the potential sound while seeing an event. This natural synchronization between audio and visual signals reveals their intrinsic correlations. To this end, we propose to learn the audio-visual correlations from the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Ye Zhu , Yu Wu , Hugo Latapie , Yi Yang , Yan Yan

In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a…

Machine Learning · Statistics 2021-12-30 Hwan Goh , Sheroze Sheriffdeen , Jonathan Wittmer , Tan Bui-Thanh

A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips. We learn data-driven generative models of human movement using autoregressive…

Machine Learning · Computer Science 2021-03-29 Hung Yu Ling , Fabio Zinno , George Cheng , Michiel van de Panne

Accurate motion prediction of surrounding agents is crucial for the safe planning of autonomous vehicles. Recent advancements have extended prediction techniques from individual agents to joint predictions of multiple interacting agents,…

Artificial Intelligence · Computer Science 2025-09-12 Xing Gao , Zherui Huang , Weiyao Lin , Xiao Sun

In order to enable high-quality decision making and motion planning of intelligent systems such as robotics and autonomous vehicles, accurate probabilistic predictions for surrounding interactive objects is a crucial prerequisite. Although…

Robotics · Computer Science 2019-04-05 Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

Machine Learning · Computer Science 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

Variational autoencoder (VAE) estimates the posterior parameters (mean and variance) of latent variables corresponding to each input data. While it is used for many tasks, the transparency of the model is still an underlying issue. This…

Machine Learning · Statistics 2023-02-23 Akira Nakagawa , Keizo Kato , Taiji Suzuki

An important property for deep neural networks is the ability to perform robust out-of-distribution detection on previously unseen data. This property is essential for safety purposes when deploying models for real world applications.…

Machine Learning · Computer Science 2022-04-14 Griffin Floto , Stefan Kremer , Mihai Nica

Representation learning seeks to expose certain aspects of observed data in a learned representation that's amenable to downstream tasks like classification. For instance, a good representation for 2D images might be one that describes only…

Machine Learning · Computer Science 2017-03-07 Xi Chen , Diederik P. Kingma , Tim Salimans , Yan Duan , Prafulla Dhariwal , John Schulman , Ilya Sutskever , Pieter Abbeel

Variational Autoencoders (VAEs) are known to suffer from learning uninformative latent representation of the input due to issues such as approximated posterior collapse, or entanglement of the latent space. We impose an explicit constraint…

Computation and Language · Computer Science 2019-10-01 Victor Prokhorov , Ehsan Shareghi , Yingzhen Li , Mohammad Taher Pilehvar , Nigel Collier

Deep generative models are reported to be useful in broad applications including image generation. Repeated inference between data space and latent space in these models can denoise cluttered images and improve the quality of inferred…

Machine Learning · Statistics 2017-12-13 Yoshihiro Nagano , Ryo Karakida , Masato Okada