English
Related papers

Related papers: A Contrastive Learning Approach for Training Varia…

200 papers

In this paper, we propose a variational autoencoder with disentanglement priors, VAE-DPRIOR, for task-specific natural language generation with none or a handful of task-specific labeled examples. In order to tackle compositional…

Computation and Language · Computer Science 2022-11-01 Zhuang Li , Lizhen Qu , Qiongkai Xu , Tongtong Wu , Tianyang Zhan , Gholamreza Haffari

Estimation of uncertainty in deep learning models is of vital importance, especially in medical imaging, where reliance on inference without taking into account uncertainty could lead to misdiagnosis. Recently, the probabilistic Variational…

Machine Learning · Computer Science 2020-10-20 Haleh Akrami , Anand A. Joshi , Sergul Aydore , Richard M. Leahy

The reconstruction loss and the Kullback-Leibler divergence (KLD) loss in a variational autoencoder (VAE) often play antagonistic roles, and tuning the weight of the KLD loss in $\beta$-VAE to achieve a balance between the two losses is a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Jianning Li , Jana Fragemann , Seyed-Ahmad Ahmadi , Jens Kleesiek , Jan Egger

We take steps towards understanding the "posterior collapse (PC)" difficulty in variational autoencoders (VAEs),~i.e. a degenerate optimum in which the latent codes become independent of their corresponding inputs. We rely on calculus of…

Machine Learning · Computer Science 2019-08-01 Octavian-Eugen Ganea , Yashas Annadani , Gary Bécigneul

The variational autoencoder (VAE) is a popular probabilistic generative model. However, one shortcoming of VAEs is that the latent variables cannot be discrete, which makes it difficult to generate data from different modes of a…

Machine Learning · Statistics 2017-11-21 Jay A. Hennig , Akash Umakantha , Ryan C. Williamson

Variational autoencoders (VAEs) are popular likelihood-based generative models which can be efficiently trained by maximizing an Evidence Lower Bound (ELBO). There has been much progress in improving the expressiveness of the variational…

Machine Learning · Statistics 2023-08-29 Marcel Hirt , Vasileios Kreouzis , Petros Dellaportas

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

Machine Learning · Computer Science 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

Automatic speaker verification (ASV) systems are highly vulnerable to presentation attacks, also called spoofing attacks. Replay is among the simplest attacks to mount - yet difficult to detect reliably. The generalization failure of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-24 Bhusan Chettri , Tomi Kinnunen , Emmanouil Benetos

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Pingyu Wu , Kai Zhu , Yu Liu , Liming Zhao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Optimal computations under uncertainty require an adequate probabilistic representation about beliefs. Deep generative models, and specifically Variational Autoencoders (VAEs), have the potential to meet this demand by building latent…

Using a discriminative representation obtained by supervised deep learning methods showed promising results on diverse Content-Based Image Retrieval (CBIR) problems. However, existing methods exploiting labels during training try to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Mehdi Rafiei , Alexandros Iosifidis

Recently, deep generative models have become increasingly popular in unsupervised anomaly detection. However, deep generative models aim at recovering the data distribution rather than detecting anomalies. Besides, deep generative models…

Machine Learning · Computer Science 2019-11-15 Xuhong Wang , Ying Du , Shijie Lin , Ping Cui , Yuntian Shen , Yupu Yang

VAEs, or variational autoencoders, are autoencoders that explicitly learn the distribution of the input image space rather than assuming no prior information about the distribution. This allows it to classify similar samples close to each…

Machine Learning · Computer Science 2023-02-08 Fareed Sheriff , Sameer Pai

We present a novel introspective variational autoencoder (IntroVAE) model for synthesizing high-resolution photographic images. IntroVAE is capable of self-evaluating the quality of its generated samples and improving itself accordingly.…

Machine Learning · Computer Science 2018-10-30 Huaibo Huang , Zhihang Li , Ran He , Zhenan Sun , Tieniu Tan

Variational Autoencoder (VAE) is widely used as a generative model to approximate a model's posterior on latent variables by combining the amortized variational inference and deep neural networks. However, when paired with strong…

Machine Learning · Computer Science 2020-06-02 Qile Zhu , Jianlin Su , Wei Bi , Xiaojiang Liu , Xiyao Ma , Xiaolin Li , Dapeng Wu

In variational autoencoders (VAEs), the variational posterior often collapses to the prior, known as posterior collapse, which leads to poor representation learning quality. An adjustable hyperparameter beta has been introduced in VAEs to…

Machine Learning · Statistics 2025-07-22 Yuma Ichikawa , Koji Hukushima

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

Machine Learning · Computer Science 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

Contrastive learning (CL) for Vision Transformers (ViTs) in image domains has achieved performance comparable to CL for traditional convolutional backbones. However, in 3D point cloud pretraining with ViTs, masked autoencoder (MAE) modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Bin Ren , Guofeng Mei , Danda Pani Paudel , Weijie Wang , Yawei Li , Mengyuan Liu , Rita Cucchiara , Luc Van Gool , Nicu Sebe

Variational autoencoders (VAEs) typically encode images into a compact latent space, reducing computational cost but introducing an optimization dilemma: a higher-dimensional latent space improves reconstruction fidelity but often hampers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xunzhi Xiang , Xingye Tian , Guiyu Zhang , Yabo Chen , Shaofeng Zhang , Xuebo Wang , Xin Tao , Qi Fan