中文
相关论文

相关论文: Preventing Oversmoothing in VAE via Generalized Va…

200 篇论文

Variational autoencoder (VAE) has widely been utilized for modeling data distributions because it is theoretically elegant, easy to train, and has nice manifold representations. However, when applied to image reconstruction and synthesis…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Dooseop Choi , KyoungWook Min

Deep latent variable models (LVM) such as variational auto-encoder (VAE) have recently played an important role in text generation. One key factor is the exploitation of smooth latent structures to guide the generation. However, the…

机器学习 · 计算机科学 2019-12-02 Le Fang , Chunyuan Li , Jianfeng Gao , Wen Dong , Changyou Chen

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

机器学习 · 计算机科学 2023-04-06 R. I. Cukier

Variational Autoencoders (VAEs), as a form of deep generative model, have been widely used in recent years, and shown great great peformance in a number of different domains, including image generation and anomaly detection, etc.. This…

机器学习 · 计算机科学 2024-08-28 Liang Cheng , Peiyuan Guan , Amir Taherkordi , Lei Liu , Dapeng Lan

Variational Autoencoders (VAEs) are powerful generative models widely used for learning interpretable latent spaces, quantifying uncertainty, and compressing data for downstream generative tasks. VAEs typically rely on diagonal Gaussian…

机器学习 · 计算机科学 2025-06-03 Peter Sorrenson , Lukas Lührs , Hans Olischläger , Ullrich Köthe

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. They balance reconstruction and regularizer terms. A variational approximation produces an evidence…

机器学习 · 统计学 2023-12-13 Robert I. Cukier

Training of discrete latent variable models remains challenging because passing gradient information through discrete units is difficult. We propose a new class of smoothing transformations based on a mixture of two overlapping…

机器学习 · 计算机科学 2018-05-29 Arash Vahdat , William G. Macready , Zhengbing Bian , Amir Khoshaman , Evgeny Andriyash

The variational autoencoder (VAE) can learn the manifold of natural images on certain datasets, as evidenced by meaningful interpolating or extrapolating in the continuous latent space. However, on discrete data such as text, it is unclear…

计算与语言 · 计算机科学 2020-08-10 Peng Xu , Jackie Chi Kit Cheung , Yanshuai Cao

Conventional prior for Variational Auto-Encoder (VAE) is a Gaussian distribution. Recent works demonstrated that choice of prior distribution affects learning capacity of VAE models. We propose a general technique…

机器学习 · 计算机科学 2018-12-10 Eugene Golikov , Maksim Kretov

It has been long known that sparsity is an effective inductive bias for learning efficient representation of data in vectors with fixed dimensionality, and it has been explored in many areas of representation learning. Of particular…

计算与语言 · 计算机科学 2021-04-20 Victor Prokhorov , Yingzhen Li , Ehsan Shareghi , Nigel Collier

Variational Autoencoders (VAEs) represent the given data in a low-dimensional latent space, which is generally assumed to be Euclidean. This assumption naturally leads to the common choice of a standard Gaussian prior over continuous latent…

机器学习 · 计算机科学 2020-08-10 Dimitris Kalatzis , David Eklund , Georgios Arvanitidis , Søren Hauberg

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

计算与语言 · 计算机科学 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

Vector-Quantized Variational Autoencoders (VQ-VAE)[1] provide an unsupervised model for learning discrete representations by combining vector quantization and autoencoders. In this paper, we study the use of VQ-VAE for representation…

图像与视频处理 · 电气工程与系统科学 2019-03-05 Hanwei Wu , Markus Flierl

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

机器学习 · 计算机科学 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

计算物理 · 物理学 2021-11-16 Christian Jacobsen , Karthik Duraisamy

Variational Autoencoders (VAE) are widely used for dimensionality reduction of large-scale tabular and image datasets, under the assumption of independence between data observations. In practice, however, datasets are often correlated, with…

机器学习 · 统计学 2024-12-25 Giora Simchoni , Saharon Rosset

This paper proposes a method for detecting anomalies in video data. A Variational Autoencoder (VAE) is used for reducing the dimensionality of video frames, generating latent space information that is comparable to low-dimensional sensory…

计算机视觉与模式识别 · 计算机科学 2020-03-18 Giulia Slavic , Damian Campo , Mohamad Baydoun , Pablo Marin , David Martin , Lucio Marcenaro , Carlo Regazzoni

The variational autoencoder (VAE) is a popular, deep, latent-variable model (DLVM) due to its simple yet effective formulation for modeling the data distribution. Moreover, optimizing the VAE objective function is more manageable than other…

机器学习 · 计算机科学 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine…

机器学习 · 计算机科学 2023-04-03 Mani Valleti , Yongtao Liu , Sergei Kalinin

Variational autoencoders (VAEs), one of the most widely used generative models, are known to suffer from posterior collapse, a phenomenon that reduces the diversity of generated samples. To avoid posterior collapse, many prior works have…

机器学习 · 计算机科学 2025-08-19 Hyunsoo Song , Seungwhan Kim , Seungkyu Lee