中文
相关论文

相关论文: To Regularize or Not To Regularize? The Bias Varia…

200 篇论文

Variational Autoencoders (VAEs) typically rely on a probabilistic decoder with a predefined likelihood, most commonly an isotropic Gaussian, to model the data conditional on latent variables. While convenient for optimization, this choice…

机器学习 · 统计学 2025-04-29 Chen Xu , Qiang Wang , Lijun Sun

Predicting future frames for a video sequence is a challenging generative modeling task. Promising approaches include probabilistic latent variable models such as the Variational Auto-Encoder. While VAEs can handle uncertainty and model…

计算机视觉与模式识别 · 计算机科学 2019-04-30 Lluis Castrejon , Nicolas Ballas , Aaron Courville

Noting the importance of factorizing (or disentangling) the latent space, we propose a novel, non-probabilistic disentangling framework for autoencoders, based on the principles of symmetry transformations in group-theory. To the best of…

机器学习 · 计算机科学 2022-04-14 Jaehoon Cha , Jeyan Thiyagalingam

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. They balance reconstruction and regularizer terms. A variational approximation produces an evidence…

机器学习 · 统计学 2023-12-13 Robert I. Cukier

To address the challenges in learning deep generative models (e.g.,the blurriness of variational auto-encoder and the instability of training generative adversarial networks, we propose a novel deep generative model, named…

机器学习 · 计算机科学 2019-02-26 Shunkang Zhang , Yuan Gao , Yuling Jiao , Jin Liu , Yang Wang , Can Yang

Variational autoencoders (VAEs), as an important aspect of generative models, have received a lot of research interests and reached many successful applications. However, it is always a challenge to achieve the consistency between the…

机器学习 · 计算机科学 2022-05-10 Xiaoyu Chen , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

Variational autoencoders (VAEs) are one class of generative probabilistic latent-variable models designed for inference based on known data. We develop three variations on VAEs by introducing a second parameterized encoder/decoder pair and,…

机器学习 · 计算机科学 2023-04-06 R. I. Cukier

Representation Autoencoders (RAEs) have shown distinct advantages in diffusion modeling on ImageNet by training in high-dimensional semantic latent spaces. In this work, we investigate whether this framework can scale to large-scale,…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Shengbang Tong , Boyang Zheng , Ziteng Wang , Bingda Tang , Nanye Ma , Ellis Brown , Jihan Yang , Rob Fergus , Yann LeCun , Saining Xie

The latent variables learned by VAEs have seen considerable interest as an unsupervised way of extracting features, which can then be used for downstream tasks. There is a growing interest in the question of whether features learned on one…

机器学习 · 计算机科学 2020-05-13 Saeid Asgari Taghanaki , Mohammad Havaei , Alex Lamb , Aditya Sanghi , Ara Danielyan , Tonya Custis

Variational autoencoder (VAE) is a deep generative model for unsupervised learning, allowing to encode observations into the meaningful latent space. VAE is prone to catastrophic forgetting when tasks arrive sequentially, and only the data…

机器学习 · 计算机科学 2021-11-04 Anna Kuzina , Evgenii Egorov , Evgeny Burnaev

The variational autoencoder (VAE) is a powerful generative model that can estimate the probability of a data point by using latent variables. In the VAE, the posterior of the latent variable given the data point is regularized by the prior…

机器学习 · 统计学 2019-12-30 Hiroshi Takahashi , Tomoharu Iwata , Yuki Yamanaka , Masanori Yamada , Satoshi Yagi

Despite advancements in Autoencoders (AEs) for tasks like dimensionality reduction, representation learning and data generation, they remain vulnerable to adversarial attacks. Variational Autoencoders (VAEs), with their probabilistic…

机器学习 · 计算机科学 2024-11-18 Chethan Krishnamurthy Ramanaik , Arjun Roy , Eirini Ntoutsi

A large part of the literature on learning disentangled representations focuses on variational autoencoders (VAE). Recent developments demonstrate that disentanglement cannot be obtained in a fully unsupervised setting without inductive…

机器学习 · 计算机科学 2021-02-11 Graziano Mita , Maurizio Filippone , Pietro Michiardi

Current state-of-the-art generative approaches frequently rely on a two-stage training procedure, where an autoencoder (often a VAE) first performs dimensionality reduction, followed by training a generative model on the learned latent…

机器学习 · 统计学 2025-07-15 Gianluigi Silvestri , Luca Ambrogioni

Variational Autoencoders (VAEs) with global priors trained under an imbalanced empirical class distribution can lead to underrepresentation of tail classes in the latent space. While $t^3$VAE improves robustness via heavy-tailed Student's…

机器学习 · 计算机科学 2026-04-16 Aymene Mohammed Bouayed , Samuel Deslauriers-Gauthier , Adrian Iaccovelli , David Naccache

Generating realistic time series data is important for many engineering and scientific applications. Existing work tackles this problem using generative adversarial networks (GANs). However, GANs are unstable during training, and they can…

机器学习 · 计算机科学 2024-05-14 Ilan Naiman , N. Benjamin Erichson , Pu Ren , Michael W. Mahoney , Omri Azencot

Variational AutoEncoders (VAEs) are powerful generative models that merge elements from statistics and information theory with the flexibility offered by deep neural networks to efficiently solve the generation problem for high dimensional…

机器学习 · 计算机科学 2021-03-02 A. Asperti , D. Evangelista , E. Loli Piccolomini

Variational autoencoders (VAEs) face a notorious problem wherein the variational posterior often aligns closely with the prior, a phenomenon known as posterior collapse, which hinders the quality of representation learning. To mitigate this…

机器学习 · 统计学 2023-10-25 Yuma Ichikawa , Koji Hukushima

A trade-off exists between reconstruction quality and the prior regularisation in the Evidence Lower Bound (ELBO) loss that Variational Autoencoder (VAE) models use for learning. There are few satisfactory approaches to deal with a balance…

机器学习 · 计算机科学 2019-09-10 Shuyu Lin , Stephen Roberts , Niki Trigoni , Ronald Clark

In this paper, we study two aspects of the variational autoencoder (VAE): the prior distribution over the latent variables and its corresponding posterior. First, we decompose the learning of VAEs into layerwise density estimation, and…