中文
相关论文

相关论文: Disentanglement Analysis in Deep Latent Variable M…

200 篇论文

Due to the phenomenon of "posterior collapse," current latent variable generative models pose a challenging design choice that either weakens the capacity of the decoder or requires augmenting the objective so it does not only maximize the…

机器学习 · 计算机科学 2019-01-14 Ali Razavi , Aäron van den Oord , Ben Poole , Oriol Vinyals

Deep generative models aim to learn underlying distributions that generate the observed data. Given the fact that the generative distribution may be complex and intractable, deep latent variable models use probabilistic frameworks to learn…

机器学习 · 计算机科学 2021-10-05 Batuhan Koyuncu

While disentangled representations have shown promise in generative modeling and representation learning, their downstream usefulness remains debated. Recent studies re-defined disentanglement through a formal connection to symmetries,…

机器学习 · 计算机科学 2024-11-04 Cristian Meo , Louis Mahon , Anirudh Goyal , Justin Dauwels

Purpose: Handling heterogeneous and mixed data types has become increasingly critical with the exponential growth in real-world databases. While deep generative models attempt to merge diverse data views into a common latent space, they…

Data-driven reduced-order models based on autoencoders generally lack interpretability compared to classical methods such as the proper orthogonal decomposition. More interpretability can be gained by disentangling the latent variables and…

机器学习 · 计算机科学 2025-02-21 Henning Schwarz , Pyei Phyo Lin , Jens-Peter M. Zemke , Thomas Rung

We present a self-supervised method to disentangle factors of variation in high-dimensional data that does not rely on prior knowledge of the underlying variation profile (e.g., no assumptions on the number or distribution of the individual…

机器学习 · 计算机科学 2022-09-23 Eric Yeats , Frank Liu , David Womble , Hai Li

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

计算机视觉与模式识别 · 计算机科学 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Variational autoencoders (VAEs) are widely used deep generative models capable of learning unsupervised latent representations of data. Such representations are often difficult to interpret or control. We consider the problem of…

机器学习 · 计算机科学 2018-12-18 Jack Klys , Jake Snell , Richard Zemel

The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments suggesting the…

机器学习 · 计算机科学 2021-02-16 Dominik Zietlow , Michal Rolinek , Georg Martius

The goal of a classification model is to assign the correct labels to data. In most cases, this data is not fully described by the given set of labels. Often a rich set of meaningful concepts exist in the domain that can much more precisely…

机器学习 · 计算机科学 2021-08-23 Yoeri Poels , Vlado Menkovski

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman

We propose a framework to analyze how multivariate representations disentangle ground-truth generative factors. A quantitative analysis of disentanglement has been based on metrics designed to compare how one variable explains each…

机器学习 · 统计学 2022-02-11 Seiya Tokui , Issei Sato

Variational Autoencoder (VAE), a simple and effective deep generative model, has led to a number of impressive empirical successes and spawned many advanced variants and theoretical investigations. However, recent studies demonstrate that,…

机器学习 · 计算机科学 2019-01-08 Xuezhe Ma , Chunting Zhou , Eduard Hovy

While unsupervised variational autoencoders (VAE) have become a powerful tool in neuroimage analysis, their application to supervised learning is under-explored. We aim to close this gap by proposing a unified probabilistic model for…

机器学习 · 计算机科学 2019-07-15 Qingyu Zhao , Ehsan Adeli , Nicolas Honnorat , Tuo Leng , Kilian M. Pohl

Conflicting objectives present a considerable challenge in interleaving multi-task learning, necessitating the need for meticulous design and balance to ensure effective learning of a representative latent data space across all tasks…

机器学习 · 计算机科学 2025-01-17 Noelle Y. L. Wong , Eng Yeow Cheu , Zhonglin Chiam , Dipti Srinivasan

Among likelihood-based approaches for deep generative modelling, variational autoencoders (VAEs) offer scalable amortized posterior inference and fast sampling. However, VAEs are also more and more outperformed by competing models such as…

机器学习 · 计算机科学 2021-07-01 Antoine Wehenkel , Gilles Louppe

Recent advances in Convolutional Neural Network (CNN) model interpretability have led to impressive progress in visualizing and understanding model predictions. In particular, gradient-based visual attention methods have driven much recent…

计算机视觉与模式识别 · 计算机科学 2020-04-15 Wenqian Liu , Runze Li , Meng Zheng , Srikrishna Karanam , Ziyan Wu , Bir Bhanu , Richard J. Radke , Octavia Camps

Blending of galaxies has a major contribution in the systematic error budget of weak lensing studies, affecting photometric and shape measurements, particularly for ground-based, deep, photometric galaxy surveys, such as the Rubin…

天体物理仪器与方法 · 物理学 2020-10-29 Bastien Arcelin , Cyrille Doux , Eric Aubourg , Cécile Roucelle , The LSST Dark Energy Science Collaboration

The posterior collapse phenomenon in variational autoencoder (VAE), where the variational posterior distribution closely matches the prior distribution, can hinder the quality of the learned latent variables. As a consequence of posterior…

机器学习 · 统计学 2024-05-14 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

The problem of feature disentanglement has been explored in the literature, for the purpose of image and video processing and text analysis. State-of-the-art methods for disentangling feature representations rely on the presence of many…

机器学习 · 计算机科学 2017-11-28 Ershad Banijamali , Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi