English
Related papers

Related papers: Closed-Loop Unsupervised Representation Disentangl…

200 papers

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

Continuous speech representations based on Variational Autoencoders (VAEs) have emerged as a promising alternative to traditional spectrogram or discrete token based features for speech generation and reconstruction. Recent research has…

Sound · Computer Science 2026-05-26 Changhao Cheng , Wei Wang , Wangyou Zhang , Dongya Jia , Jian Wu , Zhuo Chen , Yanmin Qian

$\beta$-VAE is a follow-up technique to variational autoencoders that proposes special weighting of the KL divergence term in the VAE loss to obtain disentangled representations. Unsupervised learning is known to be brittle even on toy…

Machine Learning · Computer Science 2022-01-03 Miroslav Fil , Munib Mesinovic , Matthew Morris , Jonas Wildberger

Continuous treatment effect estimation holds significant practical importance across various decision-making and assessment domains, such as healthcare and the military. However, current methods for estimating dose-response curves hinge on…

Machine Learning · Computer Science 2024-06-05 Ruijing Cui , Jianbin Sun , Bingyu He , Kewei Yang , Bingfeng Ge

Variational AutoEncoders (VAEs) provide a means to generate representational latent embeddings. Previous research has highlighted the benefits of achieving representations that are disentangled, particularly for downstream tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

A variational autoencoder (VAE) derived from Tsallis statistics called q-VAE is proposed. In the proposed method, a standard VAE is employed to statistically extract latent space hidden in sampled data, and this latent space helps make…

Machine Learning · Computer Science 2021-08-27 Taisuke Kobayashi

Disentangled representation learning (DRL) aims to break down observed data into core intrinsic factors for a profound understanding of the data. In real-world scenarios, manually defining and labeling these factors are non-trivial, making…

Machine Learning · Computer Science 2024-11-01 Youngjun Jun , Jiwoo Park , Kyobin Choo , Tae Eun Choi , Seong Jae Hwang

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled…

Machine Learning · Computer Science 2020-03-23 Luis A. Pérez Rey

Self-supervised disentangled representation learning is a critical task in sequence modeling. The learnt representations contribute to better model interpretability as well as the data generation, and improve the sample efficiency for…

Machine Learning · Computer Science 2021-10-26 Junwen Bai , Weiran Wang , Carla Gomes

We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent representation that…

Machine Learning · Computer Science 2017-05-25 Diane Bouchacourt , Ryota Tomioka , Sebastian Nowozin

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

Machine Learning · Statistics 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Visual data can be understood at different levels of granularity, where global features correspond to semantic-level information and local features correspond to texture patterns. In this work, we propose a framework, called SPLIT, which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Rujikorn Charakorn , Yuttapong Thawornwattana , Sirawaj Itthipuripat , Nick Pawlowski , Poramate Manoonpong , Nat Dilokthanakul

The ability to extract generative parameters from high-dimensional fields of data in an unsupervised manner is a highly desirable yet unrealized goal in computational physics. This work explores the use of variational autoencoders (VAEs)…

Computational Physics · Physics 2021-11-16 Christian Jacobsen , Karthik Duraisamy

Recent successes in image generation, model-based reinforcement learning, and text-to-image generation have demonstrated the empirical advantages of discrete latent representations, although the reasons behind their benefits remain unclear.…

Machine Learning · Computer Science 2023-07-27 David Friede , Christian Reimers , Heiner Stuckenschmidt , Mathias Niepert

The effective application of representation learning to real-world problems requires both techniques for learning useful representations, and also robust ways to evaluate properties of representations. Recent work in disentangled…

Machine Learning · Computer Science 2020-12-16 Salman Mohammadi , Anders Kirk Uhrenholt , Bjørn Sand Jensen

A large part of the literature on learning disentangled representations focuses on variational autoencoders (VAE). Recent developments demonstrate that disentanglement cannot be obtained in a fully unsupervised setting without inductive…

Machine Learning · Computer Science 2021-02-11 Graziano Mita , Maurizio Filippone , Pietro Michiardi

Disentangled representation learning is one of the major goals of deep learning, and is a key step for achieving explainable and generalizable models. A well-defined theoretical guarantee still lacks for the VAE-based unsupervised methods,…

Machine Learning · Computer Science 2022-03-16 Tao Yang , Xuanchi Ren , Yuwang Wang , Wenjun Zeng , Nanning Zheng

Improving controllability or the ability to manipulate one or more attributes of the generated data has become a topic of interest in the context of deep generative models of music. Recent attempts in this direction have relied on learning…

Sound · Computer Science 2021-08-04 Ashis Pati , Alexander Lerch

While deep generative models have significantly advanced representation learning, they may inherit or amplify biases and fairness issues by encoding sensitive attributes alongside predictive features. Enforcing strict independence in…

Machine Learning · Computer Science 2025-11-18 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen

Distributed learning and Edge AI necessitate efficient data processing, low-latency communication, decentralized model training, and stringent data privacy to facilitate real-time intelligence on edge devices while reducing dependency on…

Machine Learning · Computer Science 2025-07-08 Lucas Heublein , Simon Kocher , Tobias Feigl , Alexander Rügamer , Christopher Mutschler , Felix Ott