English
Related papers

Related papers: Disentanglement Challenge: From Regularization to …

200 papers

Latent confounders are a fundamental challenge for inferring causal effects from observational data. The instrumental variable (IV) approach is a practical way to address this challenge. Existing IV based estimators need a known IV or other…

Machine Learning · Computer Science 2024-12-09 Debo Cheng , Jiuyong Li , Lin Liu , Ziqi Xu , Weijia Zhang , Jixue Liu , Thuc Duy Le

We propose a novel and theoretical model, blocked and hierarchical variational autoencoder (BHiVAE), to get better-disentangled representation. It is well known that information theory has an excellent explanatory meaning for the network,…

Information Theory · Computer Science 2021-01-22 Ziwen Liu , Mingqiang Li , Congying Han

Researching bragging behavior on social media arouses interest of computational (socio) linguists. However, existing bragging classification datasets suffer from a serious data imbalance issue. Because labeling a data-balance dataset is…

Computation and Language · Computer Science 2022-10-28 Xiang Li , Yucheng Zhou

Recently there has been a significant interest in learning disentangled representations, as they promise increased interpretability, generalization to unseen scenarios and faster learning on downstream tasks. In this paper, we investigate…

Machine Learning · Computer Science 2019-10-30 Francesco Locatello , Gabriele Abbati , Tom Rainforth , Stefan Bauer , Bernhard Schölkopf , Olivier Bachem

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

Finding disentangled representation plays a predominant role in the success of modern deep learning applications, but the results lack a straightforward explanation. Here we apply the information bottleneck method and its $\beta$-VAE…

Strongly Correlated Electrons · Physics 2022-07-01 Dongchen Huang , Danqing Hu , Yi-feng Yang

A disentangled representation encodes information about the salient factors of variation in the data independently. Although it is often argued that this representational format is useful in learning to solve many real-world down-stream…

Machine Learning · Computer Science 2020-01-08 Sjoerd van Steenkiste , Francesco Locatello , Jürgen Schmidhuber , Olivier Bachem

The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments suggesting the…

Machine Learning · Computer Science 2021-02-16 Dominik Zietlow , Michal Rolinek , Georg Martius

We propose a novel approach to disentangle the generative factors of variation underlying a given set of observations. Our method builds upon the idea that the (unknown) low-dimensional manifold underlying the data space can be explicitly…

Machine Learning · Computer Science 2021-10-05 Marco Fumero , Luca Cosmo , Simone Melzi , Emanuele Rodolà

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In…

Machine Learning · Computer Science 2023-06-01 Lilian Ngweta , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

This report to our stage 2 submission to the NeurIPS 2019 disentanglement challenge presents a simple image preprocessing method for learning disentangled latent factors. We propose to train a variational autoencoder on regionally…

Machine Learning · Computer Science 2020-11-18 Maximilian Seitzer , Andreas Foltyn , Felix P. Kemeth

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

Machine Learning · Computer Science 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

The problem of fair classification can be mollified if we develop a method to remove the embedded sensitive information from the classification features. This line of separating the sensitive information is developed through the causal…

Machine Learning · Computer Science 2020-12-10 Hyemi Kim , Seungjae Shin , JoonHo Jang , Kyungwoo Song , Weonyoung Joo , Wanmo Kang , Il-Chul Moon

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on…

Machine Learning · Computer Science 2025-10-08 Hedi Zisling , Ilan Naiman , Nimrod Berman , Supasorn Suwajanakorn , Omri Azencot

There have been many recent advances in representation learning; however, unsupervised representation learning can still struggle with model identification issues related to rotations of the latent space. Variational Auto-Encoders (VAEs)…

Machine Learning · Computer Science 2021-10-29 Travers Rhodes , Daniel D. Lee

Paradoxically, a Variational Autoencoder (VAE) could be pushed in two opposite directions, utilizing powerful decoder model for generating realistic images but collapsing the learned representation, or increasing regularization coefficient…

Machine Learning · Computer Science 2022-03-30 Trung Ngo , Najwa Laabid , Ville Hautamäki , Merja Heinäniemi

Cross-domain disentanglement is the problem of learning representations partitioned into domain-invariant and domain-specific representations, which is a key to successful domain transfer or measuring semantic distance between two domains.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 HyeongJoo Hwang , Geon-Hyeong Kim , Seunghoon Hong , Kee-Eung Kim

Recently, the standard variational autoencoder has been successfully used to learn a probabilistic prior over speech signals, which is then used to perform speech enhancement. Variational autoencoders have then been conditioned on a label…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Guillaume Carbajal , Julius Richter , Timo Gerkmann

We construct an unsupervised learning model that achieves nonlinear disentanglement of underlying factors of variation in naturalistic videos. Previous work suggests that representations can be disentangled if all but a few factors in the…

Disentangled representation learning aims to extract explanatory features or factors and retain salient information. Factorized hierarchical variational autoencoder (FHVAE) presents a way to disentangle a speech signal into sequential-level…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Yuying Xie , Thomas Arildsen , Zheng-Hua Tan