English
Related papers

Related papers: Evaluating unsupervised disentangled representatio…

200 papers

Disentangled representation learning (DRL) aims to identify and decompose underlying factors behind observations, thus facilitating data perception and generation. However, current DRL approaches often rely on the unrealistic assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Baao Xie , Qiuyu Chen , Yunnan Wang , Zequn Zhang , Xin Jin , Wenjun Zeng

Fair and unbiased machine learning is an important and active field of research, as decision processes are increasingly driven by models that learn from data. Unfortunately, any biases present in the data may be learned by the model,…

Machine Learning · Computer Science 2020-02-27 Matthew J. Vowels , Necati Cihan Camgoz , Richard Bowden

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve…

Machine Learning · Computer Science 2023-02-27 Nao Nakagawa , Ren Togo , Takahiro Ogawa , Miki Haseyama

For personalized medicines, very crucial intrinsic information is present in high dimensional omics data which is difficult to capture due to the large number of molecular features and small number of available samples. Different types of…

Machine Learning · Computer Science 2022-02-04 Sayed Hashim , Muhammad Ali , Karthik Nandakumar , Mohammad Yaqub

We view disentanglement learning as discovering an underlying structure that equivariantly reflects the factorized variations shown in data. Traditionally, such a structure is fixed to be a vector space with data variations represented by…

Machine Learning · Computer Science 2021-06-08 Xinqi Zhu , Chang Xu , Dacheng Tao

This paper describes InfoCatVAE, an extension of the variational autoencoder that enables unsupervised disentangled representation learning. InfoCatVAE uses multimodal distributions for the prior and the inference network and then maximizes…

Machine Learning · Computer Science 2018-06-26 Edouard Pineau , Marc Lelarge

User behavior data in recommender systems are driven by the complex interactions of many latent factors behind the users' decision making processes. The factors are highly entangled, and may range from high-level ones that govern user…

Machine Learning · Computer Science 2019-11-01 Jianxin Ma , Chang Zhou , Peng Cui , Hongxia Yang , Wenwu Zhu

Learning a disentangled, interpretable, and structured latent representation in 3D generative models of faces and bodies is still an open problem. The problem is particularly acute when control over identity features is required. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Simone Foti , Bongjin Koo , Danail Stoyanov , Matthew J. Clarkson

The Variational Autoencoder (VAE) is a seminal approach in deep generative modeling with latent variables. Interpreting its reconstruction process as a nonlinear transformation of samples from the latent posterior distribution, we apply the…

Machine Learning · Computer Science 2023-06-09 Faris Janjoš , Lars Rosenbaum , Maxim Dolgov , J. Marius Zöllner

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

Machine Learning · Computer Science 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

As an important problem in causal inference, we discuss the identification and estimation of treatment effects (TEs) under limited overlap; that is, when subjects with certain features belong to a single treatment group. We use a latent…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu

Variational Autoencoders (VAE) and their variants have been widely used in a variety of applications, such as dialog generation, image generation and disentangled representation learning. However, the existing VAE models have some…

Machine Learning · Computer Science 2020-06-23 Huajie Shao , Shuochao Yao , Dachun Sun , Aston Zhang , Shengzhong Liu , Dongxin Liu , Jun Wang , Tarek Abdelzaher

We propose a family of novel hierarchical Bayesian deep auto-encoder models capable of identifying disentangled factors of variability in data. While many recent attempts at factor disentanglement have focused on sophisticated learning…

Machine Learning · Computer Science 2019-09-10 Minyoung Kim , Yuting Wang , Pritish Sahu , Vladimir Pavlovic

Physical imaging is a foundational characterization method in areas from condensed matter physics and chemistry to astronomy and spans length scales from atomic to universe. Images encapsulate crucial data regarding atomic bonding,…

This is a tutorial and survey paper on factor analysis, probabilistic Principal Component Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods, which are tightly related, are dimensionality reduction and…

Machine Learning · Statistics 2022-05-25 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Recommendation models are typically trained on observational user interaction data, but the interactions between latent factors in users' decision-making processes lead to complex and entangled data. Disentangling these latent factors to…

Information Retrieval · Computer Science 2023-04-18 Siyu Wang , Xiaocong Chen , Quan Z. Sheng , Yihong Zhang , Lina Yao

Despite the success in learning semantically meaningful, unsupervised disentangled representations, variational autoencoders (VAEs) and their variants face a fundamental theoretical challenge: substantial evidence indicates that…

Machine Learning · Computer Science 2025-06-02 Zihao Chen , Yu Xiang , Wenyong Wang

Pan-cancer classification using transcriptomic (RNA-Seq) data can inform tumor subtyping and therapy selection, but is challenging due to extremely high dimensionality and limited sample sizes. In this study, we propose a novel deep…

Genomics · Quantitative Biology 2025-08-06 Vinil Polepalli

Deep latent variable models (DLVMs) are designed to learn meaningful representations in an unsupervised manner, such that the hidden explanatory factors are interpretable by independent latent variables (aka disentanglement). The…

Machine Learning · Computer Science 2025-01-28 Surojit Saha , Sarang Joshi , Ross Whitaker