English
Related papers

Related papers: Disentangling Interpretable Generative Parameters …

200 papers

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

Representing graph data in a low-dimensional space for subsequent tasks is the purpose of attributed graph embedding. Most existing neural network approaches learn latent representations by minimizing reconstruction errors. Rare work…

Machine Learning · Computer Science 2024-01-15 Bozhen Hu , Zelin Zang , Jun Xia , Lirong Wu , Cheng Tan , Stan Z. Li

Semi-implicit graph variational auto-encoder (SIG-VAE) is proposed to expand the flexibility of variational graph auto-encoders (VGAE) to model graph data. SIG-VAE employs a hierarchical variational framework to enable neighboring node…

Machine Learning · Computer Science 2020-04-23 Arman Hasanzadeh , Ehsan Hajiramezanali , Nick Duffield , Krishna R. Narayanan , Mingyuan Zhou , Xiaoning Qian

The performance of $\beta$-Variational-Autoencoders ($\beta$-VAEs) and their variants on learning semantically meaningful, disentangled representations is unparalleled. On the other hand, there are theoretical arguments suggesting the…

Machine Learning · Computer Science 2021-02-16 Dominik Zietlow , Michal Rolinek , Georg Martius

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

Machine Learning · Computer Science 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing. Currently, most disentanglement methods are unsupervised…

Computation and Language · Computer Science 2023-02-17 Danilo S. Carvalho , Giangiacomo Mercatali , Yingji Zhang , Andre Freitas

Latent traversal is a popular approach to visualize the disentangled latent representations. Given a bunch of variations in a single unit of the latent representation, it is expected that there is a change in a single factor of variation of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Dacheng Tao

The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and…

Machine Learning · Computer Science 2023-09-26 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Generative models of graphs are well-known, but many existing models are limited in scalability and expressivity. We present a novel sequential graphical variational autoencoder operating directly on graphical representations of data. In…

Machine Learning · Computer Science 2019-12-18 Bowen Jing , Ethan A. Chi , Jillian Tang

Learning precise representations of users and items to fit observed interaction data is the fundamental task of collaborative filtering. Existing studies usually infer entangled representations to fit such interaction data, neglecting to…

Information Retrieval · Computer Science 2024-01-11 Zhiqiang Guo , Guohui Li , Jianjun Li , Chaoyang Wang , Si Shi

The ability to record activities from hundreds of neurons simultaneously in the brain has placed an increasing demand for developing appropriate statistical techniques to analyze such data. Recently, deep generative models have been…

Machine Learning · Statistics 2020-11-11 Ding Zhou , Xue-Xin Wei

In data-driven drug discovery, designing molecular descriptors is a very important task. Deep generative models such as variational autoencoders (VAEs) offer a potential solution by designing descriptors as probabilistic latent vectors…

Machine Learning · Computer Science 2023-08-23 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

In disentangled representation learning, the goal is to achieve a compact representation that consists of all interpretable generative factors in the observational data. Learning disentangled representations for graphs becomes increasingly…

Machine Learning · Computer Science 2023-11-20 Jingyun Feng , Lin Zhang , Lili Yang

Many real-world datasets can be divided into groups according to certain salient features (e.g. grouping images by subject, grouping text by font, etc.). Often, machine learning tasks require that these features be represented separately…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-16 Dan Andrei Iliescu , Aliaksei Mikhailiuk , Damon Wischik , Rafal Mantiuk

Modern generative models are usually designed to match target distributions directly in the data space, where the intrinsic dimension of data can be much lower than the ambient dimension. We argue that this discrepancy may contribute to the…

Machine Learning · Computer Science 2020-07-02 Zijun Zhang , Ruixiang Zhang , Zongpeng Li , Yoshua Bengio , Liam Paull

Sensory data are often comprised of independent content and transformation factors. For example, face images may have shapes as content and poses as transformation. To infer separately these factors from given data, various…

Machine Learning · Computer Science 2021-01-26 Haruo Hosoya

Models of human motion commonly focus either on trajectory prediction or action classification but rarely both. The marked heterogeneity and intricate compositionality of human motion render each task vulnerable to the data degradation and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Anthony Bourached , Robert Gray , Xiaodong Guan , Ryan-Rhys Griffiths , Ashwani Jha , Parashkev Nachev

Controllable data generation aims to synthesize data by specifying values for target concepts. Achieving this reliably requires modeling the underlying generative factors and their relationships. In real-world scenarios, these factors…

Machine Learning · Computer Science 2025-11-21 Qilong Zhao , Shiyu Wang , Zeeshan Memon , Yang Qiao , Guangji Bai , Bo Pan , Zhaohui Qin , Liang Zhao