English
Related papers

Related papers: On Disentanglement in Gaussian Process Variational…

200 papers

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical…

Machine Learning · Computer Science 2023-06-02 Stathi Fotiadis , Mario Lino , Shunlong Hu , Stef Garasto , Chris D Cantwell , Anil Anthony Bharath

Autoencoders exhibit impressive abilities to embed the data manifold into a low-dimensional latent space, making them a staple of representation learning methods. However, without explicit supervision, which is often unavailable, the…

Machine Learning · Computer Science 2023-01-12 Felix Leeb , Stefan Bauer , Michel Besserve , Bernhard Schölkopf

This paper proposes a new high dimensional regression method by merging Gaussian process regression into a variational autoencoder framework. In contrast to other regression methods, the proposed method focuses on the case where output…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 YoungJoon Yoo , Sangdoo Yun , Hyung Jin Chang , Yiannis Demiris , Jin Young Choi

As we enter the era of machine learning characterized by an overabundance of data, discovery, organization, and interpretation of the data in an unsupervised manner becomes a critical need. One promising approach to this endeavour is the…

Machine Learning · Computer Science 2022-10-24 Vaishnavi Patil , Matthew Evanusa , Joseph JaJa

Disentangled learning representations have promising utility in many applications, but they currently suffer from serious reliability issues. We present Gaussian Channel Autoencoder (GCAE), a method which achieves reliable disentanglement…

Machine Learning · Computer Science 2023-02-10 Eric Yeats , Frank Liu , Hai Li

Sensory data are often comprised of independent content and transformation factors. For example, face images may have shapes as content and poses as transformation. To infer separately these factors from given data, various…

Machine Learning · Computer Science 2021-01-26 Haruo Hosoya

Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner. A number of recent efforts have focused on learning representations that disentangle statistically independent axes of variation by…

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

Deep generative models like variational autoencoders approximate the intrinsic geometry of high dimensional data manifolds by learning low-dimensional latent-space variables and an embedding function. The geometric properties of these…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Ankita Shukla , Shagun Uppal , Sarthak Bhagat , Saket Anand , Pavan Turaga

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

We present a framework for learning disentangled and interpretable jointly continuous and discrete representations in an unsupervised manner. By augmenting the continuous latent distribution of variational autoencoders with a relaxed…

Machine Learning · Statistics 2018-10-23 Emilien Dupont

A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a disentangled…

Machine Learning · Computer Science 2020-03-23 Luis A. Pérez Rey

The process of generating data such as images is controlled by independent and unknown factors of variation. The retrieval of these variables has been studied extensively in the disentanglement, causal representation learning, and…

Machine Learning · Computer Science 2023-09-26 Gaël Gendron , Michael Witbrock , Gillian Dobbie

We propose a sequential variational autoencoder to learn disentangled representations of sequential data (e.g., videos and audios) under self-supervision. Specifically, we exploit the benefits of some readily accessible supervisory signals…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yizhe Zhu , Martin Renqiang Min , Asim Kadav , Hans Peter Graf

This work studies the problem of modeling visual processes by leveraging deep generative architectures for learning linear, Gaussian representations from observed sequences. We propose a joint learning framework, combining a vector…

Neural and Evolutionary Computing · Computer Science 2020-04-13 Alexander Sagel , Hao Shen

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Existing methods for multi-modal time series representation learning aim to disentangle the modality-shared and modality-specific latent variables. Although achieving notable performances on downstream tasks, they usually assume an…

Machine Learning · Computer Science 2024-05-28 Ruichu Cai , Zhifang Jiang , Zijian Li , Weilin Chen , Xuexin Chen , Zhifeng Hao , Yifan Shen , Guangyi Chen , Kun Zhang

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Disentanglement is a highly desirable property of representation due to its similarity with human's understanding and reasoning. This improves interpretability, enables the performance of down-stream tasks, and enables controllable…

Machine Learning · Computer Science 2020-10-24 Jiantao Wu , Lin Wang

Learning Interpretable representation in medical applications is becoming essential for adopting data-driven models into clinical practice. It has been recently shown that learning a disentangled feature representation is important for a…

Machine Learning · Computer Science 2019-04-19 Mhd Hasan Sarhan , Abouzar Eslami , Nassir Navab , Shadi Albarqouni