English
Related papers

Related papers: Fully Bayesian Autoencoders with Latent Sparse Gau…

200 papers

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

We propose a topic-guided variational autoencoder (TGVAE) model for text generation. Distinct from existing variational autoencoder (VAE) based approaches, which assume a simple Gaussian prior for the latent code, our model specifies the…

Computation and Language · Computer Science 2019-03-19 Wenlin Wang , Zhe Gan , Hongteng Xu , Ruiyi Zhang , Guoyin Wang , Dinghan Shen , Changyou Chen , Lawrence Carin

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

Machine Learning · Statistics 2023-05-29 Yixiu Zhao , Scott W. Linderman

This paper introduces a new interpretation of the Variational Autoencoder framework by taking a fully geometric point of view. We argue that vanilla VAE models unveil naturally a Riemannian structure in their latent space and that taking…

Machine Learning · Statistics 2022-11-04 Clément Chadebec , Stéphanie Allassonnière

Sparse Gaussian processes and various extensions thereof are enabled through inducing points, that simultaneously bottleneck the predictive capacity and act as the main contributor towards model complexity. However, the number of inducing…

Machine Learning · Computer Science 2021-07-27 Anders Kirk Uhrenholt , Valentin Charvet , Bjørn Sand Jensen

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

Variational inference is a powerful tool for approximate inference, and it has been recently applied for representation learning with deep generative models. We develop the variational Gaussian process (VGP), a Bayesian nonparametric…

Machine Learning · Statistics 2016-04-19 Dustin Tran , Rajesh Ranganath , David M. Blei

Multiple modalities often co-occur when describing natural phenomena. Learning a joint representation of these modalities should yield deeper and more useful representations. Previous generative approaches to multi-modal input either do not…

Machine Learning · Computer Science 2018-11-13 Mike Wu , Noah Goodman

Recent advances in generative AI offer promising solutions for synthetic data generation but often rely on large datasets for effective training. To address this limitation, we propose a novel generative model that learns from limited data…

Machine Learning · Statistics 2025-05-27 Michail Spitieris , Massimiliano Ruocco , Abdulmajid Murad , Alessandro Nocente

Generative models of graphs are well-known, but many existing models are limited in scalability and expressivity. We present a novel sequential graphical variational autoencoder operating directly on graphical representations of data. In…

Machine Learning · Computer Science 2019-12-18 Bowen Jing , Ethan A. Chi , Jillian Tang

Hierarchical probabilistic models, such as Gaussian mixture models, are widely used for unsupervised learning tasks. These models consist of observable and latent variables, which represent the observable data and the underlying…

Machine Learning · Statistics 2015-03-26 Keisuke Yamazaki

Recent advances in deep learning have shown their ability to learn strong feature representations for images. The task of image clustering naturally requires good feature representations to capture the distribution of the data and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Vignesh Prasad , Dipanjan Das , Brojeshwar Bhowmick

While much research effort has been dedicated to scaling up sparse Gaussian process (GP) models based on inducing variables for big data, little attention is afforded to the other less explored class of low-rank GP approximations that…

Machine Learning · Statistics 2016-11-21 Quang Minh Hoang , Trong Nghia Hoang , Kian Hsiang Low

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

We extend Stochastic Gradient Variational Bayes to perform posterior inference for the weights of Stick-Breaking processes. This development allows us to define a Stick-Breaking Variational Autoencoder (SB-VAE), a Bayesian nonparametric…

Machine Learning · Statistics 2017-04-05 Eric Nalisnick , Padhraic Smyth

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks…

Machine Learning · Computer Science 2018-10-15 Yin Cheng Ng , Nicolo Colombo , Ricardo Silva

Extracting insight from the enormous quantity of data generated from molecular simulations requires the identification of a small number of collective variables whose corresponding low-dimensional free-energy landscape retains the essential…

Chemical Physics · Physics 2019-12-30 Yasemin Bozkurt Varolgunes , Tristan Bereau , Joseph F. Rudzinski

Multivariate categorical data occur in many applications of machine learning. One of the main difficulties with these vectors of categorical variables is sparsity. The number of possible observations grows exponentially with vector length,…

Machine Learning · Statistics 2015-03-10 Yarin Gal , Yutian Chen , Zoubin Ghahramani

Longitudinal datasets measured repeatedly over time from individual subjects, arise in many biomedical, psychological, social, and other studies. A common approach to analyse high-dimensional data that contains missing values is to learn a…

Machine Learning · Statistics 2021-04-21 Siddharth Ramchandran , Gleb Tikhonov , Kalle Kujanpää , Miika Koskinen , Harri Lähdesmäki

Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide…

Machine Learning · Computer Science 2022-04-29 Rohitash Chandra , Mahir Jain , Manavendra Maharana , Pavel N. Krivitsky