English
Related papers

Related papers: not-MIWAE: Deep Generative Modelling with Missing …

200 papers

AI Safety is a major concern in many deep learning applications such as autonomous driving. Given a trained deep learning model, an important natural problem is how to reliably verify the model's prediction. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tong Che , Xiaofeng Liu , Site Li , Yubin Ge , Ruixiang Zhang , Caiming Xiong , Yoshua Bengio

Deep generative networks can simulate from a complex target distribution, by minimizing a loss with respect to samples from that distribution. However, often we do not have direct access to our target distribution - our data may be subject…

The paradigm shift from shallow classifiers with hand-crafted features to end-to-end trainable deep learning models has shown significant improvements on supervised learning tasks. Despite the promising power of deep neural networks (DNN),…

Machine Learning · Computer Science 2017-06-09 Chih-Kuan Yeh , Yao-Hung Hubert Tsai , Yu-Chiang Frank Wang

In this paper, we examine the problem of missing data in high-dimensional datasets by taking into consideration the Missing Completely at Random and Missing at Random mechanisms, as well as theArbitrary missing pattern. Additionally, this…

Artificial Intelligence · Computer Science 2016-07-04 Collins Leke , Tshilidzi Marwala

Random feature latent variable models (RFLVMs) represent the state-of-the-art in latent variable models, capable of handling non-Gaussian likelihoods and effectively uncovering patterns in high-dimensional data. However, their heavy…

Machine Learning · Computer Science 2024-10-24 Ying Li , Zhidi Lin , Yuhao Liu , Michael Minyi Zhang , Pablo M. Olmos , Petar M. Djurić

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani

Generative models play an important role in missing data imputation in that they aim to learn the joint distribution of full data. However, applying advanced deep generative models (such as Diffusion models) to missing data imputation is…

Machine Learning · Computer Science 2025-05-27 Hengrui Zhang , Liancheng Fang , Qitian Wu , Philip S. Yu

We illustrate a class of conditional models for the analysis of longitudinal data suffering attrition in random effects models framework, where the subject-specific random effects are assumed to be discrete and to follow a time-dependent…

Methodology · Statistics 2014-04-28 Antonello Maruotti

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

Machine Learning · Computer Science 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

We consider the problem of estimating the conditional probability distribution of missing values given the observed ones. We propose an approach, which combines the flexibility of deep neural networks with the simplicity of Gaussian mixture…

Machine Learning · Computer Science 2020-11-20 Marcin Przewięźlikowski , Marek Śmieja , Łukasz Struski

Deep Learning (DL) methods have dramatically increased in popularity in recent years. While its initial success was demonstrated in the classification and manipulation of image data, there has been significant growth in the application of…

Machine Learning · Computer Science 2022-06-22 David K. Lim , Naim U. Rashid , Junier B. Oliva , Joseph G. Ibrahim

We propose a deep generative approach to sampling from a conditional distribution based on a unified formulation of conditional distribution and generalized nonparametric regression function using the noise-outsourcing lemma. The proposed…

Statistics Theory · Mathematics 2021-10-22 Xingyu Zhou , Yuling Jiao , Jin Liu , Jian Huang

Likelihood-based, or explicit, deep generative models use neural networks to construct flexible high-dimensional densities. This formulation directly contradicts the manifold hypothesis, which states that observed data lies on a…

Machine Learning · Statistics 2022-11-30 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Jesse C. Cresswell , Anthony L. Caterini

A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic {\em unpooling} is employed to link consecutive layers in the model, yielding…

Computer Vision and Pattern Recognition · Computer Science 2015-12-25 Yunchen Pu , Xin Yuan , Andrew Stevens , Chunyuan Li , Lawrence Carin

In data-driven drug discovery, designing molecular descriptors is a very important task. Deep generative models such as variational autoencoders (VAEs) offer a potential solution by designing descriptors as probabilistic latent vectors…

Machine Learning · Computer Science 2023-08-23 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

There is a growing need for the ability to analyse interval-valued data. However, existing descriptive frameworks to achieve this ignore the process by which interval-valued data are typically constructed; namely by the aggregation of…

Methodology · Statistics 2019-03-08 Xin Zhang , Boris Beranger , Scott A. Sisson

This paper introduces a new latent variable generative model able to handle high dimensional longitudinal data and relying on variational inference. The time dependency between the observations of an input sequence is modelled using…

Machine Learning · Statistics 2023-03-28 Clément Chadebec , Stéphanie Allassonnière

Learning representations that disentangle the underlying factors of variability in data is an intuitive way to achieve generalization in deep models. In this work, we address the scenario where generative factors present a multimodal…

Machine Learning · Statistics 2020-04-07 Javier Antoran , Antonio Miguel

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander