English
Related papers

Related papers: Variational Mixture of Normalizing Flows

200 papers

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

Machine Learning · Statistics 2024-01-24 Shogo Sagawa , Hideitsu Hino

A generative model based on training deep architectures is proposed. The model consists of K networks that are trained together to learn the underlying distribution of a given data set. The process starts with dividing the input data into K…

Machine Learning · Computer Science 2017-02-14 Ershad Banijamali , Ali Ghodsi , Pascal Poupart

Generation of graphs is a major challenge for real-world tasks that require understanding the complex nature of their non-Euclidean structures. Although diffusion models have achieved notable success in graph generation recently, they are…

Machine Learning · Computer Science 2024-06-04 Jaehyeong Jo , Dongki Kim , Sung Ju Hwang

Learning, taking into account full distribution of the data, referred to as generative, is not feasible with deep neural networks (DNNs) because they model only the conditional distribution of the outputs given the inputs. Current solutions…

Machine Learning · Computer Science 2017-09-26 Boris Flach , Alexander Shekhovtsov , Ondrej Fikar

Graph convolutional networks (GCNs) are \emph{discriminative models} that directly model the class posterior $p(y|\mathbf{x})$ for semi-supervised classification of graph data. While being effective, as a representation learning approach,…

Machine Learning · Computer Science 2023-05-30 Tianchun Wang , Farzaneh Mirzazadeh , Xiang Zhang , Jie Chen

A regularized version of Mixture Models is proposed to learn a principal graph from a distribution of $D$-dimensional data points. In the particular case of manifold learning for ridge detection, we assume that the underlying manifold can…

Machine Learning · Computer Science 2023-07-13 Tony Bonnaire , Aurélien Decelle , Nabila Aghanim

This paper presents a general and efficient framework for probabilistic inference and learning from arbitrary uncertain information. It exploits the calculation properties of finite mixture models, conjugate families and factorization. Both…

Artificial Intelligence · Computer Science 2011-05-19 M. C. Garrido , P. E. Lopez-de-Teruel , A. Ruiz

Building on the success of deep learning, two modern approaches to learn a probability model from the data are Generative Adversarial Networks (GANs) and Variational AutoEncoders (VAEs). VAEs consider an explicit probability model for the…

Machine Learning · Computer Science 2019-06-06 Yogesh Balaji , Hamed Hassani , Rama Chellappa , Soheil Feizi

Developments in deep generative models have allowed for tractable learning of high-dimensional data distributions. While the employed learning procedures typically assume that training data is drawn i.i.d. from the distribution of interest,…

Machine Learning · Computer Science 2017-05-24 Ari Seff , Alex Beatson , Daniel Suo , Han Liu

We present a generative model that is defined on finite sets of exchangeable, potentially high dimensional, data. As the architecture is an extension of RealNVPs, it inherits all its favorable properties, such as being invertible and…

Machine Learning · Computer Science 2019-09-09 Kashif Rasul , Ingmar Schuster , Roland Vollgraf , Urs Bergmann

We extend variational autoencoders (VAEs) to collaborative filtering for implicit feedback. This non-linear probabilistic model enables us to go beyond the limited modeling capacity of linear factor models which still largely dominate…

Machine Learning · Statistics 2018-02-19 Dawen Liang , Rahul G. Krishnan , Matthew D. Hoffman , Tony Jebara

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

We propose a new approach to train the Generative Adversarial Nets (GANs) with a mixture of generators to overcome the mode collapsing problem. The main intuition is to employ multiple generators, instead of using a single one as in the…

Machine Learning · Computer Science 2017-10-31 Quan Hoang , Tu Dinh Nguyen , Trung Le , Dinh Phung

Generative flows are promising tractable models for density modeling that define probabilistic distributions with invertible transformations. However, tractability imposes architectural constraints on generative flows, making them less…

Machine Learning · Statistics 2020-07-23 Jianfei Chen , Cheng Lu , Biqi Chenli , Jun Zhu , Tian Tian

Global variational approximation methods in graphical models allow efficient approximate inference of complex posterior distributions by using a simpler model. The choice of the approximating model determines a tradeoff between the…

Artificial Intelligence · Computer Science 2013-01-14 Tal El-Hay , Nir Friedman

Normalizing flows are a class of probabilistic generative models which allow for both fast density computation and efficient sampling and are effective at modelling complex distributions like images. A drawback among current methods is…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jason J. Yu , Konstantinos G. Derpanis , Marcus A. Brubaker

Density deconvolution is the task of estimating a probability density function given only noise-corrupted samples. We can fit a Gaussian mixture model to the underlying density by maximum likelihood if the noise is normally distributed, but…

Machine Learning · Statistics 2020-07-14 Tim Dockhorn , James A. Ritchie , Yaoliang Yu , Iain Murray

Generative Adversarial Networks have become one of the most studied frameworks for unsupervised learning due to their intuitive formulation. They have also been shown to be capable of generating convincing examples in limited domains, such…

Machine Learning · Computer Science 2016-12-14 Daniel Jiwoong Im , He Ma , Chris Dongjoo Kim , Graham Taylor

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

Machine Learning · Computer Science 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas