English
Related papers

Related papers: Variational Search Distributions

200 papers

We introduce a family of multitask variational methods for semi-supervised sequence labeling. Our model family consists of a latent-variable generative model and a discriminative labeler. The generative models use latent variables to define…

Computation and Language · Computer Science 2019-06-25 Mingda Chen , Qingming Tang , Karen Livescu , Kevin Gimpel

We propose a discrete latent distribution for Generative Adversarial Networks (GANs). Instead of drawing latent vectors from a continuous prior, we sample from a finite set of learnable latents. However, a direct parametrization of such a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Evangelos Ntavelis , Mohamad Shahbazi , Iason Kastanis , Radu Timofte , Martin Danelljan , Luc Van Gool

We develop an approach to training generative models based on unrolling a variational auto-encoder into a Markov chain, and shaping the chain's trajectories using a technique inspired by recent work in Approximate Bayesian computation. We…

Machine Learning · Computer Science 2017-08-03 Philip Bachman , Doina Precup

We propose in this work RBM-SVGD, a stochastic version of Stein Variational Gradient Descent (SVGD) method for efficiently sampling from a given probability measure and thus useful for Bayesian inference. The method is to apply the Random…

Machine Learning · Statistics 2020-06-24 Lei Li , Yingzhou Li , Jian-Guo Liu , Zibu Liu , Jianfeng Lu

Developments in deep generative models have allowed for tractable learning of high-dimensional data distributions. While the employed learning procedures typically assume that training data is drawn i.i.d. from the distribution of interest,…

Machine Learning · Computer Science 2017-05-24 Ari Seff , Alex Beatson , Daniel Suo , Han Liu

We present a conditional generative model to learn variation in cell and nuclear morphology and the location of subcellular structures from microscopy images. Our model generalizes to a wide range of subcellular localization and allows for…

Machine Learning · Statistics 2017-05-02 Gregory R. Johnson , Rory M. Donovan-Maiye , Mary M. Maleckar

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

Latent world models allow agents to reason about complex environments with high-dimensional observations. However, adapting to new environments and effectively leveraging previous knowledge remain significant challenges. We present…

Machine Learning · Computer Science 2022-06-23 Anson Lei , Bernhard Schölkopf , Ingmar Posner

We consider the problem of learning deep generative models from data. We formulate a method that generates an independent sample via a single feedforward pass through a multilayer perceptron, as in the recently proposed generative…

Machine Learning · Computer Science 2015-02-11 Yujia Li , Kevin Swersky , Richard Zemel

Diffusion probabilistic models have achieved enormous success in the field of image generation and manipulation. In this paper, we explore a novel paradigm of using the diffusion model and classifier guidance in the latent semantic space…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Changhao Shi , Haomiao Ni , Kai Li , Shaobo Han , Mingfu Liang , Martin Renqiang Min

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

We present the Variational Adaptive Newton (VAN) method which is a black-box optimization method especially suitable for explorative-learning tasks such as active learning and reinforcement learning. Similar to Bayesian methods, VAN…

Machine Learning · Statistics 2017-11-16 Mohammad Emtiyaz Khan , Wu Lin , Voot Tangkaratt , Zuozhu Liu , Didrik Nielsen

In recent years the scientific community has devoted much effort in the development of deep learning models for the generation of new molecules with desirable properties (i.e. drugs). This has produced many proposals in literature. However,…

Machine Learning · Computer Science 2020-08-24 Davide Rigoni , Nicolò Navarin , Alessandro Sperduti

We investigate an application in the automatic tuning of computer codes, an area of research that has come to prominence alongside the recent rise of distributed scientific processing and heterogeneity in high-performance computing…

Applications · Statistics 2013-04-17 Robert B. Gramacy , Matt Taddy , Stefan M. Wild

Neural network based generative models with discriminative components are a powerful approach for semi-supervised learning. However, these techniques a) cannot account for model uncertainty in the estimation of the model's discriminative…

Machine Learning · Statistics 2017-06-30 Jonathan Gordon , José Miguel Hernández-Lobato

Molecular design and synthesis planning are two critical steps in the process of molecular discovery that we propose to formulate as a single shared task of conditional synthetic pathway generation. We report an amortized approach to…

Machine Learning · Computer Science 2022-03-15 Wenhao Gao , Rocío Mercado , Connor W. Coley

Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tianyi Chu , Wei Xing , Jiafu Chen , Zhizhong Wang , Jiakai Sun , Lei Zhao , Haibo Chen , Huaizhong Lin

In materials science, the challenge of rapid prototyping materials with desired properties often involves extensive experimentation to find suitable microstructures. Additionally, finding microstructures for given properties is typically an…

Machine Learning · Computer Science 2024-05-22 Sébastien Bompas , Stefan Sandfeld

Solving high-dimensional Bayesian inverse problems (BIPs) with the variational inference (VI) method is promising but still challenging. The main difficulties arise from two aspects. First, VI methods approximate the posterior distribution…

Numerical Analysis · Mathematics 2023-02-23 Yingzhi Xia , Qifeng Liao , Jinglai Li

Given a probability distribution $\mu$ in $\mathbb{R}^d$ represented by data, we study in this paper the generative modeling of the corresponding conditional probability distributions on the level-sets of a collective variable…

Machine Learning · Statistics 2026-03-30 Fatima-Zahrae Akhyar , Wei Zhang , Gabriel Stoltz , Christof Schütte