English
Related papers

Related papers: Variational Encoders and Autoencoders : Informatio…

200 papers

Graphs are ubiquitous data structures for representing interactions between entities. With an emphasis on the use of graphs to represent chemical molecules, we explore the task of learning to generate graphs that conform to a distribution…

Machine Learning · Computer Science 2019-03-08 Qi Liu , Miltiadis Allamanis , Marc Brockschmidt , Alexander L. Gaunt

In variational autoencoders, the prior on the latent codes $z$ is often treated as an afterthought, but the prior shapes the kind of latent representation that the model learns. If the goal is to learn a representation that is interpretable…

Machine Learning · Computer Science 2018-10-17 Sharad Vikram , Matthew D. Hoffman , Matthew J. Johnson

Machine learning models provide statistically impressive results which might be individually unreliable. To provide reliability, we propose an Epistemic Classifier (EC) that can provide justification of its belief using support from the…

Machine Learning · Computer Science 2020-10-20 Chitresh Bhushan , Zhaoyuan Yang , Nurali Virani , Naresh Iyer

Bayesian analyses combine information represented by different terms in a joint Bayesian model. When one or more of the terms is misspecified, it can be helpful to restrict the use of information from suspect model components to modify…

Methodology · Statistics 2022-06-27 Xuejun Yu , David J. Nott , Michael Stanley Smith

Learning in the latent variable model is challenging in the presence of the complex data structure or the intractable latent variable. Previous variational autoencoders can be low effective due to the straightforward encoder-decoder…

Machine Learning · Computer Science 2018-04-13 Jiangchao Yao , Ivor Tsang , Ya Zhang

Variational Autoencoders are powerful models for unsupervised learning. However deep models with several layers of dependent stochastic variables are difficult to train which limits the improvements obtained using these highly expressive…

Machine Learning · Statistics 2016-05-30 Casper Kaae Sønderby , Tapani Raiko , Lars Maaløe , Søren Kaae Sønderby , Ole Winther

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Many applications, such as text modelling, high-throughput sequencing, and recommender systems, require analysing sparse, high-dimensional, and overdispersed discrete (count-valued or binary) data. Although probabilistic matrix…

Machine Learning · Computer Science 2019-05-27 He Zhao , Piyush Rai , Lan Du , Wray Buntine , Mingyuan Zhou

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

In this paper, we focus on the problem of identifying semantic factors of variation in large image datasets. By training a convolutional Autoencoder on the image data, we create encodings, which describe each datapoint at a higher level of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Ilja Manakov , Volker Tresp

The framework of variational autoencoders (VAEs) provides a principled method for jointly learning latent-variable models and corresponding inference models. However, the main drawback of this approach is the blurriness of the generated…

Machine Learning · Computer Science 2020-07-01 Ioannis Gatopoulos , Maarten Stol , Jakub M. Tomczak

Amortized inference allows latent-variable models trained via variational learning to scale to large datasets. The quality of approximate inference is determined by two factors: a) the capacity of the variational distribution to match the…

Machine Learning · Computer Science 2018-05-29 Chris Cremer , Xuechen Li , David Duvenaud

We introduce an information-theoretic framework that uses variational autoencoders (VAEs) to extract compact, physically interpretable manifolds from high-dimensional flow-field data. To this end, the Kullback--Leibler (KL) divergence in…

Fluid Dynamics · Physics 2026-04-21 Zhiyuan Wang , Iacopo Tirelli , Stefano Discetti , Andrea Ianiro

Variational autoencoders model high-dimensional data by positing low-dimensional latent variables that are mapped through a flexible distribution parametrized by a neural network. Unfortunately, variational autoencoders often suffer from…

Machine Learning · Statistics 2023-01-03 Yixin Wang , David M. Blei , John P. Cunningham

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

We introduce an improved variational autoencoder (VAE) for text modeling with topic information explicitly modeled as a Dirichlet latent variable. By providing the proposed model topic awareness, it is more superior at reconstructing input…

Computation and Language · Computer Science 2018-11-02 Yijun Xiao , Tiancheng Zhao , William Yang Wang

We propose a single neural probabilistic model based on variational autoencoder that can be conditioned on an arbitrary subset of observed features and then sample the remaining features in "one shot". The features may be both real-valued…

Machine Learning · Statistics 2019-07-01 Oleg Ivanov , Michael Figurnov , Dmitry Vetrov

In recent years, machine learning models, chiefly deep neural networks, have revealed suited to learn accurate energy-density functionals from data. However, problematic instabilities have been shown to occur in the search of ground-state…

Computational Physics · Physics 2024-09-26 Emanuele Costa , Giuseppe Scriva , Sebastiano Pilati

Variational inequalities as an effective tool for solving applied problems, including machine learning tasks, have been attracting more and more attention from researchers in recent years. The use of variational inequalities covers a wide…

Optimization and Control · Mathematics 2024-12-20 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing