English
Related papers

Related papers: Simpler is better: spectral regularization and up-…

200 papers

Generative AutoEncoders require a chosen probability distribution in latent space, usually multivariate Gaussian. The original Variational AutoEncoder (VAE) uses randomness in encoder - causing problematic distortion, and overlaps in latent…

Machine Learning · Computer Science 2019-01-15 Jarek Duda

We introduce a Three-Dimensional Convolutional Variational Autoencoder (3D-CVAE) for automated anomaly detection in Electron Energy Loss Spectroscopy Spectrum Imaging (EELS-SI) data. Our approach leverages the full three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Seyfal Sultanov , James P Buban , Robert F Klie

Deep generative models are attracting great attention as a new promising approach for molecular design. All models reported so far are based on either variational autoencoder (VAE) or generative adversarial network (GAN). Here we propose a…

Chemical Physics · Physics 2019-12-13 Seung Hwan Hong , Jaechang Lim , Seongok Ryu , Woo Youn Kim

Deep learning on graphs has become a popular research topic with many applications. However, past work has concentrated on learning graph embedding tasks, which is in contrast with advances in generative models for images and text. Is it…

Machine Learning · Computer Science 2018-02-13 Martin Simonovsky , Nikos Komodakis

Colorization is an ambiguous problem, with multiple viable colorizations for a single grey-level image. However, previous methods only produce the single most probable colorization. Our goal is to model the diversity intrinsic to the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Aditya Deshpande , Jiajun Lu , Mao-Chuang Yeh , Min Jin Chong , David Forsyth

Image compression has been investigated for many decades. Recently, deep learning approaches have achieved a great success in many computer vision tasks, and are gradually used in image compression. In this paper, we develop three overall…

Image and Video Processing · Electrical Eng. & Systems 2018-07-03 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Variational Autoencoders (VAEs) have experienced recent success as data-generating models by using simple architectures that do not require significant fine-tuning of hyperparameters. However, VAEs are known to suffer from…

Machine Learning · Statistics 2020-07-22 Wei Cheng , Gregory Darnell , Sohini Ramachandran , Lorin Crawford

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Modern generative models are usually designed to match target distributions directly in the data space, where the intrinsic dimension of data can be much lower than the ambient dimension. We argue that this discrepancy may contribute to the…

Machine Learning · Computer Science 2020-07-02 Zijun Zhang , Ruixiang Zhang , Zongpeng Li , Yoshua Bengio , Liam Paull

Researchers have applied deep neural networks to image restoration tasks, in which they proposed various network architectures, loss functions, and training methods. In particular, adversarial training, which is employed in recent studies,…

Neural and Evolutionary Computing · Computer Science 2018-03-02 Masanori Suganuma , Mete Ozay , Takayuki Okatani

The variational autoencoder (VAE) framework is a popular option for training unsupervised generative models, featuring ease of training and latent representation of data. The objective function of VAE does not guarantee to achieve the…

Machine Learning · Computer Science 2019-04-25 Jason Chou

We propose the Wasserstein Auto-Encoder (WAE)---a new algorithm for building a generative model of the data distribution. WAE minimizes a penalized form of the Wasserstein distance between the model distribution and the target distribution,…

Machine Learning · Statistics 2019-12-06 Ilya Tolstikhin , Olivier Bousquet , Sylvain Gelly , Bernhard Schoelkopf

Variational Autoencoders (VAEs) have become a popular approach for dimensionality reduction. However, despite their ability to identify latent low-dimensional structures embedded within high-dimensional data, these latent representations…

Machine Learning · Statistics 2020-08-27 Kaspar Märtens , Christopher Yau

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

Deep Learning based methods have emerged as the indisputable leaders for virtually all image restoration tasks. Especially in the domain of microscopy images, various content-aware image restoration (CARE) approaches are now used to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Mangal Prakash , Alexander Krull , Florian Jug

Invertible flow-based generative models are an effective method for learning to generate samples, while allowing for tractable likelihood computation and inference. However, the invertibility requirement restricts models to have the same…

Machine Learning · Computer Science 2020-02-21 Abhishek Kumar , Ben Poole , Kevin Murphy

Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the…

Signal Processing · Electrical Eng. & Systems 2023-12-07 Michael Baur , Franz Weißer , Benedikt Böck , Wolfgang Utschick

User attributes, such as gender and education, face severe incompleteness in social networks. In order to make this kind of valuable data usable for downstream tasks like user profiling and personalized recommendation, attribute inference…

Machine Learning · Computer Science 2021-06-01 Yadong Zhou , Zhihao Ding , Xiaoming Liu , Chao Shen , Lingling Tong , Xiaohong Guan

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

Machine Learning · Computer Science 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun