English
Related papers

Related papers: Learning Deep Energy Models: Contrastive Divergenc…

200 papers

The accuracy of the information that can be extracted from electron diffraction patterns is often limited by the presence of optical distortions. Existing distortion characterization techniques typically require knowledge of the reciprocal…

Generative moment matching network (GMMN) is a deep generative model that differs from Generative Adversarial Network (GAN) by replacing the discriminator in GAN with a two-sample test based on kernel maximum mean discrepancy (MMD).…

Machine Learning · Computer Science 2017-11-28 Chun-Liang Li , Wei-Cheng Chang , Yu Cheng , Yiming Yang , Barnabás Póczos

Determining the stability of chemical compounds is essential for advancing material discovery. In this study, we introduce a novel deep neural network model designed to predict a crystal's formation energy, which identifies its stability…

Materials Science · Physics 2026-04-21 V. Torlao , E. A. Fajardo

We propose a new active learning by query synthesis approach using Generative Adversarial Networks (GAN). Different from regular active learning, the resulting algorithm adaptively synthesizes training instances for querying to increase…

Machine Learning · Computer Science 2017-11-17 Jia-Jie Zhu , José Bento

We present a deep learning model for data-driven simulations of random dynamical systems without a distributional assumption. The deep learning model consists of a recurrent neural network, which aims to learn the time marching structure,…

Machine Learning · Computer Science 2022-04-12 Kyongmin Yeo , Zan Li , Wesley M. Gifford

Deep generative models have achieved impressive success in recent years. Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), as emerging families for generative model learning, have largely been considered as two…

Machine Learning · Computer Science 2018-07-12 Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric P. Xing

We present an approach to quantifying both aleatoric and epistemic uncertainty for deep neural networks in image classification, based on generative adversarial networks (GANs). While most works in the literature that use GANs to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Philipp Oberdiek , Gernot A. Fink , Matthias Rottmann

In the course of the past few years, diffusion models (DMs) have reached an unprecedented level of visual quality. However, relatively little attention has been paid to the detection of DM-generated images, which is critical to prevent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jonas Ricker , Simon Damm , Thorsten Holz , Asja Fischer

Computational material modeling using advanced numerical techniques speeds up the design process and reduces the costs of developing new engineering products. In the field of multiscale modeling, huge computation efforts are expected for…

Disordered Systems and Neural Networks · Physics 2023-01-31 Fadi Aldakheel , Celal Soyarslan , Hari Subramani Palanisamy , Elsayed Saber Elsayed

Conditional waveform synthesis models learn a distribution of audio waveforms given conditioning such as text, mel-spectrograms, or MIDI. These systems employ deep generative models that model the waveform via either sequential…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-07 Max Morrison , Rithesh Kumar , Kundan Kumar , Prem Seetharaman , Aaron Courville , Yoshua Bengio

Training deep neural networks (DNNs) from noisy labels is an important and challenging task. However, most existing approaches focus on the corrupted labels and ignore the importance of inherent data structure. To bridge the gap between…

Machine Learning · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Diffusion and flow-based models are ubiquitously used for generative modelling and density estimation. They admit a deterministic probability flow ordinary differential equation (PF-ODE), analogous to continuous normalizing flows (CNFs),…

Machine Learning · Statistics 2026-05-19 Gurjeet Jagwani , Stephen Thorp , Sinan Deger , Hiranya Peiris

Generative adversarial networks (GANs) have been extremely effective in approximating complex distributions of high-dimensional, input data samples, and substantial progress has been made in understanding and improving GAN performance in…

Machine Learning · Computer Science 2018-05-01 Daniel Jiwoong Im , He Ma , Graham Taylor , Kristin Branson

Simulating detector responses is a crucial part of understanding the inner-workings of particle collisions in the Large Hadron Collider at CERN. The current reliance on statistical Monte-Carlo simulations strains CERN's computational grid,…

Machine Learning · Computer Science 2024-06-06 Patryk Będkowski , Jan Dubiński , Kamil Deja , Przemysław Rokita

The ability to generate physically plausible ensembles of variable sources is critical to the optimization of time-domain survey cadences and the training of classification models on datasets with few to no labels. Traditional data…

Instrumentation and Methods for Astrophysics · Physics 2020-05-19 Jorge Martínez-Palomera , Joshua S. Bloom , Ellianna S. Abrahams

We present Generalized Contrastive Divergence (GCD), a novel objective function for training an energy-based model (EBM) and a sampler simultaneously. GCD generalizes Contrastive Divergence (Hinton, 2002), a celebrated algorithm for…

Machine Learning · Computer Science 2023-12-07 Sangwoong Yoon , Dohyun Kwon , Himchan Hwang , Yung-Kyun Noh , Frank C. Park

We study the problem of multimodal generative modelling of images based on generative adversarial networks (GANs). Despite the success of existing methods, they often ignore the underlying structure of vision data or its multimodal…

Machine Learning · Computer Science 2019-11-07 Lili Pan , Shen Cheng , Jian Liu , Yazhou Ren , Zenglin Xu

Generative Adversarial Networks (GANs) have become one of the dominant methods for deep generative modeling. Despite their demonstrated success on multiple vision tasks, GANs are difficult to train and much research has been dedicated…

Neural and Evolutionary Computing · Computer Science 2018-09-05 Abdullah Al-Dujaili , Tom Schmiedlechner , and Erik Hemberg , Una-May O'Reilly

Active learning aims to develop label-efficient algorithms by querying the most informative samples to be labeled by an oracle. The design of efficient training methods that require fewer labels is an important research direction that…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Ali Mottaghi , Serena Yeung