English
Related papers

Related papers: Learning Deep Energy Models: Contrastive Divergenc…

200 papers

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

Disentangling factors of variation has become a very challenging problem on representation learning. Existing algorithms suffer from many limitations, such as unpredictable disentangling factors, poor quality of generated images from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Taihong Xiao , Jiapeng Hong , Jinwen Ma

We demonstrate a machine learning approach designed to extract hidden chemistry/physics to facilitate new materials discovery. In particular, we propose a novel method for learning latent knowledge from material structure data in which…

Materials Science · Physics 2021-08-03 Tien-Cuong Nguyen , Van-Quyen Nguyen , Van-Linh Ngo , Quang-Khoat Than , Tien-Lam Pham

We introduce Kernel Density Discrimination GAN (KDD GAN), a novel method for generative adversarial learning. KDD GAN formulates the training as a likelihood ratio optimization problem where the data distributions are written explicitly via…

Machine Learning · Computer Science 2021-07-14 Abdelhak Lemkhenter , Adam Bielski , Alp Eren Sari , Paolo Favaro

Over the past years, Generative Adversarial Networks (GANs) have shown a remarkable generation performance especially in image synthesis. Unfortunately, they are also known for having an unstable training process and might loose parts of…

Machine Learning · Computer Science 2019-11-18 Teodora Pandeva , Matthias Schubert

There have been many applications of deep neural networks to detector calibrations and a growing number of studies that propose deep generative models as automated fast detector simulators. We show that these two tasks can be unified by…

High Energy Physics - Phenomenology · Physics 2025-04-14 Haoxing Du , Claudius Krause , Vinicius Mikuni , Benjamin Nachman , Ian Pang , David Shih

A new approach to maximum likelihood learning of discrete graphical models and RBM in particular is introduced. Our method, Perturb and Descend (PD) is inspired by two ideas (I) perturb and MAP method for sampling (II) learning by…

Neural and Evolutionary Computing · Computer Science 2014-05-08 Siamak Ravanbakhsh , Russell Greiner , Brendan Frey

Unpredictability of renewable energy sources coupled with the complexity of those methods used for various purposes in this area calls for the development of robust methods such as DL models within the renewable energy domain. Given the…

Machine Learning · Computer Science 2025-05-07 Lutfu Sua , Haibo Wang , Jun Huang

Generative Adversarial Networks (GANs) have been widely-used in image translation, but their high computation and storage costs impede the deployment on mobile devices. Prevalent methods for CNN compression cannot be directly applied to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Shaojie Li , Mingbao Lin , Yan Wang , Fei Chao , Ling Shao , Rongrong Ji

Test Input Generators (TIGs) are crucial to assess the ability of Deep Learning (DL) image classifiers to provide correct predictions for inputs beyond their training and test sets. Recent advancements in Generative AI (GenAI) models have…

Machine Learning · Computer Science 2024-12-24 Maryam , Matteo Biagiola , Andrea Stocco , Vincenzo Riccio

We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between…

Computational Physics · Physics 2021-01-29 Massimiliano Lupo Pasini , Ying Wai Li , Junqi Yin , Jiaxin Zhang , Kipton Barros , Markus Eisenbach

Artificial intelligence methods including deep neural networks (DNN) can provide rapid molecular classification of tumors from routine histology with accuracy that matches or exceeds human pathologists. Discerning how neural networks make…

We present a new method for evaluating and training unnormalized density models. Our approach only requires access to the gradient of the unnormalized model's log-density. We estimate the Stein discrepancy between the data density $p(x)$…

Machine Learning · Statistics 2020-08-17 Will Grathwohl , Kuan-Chieh Wang , Jorn-Henrik Jacobsen , David Duvenaud , Richard Zemel

Ensembles of deep neural networks have achieved great success recently, but they do not offer a proper Bayesian justification. Moreover, while they allow for averaging of predictions over several hypotheses, they do not provide any…

Machine Learning · Computer Science 2021-06-23 Francesco D'Angelo , Vincent Fortuin , Florian Wenzel

The precise simulation of particle transport through detectors remains a key element for the successful interpretation of high energy physics results. However, Monte Carlo based simulation is extremely demanding in terms of computing…

High Energy Physics - Experiment · Physics 2021-09-08 Florian Rehm , Sofia Vallecorsa , Kerstin Borras , Dirk Krücker

Generative Adversarial Networks (GANs) have shown great promise in modeling high dimensional data. The learning objective of GANs usually minimizes some measure discrepancy, \textit{e.g.}, $f$-divergence~($f$-GANs) or Integral Probability…

Machine Learning · Computer Science 2020-04-07 Yuxuan Song , Qiwei Ye , Minkai Xu , Tie-Yan Liu

In the big data era, deep learning and intelligent data mining technique solutions have been applied by researchers in various areas. Forecast and analysis of stock market data have represented an essential role in today's economy, and a…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Wilfredo Tovar

We propose a simple algorithm to train stochastic neural networks to draw samples from given target distributions for probabilistic inference. Our method is based on iteratively adjusting the neural network parameters so that the output…

Machine Learning · Statistics 2017-11-01 Yihao Feng , Dilin Wang , Qiang Liu

Deep generative models are a class of techniques that train deep neural networks to model the distribution of training samples. Research has fragmented into various interconnected approaches, each of which make trade-offs including…

Machine Learning · Computer Science 2022-03-29 Sam Bond-Taylor , Adam Leach , Yang Long , Chris G. Willcocks

We study a new approach to learning energy-based models (EBMs) based on adversarial training (AT). We show that (binary) AT learns a special kind of energy function that models the support of the data distribution, and the learning process…

Machine Learning · Computer Science 2022-12-29 Xuwang Yin , Shiying Li , Gustavo K. Rohde