English
Related papers

Related papers: Deep Directed Generative Models with Energy-Based …

200 papers

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

Energy based models (EBMs) are appealing for their generality and simplicity in data likelihood modeling, but have conventionally been difficult to train due to the unstable and time-consuming implicit MCMC sampling during contrastive…

Machine Learning · Computer Science 2024-07-23 Junn Yong Loo , Michelle Adeline , Arghya Pal , Vishnu Monn Baskaran , Chee-Ming Ting , Raphael C. -W. Phan

Sampling problems are widely regarded as the task for which quantum computers can most readily provide a quantum advantage. Leveraging this feature, the quantum-enhanced Markov chain Monte Carlo [Layden, D. et al., Nature 619, 282-287…

Quantum Physics · Physics 2026-02-26 Yuichiro Nakano , Ken N. Okada , Keisuke Fujii

Scenario-based probabilistic forecasts have become vital for decision-makers in handling intermittent renewable energies. This paper presents a recent promising deep learning generative approach called denoising diffusion probabilistic…

Machine Learning · Computer Science 2023-08-22 Esteban Hernandez Capel , Jonathan Dumas

Deep generative neural networks (DGNNs) have achieved realistic and high-quality data generation. In particular, the adversarial training scheme has been applied to many DGNNs and has exhibited powerful performance. Despite of recent…

Machine Learning · Computer Science 2019-12-13 Giyoung Jeon , Haedong Jeong , Jaesik Choi

We design generative neural networks that generate Monte Carlo configurations with complete absence of autocorrelation from which only short Markov chains are needed before making measurements for physical observables, irrespective of the…

Strongly Correlated Electrons · Physics 2022-05-25 Hongyu Lu , Chuhao Li , Bin-Bin Chen , Wei Li , Yang Qi , Zi Yang Meng

Bayesian inference provides a methodology for parameter estimation and uncertainty quantification in machine learning and deep learning methods. Variational inference and Markov Chain Monte-Carlo (MCMC) sampling methods are used to…

Machine Learning · Statistics 2024-08-27 Rohitash Chandra , Joshua Simmons

Ensemble weather forecasts based on multiple runs of numerical weather prediction models typically show systematic errors and require post-processing to obtain reliable forecasts. Accurately modeling multivariate dependencies is crucial in…

Atmospheric and Oceanic Physics · Physics 2024-02-02 Jieyu Chen , Tim Janke , Florian Steinke , Sebastian Lerch

This paper addresses the problem of modeling and estimating dynamic multi-valued mappings. While most mathematical models provide a unique solution for a given input, real-world applications often lack deterministic solutions. In such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Geng Li , Di Qiu , Lok Ming Lui

Markov chain Monte Carlo is a class of algorithms for drawing Markovian samples from high-dimensional target densities to approximate the numerical integration associated with computing statistical expectation, especially in Bayesian…

Computation · Statistics 2018-03-28 Khoa T. Tran

Markov chain Monte Carlo (MCMC) is a sampling-based method for estimating features of probability distributions. MCMC methods produce a serially correlated, yet representative, sample from the desired distribution. As such it can be…

Computation · Statistics 2019-12-10 Dootika Vats , Nathan Robertson , James M Flegal , Galin L Jones

A generative model is developed for deep (multi-layered) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up (pretraining) and top-down (refinement)…

Machine Learning · Statistics 2015-04-17 Yunchen Pu , Xin Yuan , Lawrence Carin

Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are particularly useful when the training data appears to be…

High Energy Physics - Phenomenology · Physics 2026-04-30 Zachary Bogorad , Ibrahim Elsharkawy , Yonatan Kahn , Andrew J. Larkoski , Noam Levi

Molecular dynamics (MD) is a powerful technique for studying microscopic phenomena, but its computational cost has driven significant interest in the development of deep learning-based surrogate models. We introduce generative modeling of…

Biomolecules · Quantitative Biology 2024-09-27 Bowen Jing , Hannes Stärk , Tommi Jaakkola , Bonnie Berger

Monte Carlo algorithms, such as Markov chain Monte Carlo (MCMC) and Hamiltonian Monte Carlo (HMC), are routinely used for Bayesian inference in generalized linear models; however, these algorithms are prohibitively slow in massive data…

Computation · Statistics 2020-08-31 Nariankadu D. Shyamalkumar , Sanvesh Srivastava

The probabilistic characteristics of daily wind speed are not well captured by simple density functions such as Normal or Weibull distribuions as suggested by the existing literature. The unmodeled uncertainties can cause unknown influences…

Systems and Control · Computer Science 2018-09-17 Weigao Sun , Mohsen Zamani , Hai-Tao Zhang , Yuanzheng Li

The past several years have seen remarkable progress in generative models which produce convincing samples of images and other modalities. A shared component of many powerful generative models is a decoder network, a parametric deep neural…

Machine Learning · Computer Science 2017-06-08 Yuhuai Wu , Yuri Burda , Ruslan Salakhutdinov , Roger Grosse

The Markov Chain Monte Carlo (MCMC) algorithm is a widely recognised as an efficient method for sampling a specified posterior distribution. However, when the posterior is multi-modal, conventional MCMC algorithms either tend to become…

Instrumentation and Methods for Astrophysics · Physics 2014-08-19 Yi-Ming Hu , Martin Hendry , Ik Siong Heng

Hidden Markov model (HMM) has been successfully used for sequential data modeling problems. In this work, we propose to power the modeling capacity of HMM by bringing in neural network based generative models. The proposed model is termed…

Machine Learning · Computer Science 2020-05-26 Dong Liu , Antoine Honoré , Saikat Chatterjee , Lars K. Rasmussen

Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have shown advances in…

Machine Learning · Computer Science 2020-10-12 Leonardo Cotta , Carlos H. C. Teixeira , Ananthram Swami , Bruno Ribeiro