English
Related papers

Related papers: Learning Deep Energy Models: Contrastive Divergenc…

200 papers

We propose a training and evaluation approach for autoencoder Generative Adversarial Networks (GANs), specifically the Boundary Equilibrium Generative Adversarial Network (BEGAN), based on methods from the image quality assessment…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Michael O. Vertolli , Jim Davies

Generative models (GMs) such as Generative Adversary Network (GAN) and Variational Auto-Encoder (VAE) have thrived these years and achieved high quality results in generating new samples. Especially in Computer Vision, GMs have been used in…

Machine Learning · Computer Science 2018-04-27 Honggang Zhou , Yunchun Li , Hailong Yang , Wei Li , Jie Jia

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

Machine Learning · Computer Science 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

Existing deep learning methods for image deblurring typically train models using pairs of sharp images and their blurred counterparts. However, synthetically blurring images do not necessarily model the genuine blurring process in…

Computer Vision and Pattern Recognition · Computer Science 2020-05-08 Kaihao Zhang , Wenhan Luo , Yiran Zhong , Lin Ma , Bjorn Stenger , Wei Liu , Hongdong Li

Deep-learning models such as Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) have been successfully used for process-mining tasks. They have achieved better performance for different predictive tasks than traditional…

Machine Learning · Computer Science 2021-05-04 Ishwar Venugopal , Jessica Töllich , Michael Fairbank , Ansgar Scherp

Maximum likelihood estimation of energy-based models is a challenging problem due to the intractability of the log-likelihood gradient. In this work, we propose learning both the energy function and an amortized approximate sampling…

Machine Learning · Computer Science 2019-05-29 Rithesh Kumar , Sherjil Ozair , Anirudh Goyal , Aaron Courville , Yoshua Bengio

We explore the application of computer vision and machine learning (ML) techniques to predict material properties (e.g. compressive strength) based on SEM images. We show that it's possible to train ML models to predict materials…

With the growing popularity of RAG, the capabilities of embedding models are gaining increasing attention. Embedding models are primarily trained through contrastive loss learning, with negative examples being a key component. Previous work…

Computation and Language · Computer Science 2024-08-30 Shiyu Li , Yang Tang , Shizhe Chen , Xi Chen

The output of text-to-image synthesis systems should be coherent, clear, photo-realistic scenes with high semantic fidelity to their conditioned text descriptions. Our Cross-Modal Contrastive Generative Adversarial Network (XMC-GAN)…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Han Zhang , Jing Yu Koh , Jason Baldridge , Honglak Lee , Yinfei Yang

Two recently introduced criteria for estimation of generative models are both based on a reduction to binary classification. Noise-contrastive estimation (NCE) is an estimation procedure in which a generative model is trained to be able to…

Machine Learning · Statistics 2015-05-22 Ian J. Goodfellow

This paper studies a training method to jointly estimate an energy-based model and a flow-based model, in which the two models are iteratively updated based on a shared adversarial value function. This joint training method has the…

Machine Learning · Statistics 2020-04-02 Ruiqi Gao , Erik Nijkamp , Diederik P. Kingma , Zhen Xu , Andrew M. Dai , Ying Nian Wu

The last few years have witnessed an increased interest in incorporating physics-informed inductive bias in deep learning frameworks. In particular, a growing volume of literature has been exploring ways to enforce energy conservation while…

Machine Learning · Computer Science 2023-05-02 Yaofeng Desmond Zhong , Biswadip Dey , Amit Chakraborty

Synthesizing MR imaging sequences is highly relevant in clinical practice, as single sequences are often missing or are of poor quality (e.g. due to motion). Naturally, the idea arises that a target modality would benefit from multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Hongwei Li , Johannes C. Paetzold , Anjany Sekuboyina , Florian Kofler , Jianguo Zhang , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze

An energy-based model (EBM) is a popular generative framework that offers both explicit density and architectural flexibility, but training them is difficult since it is often unstable and time-consuming. In recent years, various training…

Machine Learning · Computer Science 2023-03-07 Hankook Lee , Jongheon Jeong , Sejun Park , Jinwoo Shin

We present a mathematically well founded approach for the synthetic modeling of turbulent flows using generative adversarial networks (GAN). Based on the analysis of chaotic, deterministic systems in terms of ergodicity, we outline a…

Fluid Dynamics · Physics 2022-03-23 Claudia Drygala , Benjamin Winhart , Francesca di Mare , Hanno Gottschalk

Modern generative models are roughly divided into two main categories: (1) models that can produce high-quality random samples, but cannot estimate the exact density of new data points and (2) those that provide exact density estimation, at…

Machine Learning · Computer Science 2022-06-24 Omri Ben-Dov , Pravir Singh Gupta , Victoria Fernandez Abrevaya , Michael J. Black , Partha Ghosh

Generative Adversarial Networks (GANs) have facilitated a new direction to tackle the image-to-image transformation problem. Different GANs use generator and discriminator networks with different losses in the objective function. Still…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Kancharagunta Kishan Babu , Shiv Ram Dubey

Traditional change detection methods usually follow the image differencing, change feature extraction and classification framework, and their performance is limited by such simple image domain differencing and also the hand-crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Bin Hou , Qingjie Liu , Heng Wang , Yunhong Wang

Anomaly detection in images plays a significant role for many applications across all industries, such as disease diagnosis in healthcare or quality assurance in manufacturing. Manual inspection of images, when extended over a monotonously…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Vincent Wilmet , Sauraj Verma , Tabea Redl , Håkon Sandaker , Zhenning Li

Despite continuous improvements, precipitation forecasts are still not as accurate and reliable as those of other meteorological variables. A major contributing factor to this is that several key processes affecting precipitation…

Atmospheric and Oceanic Physics · Physics 2022-11-09 Lucy Harris , Andrew T. T. McRae , Matthew Chantry , Peter D. Dueben , Tim N. Palmer
‹ Prev 1 8 9 10 Next ›