English
Related papers

Related papers: Generalized Energy Based Models

200 papers

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in the field of generative modeling due to its flexibility in the formulation and strong modeling power of the latent space. However,…

Machine Learning · Computer Science 2023-10-06 Peiyu Yu , Yaxuan Zhu , Sirui Xie , Xiaojian Ma , Ruiqi Gao , Song-Chun Zhu , Ying Nian Wu

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training…

Machine Learning · Computer Science 2025-03-05 Shuang Li , Yilun Du , Gido M. van de Ven , Igor Mordatch

In this paper, we study deep generative models for effective unsupervised learning. We propose VGAN, which works by minimizing a variational lower bound of the negative log likelihood (NLL) of an energy based model (EBM), where the model…

Machine Learning · Computer Science 2016-11-08 Shuangfei Zhai , Yu Cheng , Rogerio Feris , Zhongfei Zhang

Energy-based models (EBMs) exhibit a variety of desirable properties in predictive tasks, such as generality, simplicity and compositionality. However, training EBMs on high-dimensional datasets remains unstable and expensive. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Xiulong Yang , Shihao Ji

Neural language models can be successfully trained on source code, leading to applications such as code completion. However, their versatile autoregressive self-supervision objective overlooks important global sequence-level features that…

Machine Learning · Computer Science 2021-06-10 Tomasz Korbak , Hady Elsahar , Marc Dymetman , Germán Kruszewski

This paper proposes a multi-grid method for learning energy-based generative ConvNet models of images. For each grid, we learn an energy-based probabilistic model where the energy function is defined by a bottom-up convolutional neural…

Machine Learning · Statistics 2020-10-16 Ruiqi Gao , Yang Lu , Junpei Zhou , Song-Chun Zhu , Ying Nian Wu

Popular generative model learning methods such as Generative Adversarial Networks (GANs), and Variational Autoencoders (VAE) enforce the latent representation to follow simple distributions such as isotropic Gaussian. In this paper, we…

Machine Learning · Computer Science 2018-03-15 Cem Subakan , Oluwasanmi Koyejo , Paris Smaragdis

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön

Energy-based models (EBMs) offer a flexible framework for probabilistic modelling across various data domains. However, training EBMs on data in discrete or mixed state spaces poses significant challenges due to the lack of robust and fast…

Machine Learning · Statistics 2024-12-03 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Molecules in equilibrium follow a Boltzmann distribution, making the underlying energy landscape a physically grounded modeling objective. However, such landscapes are difficult to learn from data and, once learned, hard to sample from.…

Machine Learning · Computer Science 2026-05-19 Christoph Griesbacher , Lea Bogensperger , Andreas Habring , Thomas Pock

In many applications, the training data for a machine learning task is partitioned across multiple nodes, and aggregating this data may be infeasible due to communication, privacy, or storage constraints. Existing distributed optimization…

Machine Learning · Computer Science 2019-06-06 Neel Guha , Virginia Smith

This paper studies the fundamental problem of multi-layer generator models in learning hierarchical representations. The multi-layer generator model that consists of multiple layers of latent variables organized in a top-down architecture…

Machine Learning · Computer Science 2023-10-17 Jiali Cui , Ying Nian Wu , Tian Han

We introduce the "Energy-based Generative Adversarial Network" model (EBGAN) which views the discriminator as an energy function that attributes low energies to the regions near the data manifold and higher energies to other regions.…

Machine Learning · Computer Science 2017-03-08 Junbo Zhao , Michael Mathieu , Yann LeCun

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

Machine Learning · Computer Science 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

In learned image compression, probabilistic models play an essential role in characterizing the distribution of latent variables. The Gaussian model with mean and scale parameters has been widely used for its simplicity and effectiveness.…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Haotian Zhang , Li Li , Dong Liu

With the advent of score-matching techniques for model training and Langevin dynamics for sample generation, energy-based models (EBMs) have gained renewed interest as generative models. Recent EBMs usually use neural networks to define…

Machine Learning · Computer Science 2025-05-05 Yukun Li , Li-Ping Liu

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in…

Machine Learning · Computer Science 2025-05-22 Xingsi Dong , Xiangyuan Peng , Si Wu

Purpose: Although recent deep energy-based generative models (EBMs) have shown encouraging results in many image generation tasks, how to take advantage of the self-adversarial cogitation in deep EBMs to boost the performance of Magnetic…

Image and Video Processing · Electrical Eng. & Systems 2021-09-10 Yu Guan , Zongjiang Tu , Shanshan Wang , Qiegen Liu , Yuhao Wang , Dong Liang