English
Related papers

Related papers: Energy-based models for diagnostic reconstruction …

200 papers

Current state-of-the-art generative models map noise to data distributions by matching flows or scores. A key limitation of these models is their inability to readily integrate available partial observations and additional priors. In…

Energy-based learning is a powerful learning paradigm that encapsulates various discriminative and generative approaches. An energy-based model (EBM) is typically formed of inner-model(s) that learn a combination of the different features…

Machine Learning · Computer Science 2023-06-05 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Retrosynthesis -- the process of identifying a set of reactants to synthesize a target molecule -- is of vital importance to material design and drug discovery. Existing machine learning approaches based on language models and graph neural…

Chemical Physics · Physics 2021-12-10 Ruoxi Sun , Hanjun Dai , Li Li , Steven Kearnes , Bo Dai

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jacob Kelly , Richard Zemel , Will Grathwohl

Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration,…

Machine Learning · Computer Science 2023-04-05 Jacob Piland , Christopher Sweet , Priscila Saboia , Charles Vardeman , Adam Czajka

Energy based models (EBMs) are appealing due to their generality and simplicity in likelihood modeling, but have been traditionally difficult to train. We present techniques to scale MCMC based EBM training on continuous neural networks,…

Machine Learning · Computer Science 2020-07-01 Yilun Du , Igor Mordatch

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

We propose to learn energy-based model (EBM) in the latent space of a generator model, so that the EBM serves as a prior model that stands on the top-down network of the generator model. Both the latent space EBM and the top-down network…

Machine Learning · Statistics 2020-10-30 Bo Pang , Tian Han , Erik Nijkamp , Song-Chun Zhu , Ying Nian Wu

Purpose: Although recent deep energy-based generative models (EBMs) have shown encouraging results in many image generation tasks, how to take advantage of the self-adversarial cogitation in deep EBMs to boost the performance of Magnetic…

Image and Video Processing · Electrical Eng. & Systems 2021-09-10 Yu Guan , Zongjiang Tu , Shanshan Wang , Qiegen Liu , Yuhao Wang , Dong Liang

Molecules in equilibrium follow a Boltzmann distribution, making the underlying energy landscape a physically grounded modeling objective. However, such landscapes are difficult to learn from data and, once learned, hard to sample from.…

Machine Learning · Computer Science 2026-05-19 Christoph Griesbacher , Lea Bogensperger , Andreas Habring , Thomas Pock

Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. However, learning multimodal EBM by maximum likelihood requires Markov Chain Monte Carlo…

Machine Learning · Computer Science 2026-05-04 Jiali Cui , Zhiqiang Lao , Heather Yu

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön

Energy-based models (EBMs) are generative models that are usually trained via maximum likelihood estimation. This approach becomes challenging in generic situations where the trained energy is non-convex, due to the need to sample the Gibbs…

Machine Learning · Computer Science 2022-02-16 Carles Domingo-Enrich , Alberto Bietti , Marylou Gabrié , Joan Bruna , Eric Vanden-Eijnden

This brief sketches initial progress towards a unified energy-based solution for the semi-supervised visual anomaly detection and localization problem. In this setup, we have access to only anomaly-free training data and want to detect and…

Machine Learning · Computer Science 2021-05-10 Ergin Utku Genc , Nilesh Ahuja , Ibrahima J Ndiour , Omesh Tickoo

Energy-Based Models (EBMs), also known as non-normalized probabilistic models, specify probability density or mass functions up to an unknown normalizing constant. Unlike most other probabilistic models, EBMs do not place a restriction on…

Machine Learning · Computer Science 2021-02-19 Yang Song , Diederik P. Kingma

The estimation of rare event probabilities plays a pivotal role in diverse fields. Our aim is to determine the probability of a hazard or system failure occurring when a quantity of interest exceeds a critical value. In our approach, the…

Methodology · Statistics 2025-04-11 Lea Friedli , David Ginsbourger , Arnaud Doucet , Niklas Linde

Learning energy-based model (EBM) requires MCMC sampling of the learned model as an inner loop of the learning algorithm. However, MCMC sampling of EBMs in high-dimensional data space is generally not mixing, because the energy function,…

Machine Learning · Statistics 2022-03-17 Erik Nijkamp , Ruiqi Gao , Pavel Sountsov , Srinivas Vasudevan , Bo Pang , Song-Chun Zhu , Ying Nian Wu

This work proposes a method for using any generator network as the foundation of an Energy-Based Model (EBM). Our formulation posits that observed images are the sum of unobserved latent variables passed through the generator network and a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Mitch Hill , Erik Nijkamp , Jonathan Mitchell , Bo Pang , Song-Chun Zhu

We propose an energy-based model (EBM) of protein conformations that operates at atomic scale. The model is trained solely on crystallized protein data. By contrast, existing approaches for scoring conformations use energy functions that…

Machine Learning · Computer Science 2020-04-29 Yilun Du , Joshua Meier , Jerry Ma , Rob Fergus , Alexander Rives