English
Related papers

Related papers: Energy-Based Models for Functional Data using Path…

200 papers

In this paper, we propose conjugate energy-based models (CEBMs), a new class of energy-based models that define a joint density over data and latent variables. The joint density of a CEBM decomposes into an intractable distribution over…

Machine Learning · Computer Science 2021-06-28 Hao Wu , Babak Esmaeili , Michael Wick , Jean-Baptiste Tristan , Jan-Willem van de Meent

Consider learning a policy purely on the basis of demonstrated behavior -- that is, with no access to reinforcement signals, no knowledge of transition dynamics, and no further interaction with the environment. This *strictly batch…

Machine Learning · Statistics 2021-01-15 Daniel Jarrett , Ioana Bica , Mihaela van der Schaar

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

Machine Learning · Computer Science 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Energy-based learning is a powerful learning paradigm that encapsulates various discriminative and generative approaches. An energy-based model (EBM) is typically formed of inner-model(s) that learn a combination of the different features…

Machine Learning · Computer Science 2023-06-05 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

We propose an energy-based model (EBM) of protein conformations that operates at atomic scale. The model is trained solely on crystallized protein data. By contrast, existing approaches for scoring conformations use energy functions that…

Machine Learning · Computer Science 2020-04-29 Yilun Du , Joshua Meier , Jerry Ma , Rob Fergus , Alexander Rives

Energy-based models (EBMs) are generative models that are usually trained via maximum likelihood estimation. This approach becomes challenging in generic situations where the trained energy is non-convex, due to the need to sample the Gibbs…

Machine Learning · Computer Science 2022-02-16 Carles Domingo-Enrich , Alberto Bietti , Marylou Gabrié , Joan Bruna , Eric Vanden-Eijnden

The estimation of rare event probabilities plays a pivotal role in diverse fields. Our aim is to determine the probability of a hazard or system failure occurring when a quantity of interest exceeds a critical value. In our approach, the…

Methodology · Statistics 2025-04-11 Lea Friedli , David Ginsbourger , Arnaud Doucet , Niklas Linde

Predictive models are highly advanced in understanding the mechanisms of brain function. Recent advances in machine learning further underscore the power of prediction for optimal representation in learning. However, there remains a gap in…

Machine Learning · Computer Science 2025-05-22 Xingsi Dong , Xiangyuan Peng , Si Wu

Training energy-based models (EBMs) on discrete spaces is challenging because sampling over such spaces can be difficult. We propose to train discrete EBMs with energy discrepancy (ED), a novel type of contrastive loss functional which only…

Machine Learning · Statistics 2023-07-18 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Energy-based models (EBMs) exhibit a variety of desirable properties in predictive tasks, such as generality, simplicity and compositionality. However, training EBMs on high-dimensional datasets remains unstable and expensive. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Xiulong Yang , Shihao Ji

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jacob Kelly , Richard Zemel , Will Grathwohl

Learning energy-based model (EBM) requires MCMC sampling of the learned model as an inner loop of the learning algorithm. However, MCMC sampling of EBMs in high-dimensional data space is generally not mixing, because the energy function,…

Machine Learning · Statistics 2022-03-17 Erik Nijkamp , Ruiqi Gao , Pavel Sountsov , Srinivas Vasudevan , Bo Pang , Song-Chun Zhu , Ying Nian Wu

In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization. EBMs are a set of neural networks that can represent expressive probability density distributions in terms of a Gibbs…

Robotics · Computer Science 2023-01-13 Julen Urain , An T. Le , Alexander Lambert , Georgia Chalvatzaki , Byron Boots , Jan Peters

Energy-based models (EBMs) are known in the Machine Learning community for decades. Since the seminal works devoted to EBMs dating back to the noughties, there have been a lot of efficient methods which solve the generative modelling…

Machine Learning · Computer Science 2024-03-19 Petr Mokrov , Alexander Korotin , Alexander Kolesov , Nikita Gushchin , Evgeny Burnaev

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

With the advent of score-matching techniques for model training and Langevin dynamics for sample generation, energy-based models (EBMs) have gained renewed interest as generative models. Recent EBMs usually use neural networks to define…

Machine Learning · Computer Science 2025-05-05 Yukun Li , Li-Ping Liu

Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration,…

Machine Learning · Computer Science 2023-04-05 Jacob Piland , Christopher Sweet , Priscila Saboia , Charles Vardeman , Adam Czajka

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön