English
Related papers

Related papers: Energy-based models for inverse imaging problems

200 papers

Energy-Based Models have emerged as a powerful framework in the realm of generative modeling, offering a unique perspective that aligns closely with principles of statistical mechanics. This review aims to provide physicists with a…

Machine Learning · Computer Science 2025-05-22 Davide Carbone

Energy-based models (EBM) have become increasingly popular within computer vision. EBMs bring a probabilistic approach to training deep neural networks (DNN) and have been shown to enhance performance in areas such as calibration,…

Machine Learning · Computer Science 2023-04-05 Jacob Piland , Christopher Sweet , Priscila Saboia , Charles Vardeman , Adam Czajka

The reconstruction of the structure of biological tissue using electromyographic data is a non-invasive imaging method with diverse medical applications. Mathematically, this process is an inverse problem. Furthermore, electromyographic…

Numerical Analysis · Mathematics 2021-05-26 Anna Rörich , Tim A. Werthmann , Dominik Göddeke , Lars Grasedyck

How the brain performs credit assignment is a fundamental unsolved problem in neuroscience. Many `biologically plausible' algorithms have been proposed, which compute gradients that approximate those computed by backpropagation (BP), and…

Machine Learning · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Solving inverse problems in imaging requires models that support efficient inference, uncertainty quantification, and principled probabilistic reasoning. Energy-Based Models (EBMs), with their interpretable energy landscapes and…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Jyothi Rikhab Chand , Mathews Jacob

We focus on the problem of efficient sampling and learning of probability densities by incorporating symmetries in probabilistic models. We first introduce Equivariant Stein Variational Gradient Descent algorithm -- an equivariant sampling…

Machine Learning · Computer Science 2021-07-30 Priyank Jaini , Lars Holdijk , Max Welling

We present a new approach to the electromagnetic inverse problem that explicitly addresses the ambiguity associated with its ill-posed character. Rather than calculating a single ``best'' solution according to some criterion, our approach…

Neurons and Cognition · Quantitative Biology 2007-05-23 David M. Schmidt , John S. George , C. C. Wood

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Deep energy-based models (EBMs) are very flexible in distribution parametrization but computationally challenging because of the intractable partition function. They are typically trained via maximum likelihood, using contrastive divergence…

Machine Learning · Computer Science 2020-07-22 Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

Energy-based models (EBMs) implement inference as gradient descent on a learned Lyapunov function, yielding interpretable, structure-preserving alternatives to black-box neural ODEs and aligning naturally with physical AI. Yet their use in…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Simone Betteti , Luca Laurenti

We consider amortized Bayesian inference for nonlinear inverse problems in settings where only samples from the joint distribution of parameters and observations are available. Classical methods such as Markov chain Monte Carlo require…

Numerical Analysis · Mathematics 2026-05-19 Hojjat Kaveh , Ricardo Baptista , Andrew M. Stuart

Energy-based models (EBMs) are generative models inspired by statistical physics with a wide range of applications in unsupervised learning. Their performance is best measured by the cross-entropy (CE) of the model distribution relative to…

Machine Learning · Computer Science 2023-12-14 Davide Carbone , Mengjian Hua , Simon Coste , Eric Vanden-Eijnden

The Energy-Based Model (EBM) framework is a very general approach to generative modeling that tries to learn and exploit probability distributions only defined though unnormalized scores. It has risen in popularity recently thanks to the…

Machine Learning · Computer Science 2022-02-25 Léo Gagnon , Guillaume Lajoie

In this paper we consider Bayesian estimation for the parameters of inverse Gaussian distribution. Our emphasis is on Markov Chain Monte Carlo methods. We provide complete implementation of the Gibbs sampler algorithm. Assuming an…

Methodology · Statistics 2012-10-17 B. N. Pandey , Pulastya Bandyopadhyay

With the advent of score-matching techniques for model training and Langevin dynamics for sample generation, energy-based models (EBMs) have gained renewed interest as generative models. Recent EBMs usually use neural networks to define…

Machine Learning · Computer Science 2025-05-05 Yukun Li , Li-Ping Liu

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

Machine Learning · Computer Science 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

We study Bayesian methods for large-scale linear inverse problems, focusing on the challenging task of hyperparameter estimation. Typical hierarchical Bayesian formulations that follow a Markov Chain Monte Carlo approach are possible for…

Numerical Analysis · Mathematics 2024-01-05 Khalil A Hall-Hooper , Arvind K Saibaba , Julianne Chung , Scot M Miller

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built…

Machine Learning · Computer Science 2023-10-06 Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu

In this paper, we propose conjugate energy-based models (CEBMs), a new class of energy-based models that define a joint density over data and latent variables. The joint density of a CEBM decomposes into an intractable distribution over…

Machine Learning · Computer Science 2021-06-28 Hao Wu , Babak Esmaeili , Michael Wick , Jean-Baptiste Tristan , Jan-Willem van de Meent