English
Related papers

Related papers: An energy-based model approach to rare event proba…

200 papers

In this paper the Random Energy Model(REM) under exponential type environment is considered which includes double exponential and Gaussian cases. Limiting Free Energy is evaluated in these models. Limiting Gibbs' distribution is evaluated…

Probability · Mathematics 2007-05-23 Nabin Kumar Jana

The probability of rare and extreme events is an important quantity for design purposes. However, computing the probability of rare events can be expensive because only a few events, if any, can be observed. To this end, it is necessary to…

Computational Physics · Physics 2020-01-08 Malik Hassanaly , Venkat Raman

Rare variants are hypothesized to be largely responsible for heritability and susceptibility to disease in humans. So rare variants association studies hold promise for understanding disease. Conversely though, the rareness of the variants…

Methodology · Statistics 2021-12-06 Lorenzo Masoero , Joshua Schraiber , Tamara Broderick

In Part I (arXiv:1911.00619) of this article, we proposed an importance sampling algorithm to compute rare-event probabilities in forward uncertainty quantification problems. The algorithm, which we termed the "Bayesian Inverse Monte Carlo…

Computation · Statistics 2019-11-06 Siddhant Wahal , George Biros

We consider the common setting where one observes probability estimates for a large number of events, such as default risks for numerous bonds. Unfortunately, even with unbiased estimates, selecting events corresponding to the most extreme…

Methodology · Statistics 2021-10-14 Gareth M. James , Peter Radchenko , Bradley Rava

We introduce two synthetic likelihood methods for Simulation-Based Inference (SBI), to conduct either amortized or targeted inference from experimental observations when a high-fidelity simulator is available. Both methods learn a…

Machine Learning · Computer Science 2023-04-19 Pierre Glaser , Michael Arbel , Samo Hromadka , Arnaud Doucet , Arthur Gretton

This paper investigates the use of extreme value theory for modelling the distribution of demand-net-of-wind for capacity adequacy assessment. Extreme value theory approaches are well-established and mathematically justified methods for…

Applications · Statistics 2019-07-31 Amy L Wilson , Stan Zachary

Energy-based models (EBMs) provide an elegant framework for density estimation, but they are notoriously difficult to train. Recent work has established links to generative adversarial networks, where the EBM is trained through a minimax…

Machine Learning · Computer Science 2021-11-03 Cong Geng , Jia Wang , Zhiyong Gao , Jes Frellsen , Søren Hauberg

This paper presents a framework for deriving the storage capacity that an electricity system requires in order to satisfy a chosen risk appetite. The framework takes as inputs user-defined event categories, parameterised by peak…

Optimization and Control · Mathematics 2020-12-02 Michael P. Evans , Simon H. Tindemans

We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training…

Machine Learning · Computer Science 2025-03-05 Shuang Li , Yilun Du , Gido M. van de Ven , Igor Mordatch

In this paper, we consider an importance sampling problem for a certain rare-event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the…

Optimization and Control · Mathematics 2020-08-26 Getachew K. Befekadu

Training an energy-based model (EBM) with maximum likelihood is challenging due to the intractable normalisation constant. Traditional methods rely on expensive Markov chain Monte Carlo (MCMC) sampling to estimate the gradient of logartihm…

Machine Learning · Computer Science 2025-03-11 Hugo Senetaire , Paul Jeha , Pierre-Alexandre Mattei , Jes Frellsen

Extreme event attribution characterizes how anthropogenic climate change may have influenced the probability and magnitude of selected individual extreme weather and climate events. Attribution statements often involve quantification of the…

Methodology · Statistics 2018-02-06 Soyoung Jeon , Christopher J. Paciorek , Michael F. Wehner

Earth System Models (ESMs) are the state of the art for projecting the effects of climate change. However, longstanding uncertainties in their ability to simulate regional and local precipitation extremes and related processes inhibit…

Applications · Statistics 2017-07-20 Evan Kodra , Singdhansu Chatterjee , Stone Chen , Auroop R. Ganguly

Energy-based models are a simple yet powerful class of probabilistic models, but their widespread adoption has been limited by the computational burden of training them. We propose a novel loss function called Energy Discrepancy (ED) which…

Machine Learning · Statistics 2023-11-28 Tobias Schröder , Zijing Ou , Jen Ning Lim , Yingzhen Li , Sebastian J. Vollmer , Andrew B. Duncan

Molecular motors and other complex nonequilibrium systems are controlled by large sets of design parameters, and optimizing those parameters requires computing sensitivities -- derivatives of dynamical observables with respect to the…

Statistical Mechanics · Physics 2026-05-12 John Strahan , Todd R. Gingrich

The Energy-Based Model (EBM) framework is a very general approach to generative modeling that tries to learn and exploit probability distributions only defined though unnormalized scores. It has risen in popularity recently thanks to the…

Machine Learning · Computer Science 2022-02-25 Léo Gagnon , Guillaume Lajoie

We present an algorithm for finding the probabilities of rare events in nonequilibrium processes. The algorithm consists of evolving the system with a modified dynamics for which the required event occurs more frequently. By keeping track…

Statistical Mechanics · Physics 2011-04-07 Anupam Kundu , Sanjib Sabhapandit , Abhishek Dhar

In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization. EBMs are a set of neural networks that can represent expressive probability density distributions in terms of a Gibbs…

Robotics · Computer Science 2023-01-13 Julen Urain , An T. Le , Alexander Lambert , Georgia Chalvatzaki , Byron Boots , Jan Peters

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim