English
Related papers

Related papers: Constructing efficient score functions for rare ev…

200 papers

Rare event simulation and rare event probability estimation are important tasks within the analysis of systems subject to uncertainty and randomness. Simultaneously, accurately estimating rare event probabilities is an inherently difficult…

Methodology · Statistics 2024-07-18 Max Ehre , Iason Papaioannou , Daniel Straub

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

We consider the problem of simulating diffusion bridges, which are diffusion processes that are conditioned to initialize and terminate at two given states. The simulation of diffusion bridges has applications in diverse scientific fields…

Computation · Statistics 2025-06-19 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet , James Thornton

Climate science needs more efficient ways to study high-impact, low-probability extreme events, which are rare by definition and costly to simulate in large numbers. Rare event sampling (RES) and ensemble boosting use small perturbations to…

Atmospheric and Oceanic Physics · Physics 2025-10-21 Justin Finkel , Paul A. O'Gorman

We present a novel quasi-Bayesian method to weight multiple dynamical models by their skill at capturing both potentially non-linear trends and first-order autocorrelated variability of the underlying process, and to make weighted…

Applications · Statistics 2019-04-18 Roman Olson , Soon-Il An , Yanan Fan , Jason P. Evans

Accurate subgrid-scale closures are essential for weather/climate models, where predicting extreme events is critical. Traditional closures have structural errors, e.g., producing excessive diffusion that dampens extremes. Artificial…

Detecting recurrent weather patterns and understanding the transitions between such regimes are key to advancing our knowledge on the low-frequency variability of the atmosphere and have important implications in terms of weather and…

Atmospheric and Oceanic Physics · Physics 2024-12-24 Sebastian Springer , Vera Melinda Galfi , Alessandro Laio , Valerio Lucarini

Importance sampling is a Monte Carlo method that introduces a proposal distribution to sample the space according to the target distribution. Yet calibration of the proposal distribution is essential to achieving efficiency, thus the resort…

Computation · Statistics 2022-06-17 Grégoire Aufort , Pierre Pudlo , Denis Burgarella

The results of a recent simulation with a complex global climate model suggest that the overturning component of the freshwater transport at the southern boundary of the Atlantic could be used as an early-warning indicator of an AMOC…

Atmospheric and Oceanic Physics · Physics 2024-02-27 Erhard Reschenhofer

We introduce an approach for analyzing the responses of dynamical systems to external perturbations that combines score-based generative modeling with the Generalized Fluctuation-Dissipation Theorem (GFDT). The methodology enables accurate…

Data Analysis, Statistics and Probability · Physics 2024-11-11 Ludovico Theo Giorgini , Katherine Deck , Tobias Bischoff , Andre Souza

The minimum action method (MAM) is to calculate the most probable transition path in randomly perturbed stochastic dynamics, based on the idea of action minimization in the path space. The accuracy of the numerical path between different…

Computational Physics · Physics 2017-05-26 Y Sun , X Zhou

Understanding transition pathways between two meta-stable states of a molecular system is crucial to advance drug discovery and material design. However, unbiased molecular dynamics (MD) simulations are computationally infeasible because of…

Machine Learning · Computer Science 2025-01-28 Kiyoung Seong , Seonghyun Park , Seonghwan Kim , Woo Youn Kim , Sungsoo Ahn

Seasonal weather forecasts are crucial for long-term planning in many practical situations and skillful forecasts may have substantial economic and humanitarian implications. Current seasonal forecasting models require statistical…

We present an efficient sampling method for computing a partition function and accelerating configuration sampling. The method performs a random walk in the $\lambda$ space, with $\lambda$ being any thermodynamic variable that characterizes…

Computational Physics · Physics 2010-03-02 Cheng Zhang , Jianpeng Ma

The Atlantic Meridional Overturning Circulation (AMOC) is a much studied component of the climate system, because its suspected multistability is associated with tipping behaviour yielding potentially large regional and global climatic…

Atmospheric and Oceanic Physics · Physics 2024-12-24 Johannes Lohmann , Valerio Lucarini

This paper studies transfer learning for estimating the mean of random functions based on discretely sampled data, where, in addition to observations from the target distribution, auxiliary samples from similar but distinct source…

Statistics Theory · Mathematics 2024-03-29 T. Tony Cai , Dongwoo Kim , Hongming Pu

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

This paper presents a general-purpose formulation of a large class of discrete-time planning problems, with hybrid state and control-spaces, as factored transition systems. Factoring allows state transitions to be described as the…

Robotics · Computer Science 2019-02-13 Caelan Reed Garrett , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Destination prediction is an essential task in a variety of mobile applications. In this paper, we optimize the matrix operation and adapt a semi-lazy framework to improve the prediction accuracy and efficiency of a state-of-the-art…

Databases · Computer Science 2018-07-11 Zhou Yang , Heli Sun , Jianbin Huang , Xiaolin Jia , Ziyu Guan , Zhongmeng Zhao

We propose an adaptive importance sampling scheme for the simulation of rare events when the underlying dynamics is given by a diffusion. The scheme is based on a Gibbs variational principle that is used to determine the optimal (i.e.…

Probability · Mathematics 2019-07-24 Carsten Hartmann , Omar Kebiri , Lara Neureither , Lorenz Richter