English
Related papers

Related papers: Importance sampling for rare event tracking within…

200 papers

Data-driven modelling techniques provide a method for deriving models of dynamical systems directly from complicated data streams. However, tracking and forecasting such data streams poses a significant challenge to most methods, as they…

Dynamical Systems · Mathematics 2025-03-25 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

We propose an ensemble score filter (EnSF) for solving high-dimensional nonlinear filtering problems with superior accuracy. A major drawback of existing filtering methods, e.g., particle filters or ensemble Kalman filters, is the low…

Machine Learning · Statistics 2024-08-14 Feng Bao , Zezhong Zhang , Guannan Zhang

The Cross Entropy method is a well-known adaptive importance sampling method for rare-event probability estimation, which requires estimating an optimal importance sampling density within a parametric class. In this article we estimate an…

Computation · Statistics 2013-10-15 Z. I. Botev , A. Ridder , L. Rojas-Nandayapa

We consider the efficient use of an approximation within Markov chain Monte Carlo (MCMC), with subsequent importance sampling (IS) correction of the Markov chain inexact output, leading to asymptotically exact inference. We detail…

Computation · Statistics 2019-04-15 Jordan Franks

ICESEE (ICE Sheet statE and parameter Estimator) is a Python-based, open-source data assimilation framework designed for seamless integration with ice sheet and Earth system models. It implements a parallel Ensemble Kalman Filter (EnKF)…

Computational Complexity · Computer Science 2026-03-31 Brian Kyanjo , Talea L. Mayo , Alexander A. Robel

We consider the problem of parameter estimation for a stochastic McKean-Vlasov equation, and the associated system of weakly interacting particles. We study two cases: one in which we observe multiple independent trajectories of the…

Statistics Theory · Mathematics 2022-11-28 Louis Sharrock , Nikolas Kantas , Panos Parpas , Grigorios A. Pavliotis

The Ensemble Kalman Filter (EnKF) is a popular estimation technique in the geosciences. It is used as a numerical tool for state vector prognosis and parameter estimation. The EnKF can, for example, help to evaluate the geothermal potential…

Applications · Statistics 2018-09-17 Johannes Keller , Harrie-Jan Hendricks Franssen , Gabriele Marquart

In Bayesian inference, the approximation of integrals of the form $\psi = \mathbb{E}_{F}{l(X)} = \int_{\chi} l(\mathbf{x}) d F(\mathbf{x})$ is a fundamental challenge. Such integrals are crucial for evidence estimation, which is important…

Computation · Statistics 2026-03-24 Jyotishka Datta , Nicholas G. Polson

We introduce a computationally efficient variant of the model-based ensemble Kalman filter (EnKF). We propose two changes to the original formulation. First, we phrase the setup in terms of precision matrices instead of covariance matrices,…

Methodology · Statistics 2023-03-01 Håkon Gryvill , Håkon Tjelmeland

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future…

Methodology · Statistics 2018-02-13 Azam Moosavi , Ahmed Attia , Adrian Sandu

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

We consider importance sampling for estimating the probability that a light-tailed $d$-dimensional random walk exits through one of many disjoint rare-event regions before reaching an anticipated target. This problem arises in sequential…

Probability · Mathematics 2025-09-19 Yanglei Song , Georgios Fellouris

This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman…

Numerical Analysis · Mathematics 2022-04-29 Daniel Zhengyu Huang , Tapio Schneider , Andrew M. Stuart

Importance sampling (IS) is valuable in reducing the variance of Monte Carlo sampling for many areas, including finance, rare event simulation, and Bayesian inference. It is natural and obvious to combine quasi-Monte Carlo (QMC) methods…

Numerical Analysis · Mathematics 2022-07-21 Zhijian He , Zhan Zheng , Xiaoqun Wang

This paper is concerned with the mathematical analysis of continuous time Ensemble Kalman Filters (EnKBFs) and their mean field limit in an infinite dimensional setting. The signal is determined by a nonlinear Stochastic Partial…

Probability · Mathematics 2024-05-06 Sebastian Ertel

The importance sampling (IS) method lies at the core of many Monte Carlo-based techniques. IS allows the approximation of a target probability distribution by drawing samples from a proposal (or importance) distribution, different from the…

Applications · Statistics 2017-04-21 Manuel A. Vázquez , Joaquín Míguez

It is a grand challenge to find a feasible weather modification method to mitigate the impact of extreme weather events such as tropical cyclones. Previous works have proposed potentially effective actuators and assessed their capabilities…

Applications · Statistics 2024-05-15 Yohei Sawada

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

Mathematical modeling and simulation of complex physical systems based on partial differential equations (PDEs) have been widely used in engineering and industrial applications. To enable reliable predictions, it is crucial yet challenging…

Numerical Analysis · Mathematics 2021-07-20 Han Gao , Jian-Xun Wang