English
Related papers

Related papers: Adaptive tempering schedules with approximative in…

200 papers

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Machine Learning · Computer Science 2024-07-22 Jonas Beck , Nathanael Bosch , Michael Deistler , Kyra L. Kadhim , Jakob H. Macke , Philipp Hennig , Philipp Berens

In several applications such as databases, planning, and sensor networks, parameters such as selectivity, load, or sensed values are known only with some associated uncertainty. The performance of such a system (as captured by some…

Data Structures and Algorithms · Computer Science 2010-01-28 Sudipto Guha , Kamesh Munagala

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

Machine Learning · Computer Science 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of…

Atmospheric and Oceanic Physics · Physics 2021-01-05 Sebastian Scher , Gabriele Messori

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

We consider a non-linear filtering problem, whereby the signal obeys the stochastic Navier-Stokes equations and is observed through a linear mapping with additive noise. The setup is relevant to data assimilation for numerical weather…

Computation · Statistics 2018-04-10 Francesc Pons Llopis , Nikolas Kantas , Alexandros Beskos , Ajay Jasra

We investigate the impact of filter choice on forecast accuracy in state space models. The filters are used both to estimate the posterior distribution of the parameters, via a particle marginal Metropolis-Hastings (PMMH) algorithm, and to…

Computation · Statistics 2019-08-21 Patrick Leung , Catherine S. Forbes , Gael M. Martin , Brendan McCabe

Weather forecasting has seen a shift in methods from numerical simulations to data-driven systems. While initial research in the area focused on deterministic forecasting, recent works have used diffusion models to produce skillful ensemble…

Machine Learning · Computer Science 2025-04-15 Martin Andrae , Tomas Landelius , Joel Oskarsson , Fredrik Lindsten

We show that it is feasible to carry out exact Bayesian inference for non-Gaussian state space models using an adaptive Metropolis Hastings sampling scheme with the likelihood approximated by the particle filter. Furthermore, an adapyive…

Computation · Statistics 2009-11-03 Ralph Silva , Paolo Giordani , Robert Kohn , Mike Pitt

A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear…

Methodology · Statistics 2021-03-15 Gregor Robinson , Ian Grooms

Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only…

Computation · Statistics 2019-06-05 Xiao Lin , Gabriel Terejanu

Many recent advances in sequential assimilation of data into nonlinear high-dimensional models are modifications to particle filters which employ efficient searches of a high-dimensional state space. In this work, we present a complementary…

Dynamical Systems · Mathematics 2020-12-10 John Maclean , Elaine T Spiller

Ensemble forecast post-processing is a necessary step in producing accurate probabilistic forecasts. Conventional post-processing methods operate by estimating the parameters of a parametric distribution, frequently on a per-location or…

Machine Learning · Computer Science 2023-05-01 Peter Mlakar , Janko Merše , Jana Faganeli Pucer

Ensemble data assimilation is a problem in determining the most likely phase space trajectory of a model of an observed dynamical sys- tem as it receives inputs from measurements passing information to the model. Using methods developed in…

Chaotic Dynamics · Physics 2015-05-13 Henry D. I. Abarbanel

Accurate prediction of extreme weather events remains a major challenge for artificial intelligence-based weather prediction systems. While deterministic models such as FuXi, GraphCast, and SFNO have achieved competitive forecast skill…

Atmospheric and Oceanic Physics · Physics 2026-05-01 Rodrigo Almeida , Noelia Otero , Miguel-Ángel Fernández-Torres , Jackie Ma

Smoothing is essential to many oceanographic, meteorological and hydrological applications. The interval smoothing problem updates all desired states within a time interval using all available observations. The fixed-lag smoothing problem…

Chaotic Dynamics · Physics 2015-06-26 S. Ravela , D. McLaughlin

The particle filter is a popular Bayesian filtering algorithm for use in cases where the state-space model is nonlinear and/or the random terms (initial state or noises) are non-Gaussian distributed. We study the behavior of the error in…

Computation · Statistics 2019-03-29 Ziyu Liu , Shihong Wei , James C. Spall

The ensemble Gaussian mixture filter (EnGMF) is a powerful, convergent particle filter capable of medium-to-high dimensional non-linear filtering. The EnGMF relies on a resampling step that can generate physically unrealistic posterior…

Machine Learning · Computer Science 2026-05-05 Zain Jabbar , Andrey A. Popov

Data assimilation is a technique for increasing the accuracy of simulations of solutions to partial differential equations by incorporating observable data into the solution as time evolves. Recently, a promising new algorithm for data…

Analysis of PDEs · Mathematics 2018-12-06 Adam Larios , Collin Victor

Contemporary weather forecasts are typically based on ensemble prediction systems, which consist of multiple runs of numerical weather prediction models that vary with respect to in the initial conditions and/or the the parameterization of…

Methodology · Statistics 2016-05-04 Roman Schefzik