English
Related papers

Related papers: Adaptive tempering schedules with approximative in…

200 papers

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

Computational Engineering, Finance, and Science · Computer Science 2014-12-09 Ahmed Attia , Adrian Sandu

Understanding and predicting people flow in urban areas is useful for decision-making in urban planning and marketing strategies. Traditional methods for understanding people flow can be divided into measurement-based approaches and…

Human-Computer Interaction · Computer Science 2024-01-18 Ryo Murata , Kenji Tanaka

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

Particle filters are computational techniques for estimating the state of dynamical systems by integrating observational data with model predictions. This work introduces a class of Localized Particle Filters (LPFs) that exploit spatial…

Applications · Statistics 2025-07-10 Dan Crisan , Eliana Fausti

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of…

Atmospheric and Oceanic Physics · Physics 2022-03-14 Stefanie Legler , Tijana Janjic

Sampling is a fundamental problem in computer science and statistics. However, for a given task and stream, it is often not possible to choose good sampling probabilities in advance. We derive a general framework for adaptively changing the…

Machine Learning · Statistics 2022-06-16 Daniel Ting

Mixture models, such as Gaussian mixture models, are widely used in machine learning to represent complex data distributions. A key challenge, especially in high-dimensional settings, is to determine the mixture order and estimate the…

Optimization and Control · Mathematics 2025-09-30 Srećko Đurašinović , Jean-Bernard Lasserre , Victor Magron

Data assimilation addresses the general problem of how to combine model-based predictions with partial and noisy observations of the process in an optimal manner. This survey focuses on sequential data assimilation techniques using…

Numerical Analysis · Mathematics 2019-08-15 Sebastian Reich

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

This work introduces a novel nonlinear optimal filtering method, termed the Ensemble Schr{\"o}dinger Bridge nonlinear filter. The proposed filter combines the standard prediction step with a diffusion-generative-modeling-based analysis…

Machine Learning · Computer Science 2026-05-12 Hui Sun

State-of-the-art weather forecasts usually rely on ensemble prediction systems, accounting for the different sources of uncertainty. As ensembles are typically uncalibrated, they should get statistically postprocessed. Several multivariate…

Methodology · Statistics 2016-09-21 Roman Schefzik

Estimating and quantifying uncertainty in unknown system parameters from limited data remains a challenging inverse problem in a variety of real-world applications. While many approaches focus on estimating constant parameters, a subset of…

Methodology · Statistics 2023-05-09 Andrea Arnold

The space weather community has begun to use frontier methods such as data assimilation, machine learning, and ensemble modeling to advance current operational forecasting efforts. This was highlighted by a multi-disciplinary session at the…

Space Physics · Physics 2018-11-22 Sophie A. Murray

Model-based filtering is often carried out while subject to an imperfect model, as learning partially-observable stochastic systems remains a challenge. Recent work on Bayesian inference found that tempering the likelihood or full posterior…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Menno van Zutphen , Domagoj Herceg , Giannis Delimpaltadakis , Duarte J. Antunes

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

Ensemble calculations are essential for systems with uncertain data but require substantial increase in computational resources. This increase severely limits ensemble size. To reach beyond current limits, we present a first-order…

Numerical Analysis · Mathematics 2017-12-19 Joseph A. Fiordilino , Michael McLaughlin

In climate science, the tuning of climate models is a computationally intensive problem due to the combination of the high-dimensionality of the system state and long integration times. Supermodelling is a technique which has shown the…

Chaotic Dynamics · Physics 2026-04-15 Jordan Seneca , Suzanne Bintanja , Frank M. Selten

The problem of incorporating information from observations received serially in time is widespread in the field of uncertainty quantification. Within a probabilistic framework, such problems can be addressed using standard filtering…

Methodology · Statistics 2024-12-02 Chatchuea Kimchaiwong , Jeremie Houssineau , Adam M. Johansen

When auditing a redistricting plan, a persuasive method is to compare the plan with an ensemble of neutrally drawn redistricting plans. Ensembles are generated via algorithms that sample distributions on balanced graph partitions. To audit…

Physics and Society · Physics 2024-02-01 Gabriel Chuang , Gregory Herschlag , Jonathan C. Mattingly