English
Related papers

Related papers: A Random Batch Method for Efficient Ensemble Forec…

200 papers

When making predictions about ecosystems, we often have available a number of different ecosystem models that attempt to represent their dynamics in a detailed mechanistic way. Each of these can be used as simulators of large-scale…

The chaotic nature of fluid flow and the uncertainties in initial conditions limit predictability. Small errors that occur in the initial condition can grow exponentially until they saturate at $\mathcal{O}$(1). Ensemble forecasting…

Numerical Analysis · Mathematics 2024-07-16 Rui Fang

We review the Random Batch Methods (RBM) for interacting particle systems consisting of $N$-particles, with $N$ being large. The computational cost of such systems is of $O(N^2)$, which is prohibitively expensive. The RBM methods use small…

Numerical Analysis · Mathematics 2021-04-12 Shi Jin , Lei Li

Given the continuous increase in dataset sizes and the complexity of forecasting models, the trade-off between forecast accuracy and computational cost is emerging as an extremely relevant topic, especially in the context of ensemble…

Machine Learning · Computer Science 2025-07-10 Marco Zanotti

Multi-model ensembles provide a pragmatic approach to the representation of model uncertainty in climate prediction. However, such representations are inherently ad hoc, and, as shown, probability distributions of climate variables based on…

Atmospheric and Oceanic Physics · Physics 2009-08-26 T. N. Palmer , F. J. Doblas-Reyes , A. Weisheimer , G. J. Shutts , J. Berner , J. M. Murphy

We propose a novel, succinct, and effective approach for distribution prediction to quantify uncertainty in machine learning. It incorporates adaptively flexible distribution prediction of $\mathbb{P}(\mathbf{y}|\mathbf{X}=x)$ in regression…

Machine Learning · Computer Science 2023-06-21 Xing Yan , Yonghua Su , Wenxuan Ma

In this paper, we propose, analyze, and test a new fully discrete, efficient, decoupled, stable, and practically second-order time-stepping algorithm for computing MHD ensemble flow averages under uncertainties in the initial conditions and…

Numerical Analysis · Mathematics 2021-01-19 Muhammad Mohebujjaman

Accurate time series forecasting is critical for a wide range of problems with temporal data. Ensemble modeling is a well-established technique for leveraging multiple predictive models to increase accuracy and robustness, as the…

Machine Learning · Computer Science 2023-04-11 Dimitris Bertsimas , Leonard Boussioux

Mesoscale forecasts are now routinely performed as elements of operational forecasts and their outputs do appear convincing. However, despite their realistic appearance at times the comparison to observations is less favorable. At the grid…

Atmospheric and Oceanic Physics · Physics 2016-10-26 Markus Gross

This paper studies the application of ensembles composed of multi-output models for multi-step ahead forecasting problems. Dynamic ensembles have been commonly used for forecasting. However, these are typically designed for one-step-ahead…

Machine Learning · Statistics 2023-06-27 Vitor Cerqueira , Luis Torgo

Recent stochastic gradient methods that have appeared in the literature base their efficiency and global convergence properties on a suitable control of the variance of the gradient batch estimate. This control is typically achieved by…

Optimization and Control · Mathematics 2025-06-11 Marco Boresta , Alberto De Santis , Stefano Lucidi

Critical decisions frequently rely on high-dimensional output from complex computer simulation models that show intricate cross-variable, spatial and temporal dependence structures, with weather and climate predictions being key examples.…

Methodology · Statistics 2013-12-24 Roman Schefzik , Thordis L. Thorarinsdottir , Tilmann Gneiting

Bayesian uncertainty quantification (UQ) is of interest to industry and academia as it provides a framework for quantifying and reducing the uncertainty in computational models by incorporating available data. For systems with very high…

Computational Physics · Physics 2020-04-14 Xinlei Zhang , Heng Xiao , Thomas Gomez , Olivier Coutier-Delgosha

Obtaining accurate estimates of uncertainty in climate scenarios often requires generating large ensembles of high-resolution climate simulations, a computationally expensive and memory intensive process. To address this challenge, we train…

Machine Learning · Computer Science 2024-07-08 Johannes Meuer , Maximilian Witte , Tobias Sebastian Finn , Claudia Timmreck , Thomas Ludwig , Christopher Kadow

In many real-world scenarios, the underlying random fluctuations are non-Gaussian, particularly in contexts where heavy-tailed data distributions arise. A typical example of such non-Gaussian phenomena calls for L\'evy noise, which…

Numerical Analysis · Mathematics 2025-11-27 Jian-Guo Liu , Yuliang Wang

The success of diffusion probabilistic models in generative tasks, such as text-to-image generation, has motivated the exploration of their application to regression problems commonly encountered in scientific computing and various other…

Machine Learning · Computer Science 2024-08-12 Dule Shu , Amir Barati Farimani

Most of the methods that produce space weather forecasts are based on deterministic models. In order to generate a probabilistic forecast, a model needs to be run several times sampling the input parameter space, in order to generate an…

Space Physics · Physics 2019-05-01 Enrico Camporeale , Xiangning Chu , Oleksiy Agapitov , Jacob Bortnik

Ensemble prediction systems are an invaluable tool for weather forecasting. Practically, ensemble predictions are obtained by running several perturbations of the deterministic control forecast. However, ensemble prediction is associated…

Machine Learning · Computer Science 2023-02-22 Rüdiger Brecht , Alex Bihlo

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

Recently, deep learning has emerged as a promising tool for statistical downscaling, the set of methods for generating high-resolution climate fields from coarse low-resolution variables. Nevertheless, their ability to generalize to climate…

Machine Learning · Computer Science 2023-05-03 Jose González-Abad , Jorge Baño-Medina