English
Related papers

Related papers: A Random Batch Method for Efficient Ensemble Forec…

200 papers

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to estimate uncertainty on the prediction of multiple neural networks by collecting votes from each network and computing the difference in those predictions. In this paper,…

Machine Learning · Computer Science 2023-07-10 Illia Oleksiienko , Alexandros Iosifidis

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

Machine Learning · Statistics 2017-09-20 Ruohui Wang , Dahua Lin

Performing inference on large volumes of samples with large language models (LLMs) can be computationally and financially costly in industry and real-world use. We propose batch prompting, a simple yet effective prompting approach that…

Computation and Language · Computer Science 2023-10-25 Zhoujun Cheng , Jungo Kasai , Tao Yu

Sampling-based methods, e.g., Deep Ensembles and Bayesian Neural Nets have become promising approaches to improve the quality of uncertainty estimation and robust generalization. However, they suffer from a large model size and high latency…

Machine Learning · Computer Science 2024-05-29 Ha Manh Bui , Anqi Liu

High-resolution precipitation forecasts are crucial for providing accurate weather prediction and supporting effective responses to extreme weather events. Traditional numerical models struggle with stochastic subgrid-scale processes, while…

Machine Learning · Computer Science 2025-01-07 Shuangshuang He , Hongli Liang , Yuanting Zhang , Xingyuan Yuan

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo

Fluctuating hydrodynamics provides a model for fluids at mesoscopic scales where thermal fluctuations can have a significant impact on the behavior of the system. Here we investigate a model for fluctuating hydrodynamics of a single…

Fluid Dynamics · Physics 2015-06-22 Anuj Chaudhri , John B. Bell , Alejandro L. Garcia , Aleksandar Donev

In resource-constrained and low-latency settings, uncertainty estimates must be efficiently obtained. Deep Ensembles provide robust epistemic uncertainty (EU) but require training multiple full-size models. BatchEnsemble aims to deliver…

Machine Learning · Computer Science 2026-01-26 Anton Zamyatin , Patrick Indri , Sagar Malhotra , Thomas Gärtner

Reaction networks in the bulk and on surfaces are widespread in physical, chemical and biological systems. In macroscopic systems, which include large populations of reactive species, stochastic fluctuations are negligible and the reaction…

Statistical Mechanics · Physics 2007-10-12 Baruch Barzel , Ofer Biham , Raz Kupferman

This paper presents an algorithm for calculating an ensemble of solutions to natural convection problems. The ensemble average is the most likely temperature distribution and its variance gives an estimate of prediction reliability.…

Numerical Analysis · Mathematics 2017-08-03 Joseph A. Fiordilino

This paper addresses the challenge of model uncertainty in quantitative finance, where decisions in portfolio allocation, derivative pricing, and risk management rely on estimating stochastic models from limited data. In practice, the…

Computational Finance · Quantitative Finance 2025-06-10 Hans Buehler , Blanka Horvath , Yannick Limmer , Thorsten Schmidt

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

Building on recent advances in scientific machine learning and generative modeling for computational fluid dynamics, we propose a conditional score-based diffusion model designed for multi-scenarios fluid flow prediction. Our model…

Machine Learning · Computer Science 2025-06-02 Wilfried Genuist , Éric Savin , Filippo Gatti , Didier Clouteau

For a Bayesian, real-time forecasting with the posterior predictive distribution can be challenging for a variety of time series models. First, estimating the parameters of a time series model can be difficult with sample-based approaches…

Applications · Statistics 2022-08-08 Taylor R. Brown

We present an ``equation-free'' multiscale approach to the simulation of unsteady diffusion in a random medium. The diffusivity of the medium is modeled as a random field with short correlation length, and the governing equations are cast…

Numerical Analysis · Mathematics 2007-05-23 Dongbin Xiu , Ioannis Kevrekidis

Multivariate time series forecasting is widely used in various fields. Reasonable prediction results can assist people in planning and decision-making, generate benefits and avoid risks. Normally, there are two characteristics of time…

Machine Learning · Computer Science 2021-03-23 Yifu Zhou , Ziheng Duan , Haoyan Xu , Jie Feng , Anni Ren , Yueyang Wang , Xiaoqian Wang

Despite numerous research efforts in applying deep learning to time series forecasting, achieving high accuracy in multi-step predictions for volatile time series like crude oil prices remains a significant challenge. Moreover, most…

Machine Learning · Computer Science 2024-07-17 Mohammed Alruqimi , Luca Di Persio

Predicting chaotic dynamical systems is critical in many scientific fields, such as weather forecasting, but challenging due to the characteristic sensitive dependence on initial conditions. Traditional modeling approaches require extensive…

Machine Learning · Computer Science 2025-03-12 Christof Schötz , Alistair White , Maximilian Gelbrecht , Niklas Boers

Accurate assessment of systematic uncertainties is an increasingly vital task in physics studies, where large, high-dimensional datasets, like those collected at the Large Hadron Collider, hold the key to new discoveries. Common approaches…

Methodology · Statistics 2025-10-02 Alexis Romero , Kyle Cranmer , Daniel Whiteson

Controlling a large population, in the limit, a continuum, of structurally identical dynamical systems with parametric variations is a pervasive task in diverse applications in science and engineering. However, the severely underactuated…

Optimization and Control · Mathematics 2020-09-08 Vignesh Narayanan , Wei Zhang , Jr-Shin Li