English
Related papers

Related papers: Probabilistic Forecasting using Deep Generative Mo…

200 papers

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

In various applications, probabilistic forecasts are required to quantify the inherent uncertainty associated with the forecast. However, numerous modern forecasting methods are still designed to create deterministic forecasts. Transforming…

Machine Learning · Computer Science 2023-02-06 Kaleb Phipps , Benedikt Heidrich , Marian Turowski , Moritz Wittig , Ralf Mikut , Veit Hagenmeyer

Accurately quantifying the increased risks of climate extremes requires generating large ensembles of climate realization across a wide range of emissions scenarios, which is computationally challenging for conventional Earth System Models.…

Computational Physics · Physics 2025-08-22 Mengze Wang , Benedikt Barthel Sorensen , Themistoklis Sapsis

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and outputs. Each…

Computation · Statistics 2015-09-18 Carlo Albert

Accurate prediction of wind power is essential for the grid integration of this intermittent renewable source and aiding grid planners in forecasting available wind capacity. Spatial differences lead to discrepancies in climatological data…

Machine Learning · Computer Science 2024-05-21 Md Saiful Islam Sajol , Md Shazid Islam , A S M Jahid Hasan , Md Saydur Rahman , Jubair Yusuf

Stochastic generators are useful for estimating climate impacts on various sectors. Projecting climate risk in various sectors, e.g. energy systems, requires generators that are accurate (statistical resemblance to ground-truth), reliable…

Machine Learning · Computer Science 2024-10-22 Emmanuel Balogun , Ram Rajagopal , Arun Majumdar

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Understanding how droughts may change in the future is essential for anticipating and mitigating their adverse impacts. However, robust climate projections require large amounts of high-resolution climate simulations, particularly for…

Atmospheric and Oceanic Physics · Physics 2025-09-29 Hamish Lewis , Neelesh Rampal , Peter B. Gibson , Luke J. Harrington , Chiara M. Holgate , Anna Ukkola , Nicola M. Maher

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Statistical postprocessing is used to translate ensembles of raw numerical weather forecasts into reliable probabilistic forecast distributions. In this study, we examine the use of permutation-invariant neural networks for this task. In…

Machine Learning · Statistics 2024-01-22 Kevin Höhlein , Benedikt Schulz , Rüdiger Westermann , Sebastian Lerch

Power system state estimation (PSSE) is commonly formulated as weighted least-square (WLS) algorithm and solved using iterative methods such as Gauss-Newton methods. However, iterative methods have become more sensitive to system operating…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Narayan Bhusal , Raj Mani Shukla , Mukesh Gautam , Mohammed Benidris , Shamik Sengupta

While numerical weather prediction (NWP) models are essential for forecasting thunderstorms hours in advance, NWP uncertainty, which increases with lead time, limits the predictability of thunderstorm occurrence. This study investigates how…

Atmospheric and Oceanic Physics · Physics 2025-02-20 Kianusch Vahid Yousefnia , Tobias Bölle , Christoph Metzl

In this study, an efficient stochastic gradient-free method, the ensemble neural networks (ENN), is developed. In the ENN, the optimization process relies on covariance matrices rather than derivatives. The covariance matrices are…

Machine Learning · Statistics 2019-11-11 Yuntian Chen , Haibin Chang , Meng Jin , Dongxiao Zhang

In this paper, we give an in-depth analysis on the mathematical problem formulations and the probabilistic optimization explorations for some of the key components in Transformer model [33] in the field of generative AI. We explore and…

Machine Learning · Computer Science 2024-10-25 Fulu Li

Accurate forecasting of spatiotemporal data remains challenging due to complex spatial dependencies and temporal dynamics. The inherent uncertainty and variability in such data often render deterministic models insufficient, prompting a…

Machine Learning · Computer Science 2024-11-05 Mingze Gong , Lei Chen , Jia Li

The prediction of near surface wind speed is becoming increasingly vital for the operation of electrical energy grids as the capacity of installed wind power grows. The majority of predictive wind speed modeling has focused on point-based…

Machine Learning · Computer Science 2017-12-15 Jianan Cao , David J. Farnham , Upmanu Lall

Accurate weather forecasting holds significant importance, serving as a crucial tool for decision-making in various industrial sectors. The limitations of statistical models, assuming independence among data points, highlight the need for…

Machine Learning · Computer Science 2025-01-22 Anuvab Sen , Udayon Sen , Mayukhi Paul , Apurba Prasad Padhy , Sujith Sai , Aakash Mallik , Chhandak Mallick

Rainfall ensemble forecasts have to be skillful for both low precipitation and extreme events. We present statistical post-processing methods based on Quantile Regression Forests (QRF) and Gradient Forests (GF) with a parametric extension…

Machine Learning · Statistics 2019-06-07 Maxime Taillardat , Anne-Laure Fougères , Philippe Naveau , Olivier Mestre

The extensive penetration of wind farms (WFs) presents challenges to the operation of distribution networks (DNs). Building a probability distribution of the aggregated wind power forecast error is of great value for decision making.…

Signal Processing · Electrical Eng. & Systems 2018-12-19 Mengshuo Jia , Chen Shen , Zhiwen Wang