English
Related papers

Related papers: Demystifying Data-Driven Probabilistic Medium-Rang…

200 papers

We discuss an approach to probabilistic forecasting based on two chained machine-learning steps: a dimensional reduction step that learns a reduction map of predictor information to a low-dimensional space in a manner designed to preserve…

Machine Learning · Statistics 2022-03-28 Nick Rittler , Carlo Graziani , Jiali Wang , Rao Kotamarthi

The automated construction of coarse-grained models represents a pivotal component in computer simulation of physical systems and is a key enabler in various analysis and design tasks related to uncertainty quantification. Pertinent methods…

Machine Learning · Statistics 2019-09-11 Constantin Grigo , Phaedon-Stelios Koutsourelakis

Data-driven machine learning models for weather forecasting have made transformational progress in the last 1-2 years, with state-of-the-art ones now outperforming the best physics-based models for a wide range of skill scores. Given the…

Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our…

Artificial Intelligence · Computer Science 2024-02-14 Minjong Cheon , Daehyun Kang , Yo-Hwan Choi , Seon-Yu Kang

Data-driven weather prediction models exhibit promising performance and advance continuously. In particular, diffusion models represent fine-scale details without spatial smoothing, which is crucial for mesoscale predictions, such as heavy…

Machine Learning · Computer Science 2025-03-26 Yuta Hirabayashi , Daisuke Matsuoka

Chaotic systems, such as turbulent flows, are ubiquitous in science and engineering. However, their study remains a challenge due to the large range scales, and the strong interaction with other, often not fully understood, physics. As a…

The modeling of probability distributions, specifically generative modeling and density estimation, has become an immensely popular subject in recent years by virtue of its outstanding performance on sophisticated data such as images and…

Machine Learning · Statistics 2023-01-02 Hongkang Yang

Scenario-based probabilistic forecasts have become vital for decision-makers in handling intermittent renewable energies. This paper presents a recent promising deep learning generative approach called denoising diffusion probabilistic…

Machine Learning · Computer Science 2023-08-22 Esteban Hernandez Capel , Jonathan Dumas

Accurate weather forecasting is essential for socioeconomic activities. While data-driven forecasting demonstrates superior predictive capabilities over traditional Numerical Weather Prediction (NWP) with reduced computational demands, its…

Atmospheric and Oceanic Physics · Physics 2024-12-12 Congyi Nai , Xi Chen , Shangshang Yang , Yuan Liang , Ziniu Xiao , Baoxiang Pan

Precipitation nowcasting based on radar data plays a crucial role in extreme weather prediction and has broad implications for disaster management. Despite progresses have been made based on deep learning, two key challenges of…

Machine Learning · Computer Science 2024-02-08 Junchao Gong , Lei Bai , Peng Ye , Wanghan Xu , Na Liu , Jianhua Dai , Xiaokang Yang , Wanli Ouyang

As the peak of the solar cycle approaches in 2025 and the ability of a single geomagnetic storm to significantly alter the orbit of Resident Space Objects (RSOs), techniques for atmospheric density forecasting are vital for space…

Atmospheric and Oceanic Physics · Physics 2023-10-27 Julia Briden , Peng Mun Siew , Victor Rodriguez-Fernandez , Richard Linares

The field of meteorological forecasting has undergone a significant transformation with the integration of large models, especially those employing deep learning techniques. This paper reviews the advancements and applications of these…

Machine Learning · Computer Science 2024-04-11 Hailong Shu , Yue Wang , Weiwei Song , Huichuang Guo , Zhen Song

Uncertainty quantification is crucial to decision-making. A prominent example is probabilistic forecasting in numerical weather prediction. The dominant approach to representing uncertainty in weather forecasting is to generate an ensemble…

Machine Learning · Computer Science 2023-10-10 Lizao Li , Rob Carver , Ignacio Lopez-Gomez , Fei Sha , John Anderson

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

As in many other areas of engineering and applied science, Machine Learning (ML) is having a profound impact in the domain of Weather and Climate Prediction. A very recent development in this area has been the emergence of fully data-driven…

Machine Learning · Statistics 2023-11-06 Massimo Bonavita

Most of the methods that produce space weather forecasts are based on deterministic models. In order to generate a probabilistic forecast, a model needs to be run several times sampling the input parameter space, in order to generate an…

Space Physics · Physics 2019-05-01 Enrico Camporeale , Xiangning Chu , Oleksiy Agapitov , Jacob Bortnik

Weather forecasting is essential for various human activities. Recent data-driven models have outperformed numerical weather prediction by utilizing deep learning in forecasting performance. However, challenges remain in efficiently…

Machine Learning · Computer Science 2024-07-01 Ayumu Ueyama , Kazuhiko Kawamoto , Hiroshi Kera

We present a new framework for the assessment and calibration of medium range ensemble temperature forecasts. The method is based on maximising the likelihood of a simple parametric model for the temperature distribution, and leads to some…

Atmospheric and Oceanic Physics · Physics 2009-11-10 Stephen Jewson , Anders Brix , Christine Ziehmann

We present a significantly-improved data-driven global weather forecasting framework using a deep convolutional neural network (CNN) to forecast several basic atmospheric variables on a global grid. New developments in this framework…

Atmospheric and Oceanic Physics · Physics 2020-10-14 Jonathan A. Weyn , Dale R. Durran , Rich Caruana

Numerical Weather Prediction (NWP) has advanced significantly in recent decades but still faces challenges in accuracy, computational efficiency, and scalability. Data-driven weather models have shown great promise, sometimes surpassing…

Atmospheric and Oceanic Physics · Physics 2025-03-18 Animesh Choudhury , Jagabandhu Panda