English
Related papers

Related papers: Towards physically consistent data-driven weather …

200 papers

High-resolution precipitation forecasts are crucial for providing accurate weather prediction and supporting effective responses to extreme weather events. Traditional numerical models struggle with stochastic subgrid-scale processes, while…

Machine Learning · Computer Science 2025-01-07 Shuangshuang He , Hongli Liang , Yuanting Zhang , Xingyuan Yuan

Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying…

Recent advancements in evaluating matrix-exponential functions have opened the doors to the practical use of exponential time-integration methods in numerical weather prediction (NWP). The success of exponential methods in shallow water…

Fluid Dynamics · Physics 2023-09-19 Greg Rainwater , Kevin C. Viner , P. Alex Reinecke

In this paper, we present SSDNet, a novel deep learning approach for time series forecasting. SSDNet combines the Transformer architecture with state space models to provide probabilistic and interpretable forecasts, including trend and…

Machine Learning · Computer Science 2021-12-21 Yang Lin , Irena Koprinska , Mashud Rana

4D-variational data assimilation is applied to the Lorenz '63 model to introduce a new method for parameter estimation in chaotic climate models. The approach aims to optimise an Earth system model (ESM), for which no adjoint exists, by…

Atmospheric and Oceanic Physics · Physics 2025-04-18 Philip David Kennedy , Abhirup Banerjee , Armin Köhl , Detlef Stammer

Deep neural networks (DNNs) are receiving increasing attention in wind power forecasting due to their ability to effectively capture complex patterns in wind data. However, their forecasted errors are severely limited by the local optimal…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Wenlong Liao , Fernando Porte-Agel , Jiannong Fang , Birgitte Bak-Jensen , Zhe Yang , Gonghao Zhang

Deep neural networks offer an alternative paradigm for modeling weather conditions. The ability of neural models to make a prediction in less than a second once the data is available and to do so with very high temporal and spatial…

Atmospheric and Oceanic Physics · Physics 2023-07-07 Marcin Andrychowicz , Lasse Espeholt , Di Li , Samier Merchant , Alexander Merose , Fred Zyda , Shreya Agrawal , Nal Kalchbrenner

The field of urban spatial-temporal prediction is advancing rapidly with the development of deep learning techniques and the availability of large-scale datasets. However, challenges persist in accessing and utilizing diverse urban…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Chengkai Han , Wayne Xin Zhao , Jingyuan Wang

Data-driven weather models have made rapid advances in recent years, reaching and in some metrics surpassing the large-scale forecast skill of operational numerical weather prediction. This progress, however, has been built almost entirely…

Atmospheric and Oceanic Physics · Physics 2026-05-07 Congyi Nai , Baoxiang Pan , Yuan Liang , Xi Chen

Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. However, traditional methods often struggle to capture the complex dynamics of meteorological systems, particularly in the presence…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jiaze Wang , Hao Chen , Hongcan Xu , Jinpeng Li , Bowen Wang , Kun Shao , Furui Liu , Huaxi Chen , Guangyong Chen , Pheng-Ann Heng

Long-range geophysical forecasts are fundamentally limited by chaotic dynamics and numerical errors. While data assimilation can mitigate these issues, classical variational smoothers require computationally expensive tangent-linear and…

Machine Learning · Computer Science 2026-02-24 Phillip Si , Peng Chen

In this work, we tackle two widespread challenges in real applications for time-series forecasting that have been largely understudied: distribution shifts and missing data. We propose SpectraNet, a novel multivariate time-series…

Machine Learning · Computer Science 2022-10-26 Cristian Challu , Peihong Jiang , Ying Nian Wu , Laurent Callot

Time series forecasting is crucial for various applications, such as weather, traffic, electricity, and energy predictions. Currently, common time series forecasting methods are based on Transformers. However, existing approaches primarily…

Machine Learning · Computer Science 2025-09-30 Zixu Wang , Hongbin Dong , Xiaoping Zhang

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Heat waves are projected to increase in frequency and severity with global warming. Improved warning systems would help reduce the associated loss of lives, wildfires, power disruptions, and reduction in crop yields. In this work, we…

Atmospheric and Oceanic Physics · Physics 2023-01-13 Ignacio Lopez-Gomez , Amy McGovern , Shreya Agrawal , Jason Hickey

Deep learning and data-driven approaches have shown great potential in scientific domains. The promise of data-driven techniques relies on the availability of a large volume of high-quality training datasets. Due to the high cost of…

Machine Learning · Computer Science 2022-02-08 Yuxin Yang , Xitong Zhang , Qiang Guan , Youzuo Lin

Accurate day-ahead electricity price forecasting (DAEPF) is critical for the efficient operation of power systems, but extreme condition and market anomalies pose significant challenges to existing forecasting methods. To overcome these…

Machine Learning · Computer Science 2025-11-11 Boyan Tang , Xuanhao Ren , Peng Xiao , Shunbo Lei , Xiaorong Sun , Jianghua Wu

Variational data assimilation estimates the dynamical system states by minimizing a cost function that fits the numerical models with the observational data. Although four-dimensional variational assimilation (4D-Var) is widely used, it…

Machine Learning · Computer Science 2025-06-16 Yiming Yang , Xiaoyuan Cheng , Daniel Giles , Sibo Cheng , Yi He , Xiao Xue , Boli Chen , Yukun Hu