English
Related papers

Related papers: Fixing the Double Penalty in Data-Driven Weather F…

200 papers

The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate…

Forecast verification plays a crucial role in the development cycle of operational numerical weather prediction models. At the same time, verification remains a challenge as the traditionally used non-spatial forecast quality metrics…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Gregor Skok , Katarina Kosovelj

This work studies the multi-task functional linear regression models where both the covariates and the unknown regression coefficients (called slope functions) are curves. For slope function estimation, we employ penalized splines to…

Statistics Theory · Mathematics 2023-08-02 Shiyuan He , Hanxuan Ye , Kejun He

Accurate precipitation forecasting is becoming increasingly important in the context of climate change. In response, machine learning-based approaches have recently gained attention as an emerging alternative to traditional methods such as…

Machine Learning · Computer Science 2025-11-17 Jaeho Choi , Hyeri Kim , Kwang-Ho Kim , Jaesung Lee

Weather forecasting requires not only accuracy but also the ability to perform probabilistic prediction. However, deterministic weather forecasting methods do not support probabilistic predictions, and conversely, probabilistic models tend…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Donggeun Yoon , Minseok Seo , Doyi Kim , Yeji Choi , Donghyeon Cho

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

We discuss an approach to probabilistic forecasting based on two chained machine-learning steps: a dimensional reduction step that learns a reduction map of predictor information to a low-dimensional space in a manner designed to preserve…

Machine Learning · Statistics 2022-03-28 Nick Rittler , Carlo Graziani , Jiali Wang , Rao Kotamarthi

Recent years have seen a surge in interest in building deep learning-based fully data-driven models for weather prediction. Such deep learning models if trained on observations can mitigate certain biases in current state-of-the-art weather…

Machine Learning · Computer Science 2022-05-11 Ashesh Chattopadhyay , Jaideep Pathak , Ebrahim Nabizadeh , Wahid Bhimji , Pedram Hassanzadeh

This paper proposes a dynamic regression (DR) framework that enhances existing deep spatiotemporal models by incorporating structured learning for the error process in traffic forecasting. The framework relaxes the assumption of time…

Machine Learning · Computer Science 2025-04-09 Vincent Zhihao Zheng , Seongjin Choi , Lijun Sun

In this paper, prediction for linear systems with missing information is investigated. New methods are introduced to improve the Mean Squared Error (MSE) on the test set in comparison to state-of-the-art methods, through appropriate tuning…

Machine Learning · Statistics 2017-01-04 Mohammad Amin Fakharian , Ashkan Esmaeili , Farokh Marvasti

The classification of weather data involves categorizing meteorological phenomena into classes, thereby facilitating nuanced analyses and precise predictions for various sectors such as agriculture, aviation, and disaster management. This…

Machine Learning · Computer Science 2023-10-23 Elaheh Jafarigol , Theodore Trafalis

A novel approach to quantile estimation in multivariate linear regression models with change-points is proposed: the change-point detection and the model estimation are both performed automatically, by adopting either the quantile fused…

Statistics Theory · Mathematics 2019-04-10 Gabriela Ciuperca , Matus Maciak

Ensemble forecasting systems have advanced meteorology by providing probabilistic estimates of future states. Nonetheless, systematic biases often persist, making statistical post-processing essential. Traditional parametric post-processing…

Applications · Statistics 2026-02-17 Mária Lakatos

Accurate time series forecasting models are often compromised by data drift, where underlying data distributions change over time, leading to significant declines in prediction performance. To address this challenge, this study proposes an…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Nikhil Pawar , Guilherme Vieira Hollweg , Akhtar Hussain , Wencong Su , Van-Hai Bui

Long-term stability stands as a crucial requirement in data-driven medium-range global weather forecasting. Spectral bias is recognized as the primary contributor to instabilities, as data-driven methods difficult to learn small-scale…

Machine Learning · Computer Science 2024-07-03 Yifan Hu , Fukang Yin , Weimin Zhang , Kaijun Ren , Junqiang Song , Kefeng Deng , Di Zhang

Meaningful scores for forecast verification are essential for developing reliable forecasts, and there has been much effort to develop scores that align well with human perceptions of forecast quality. Whilst many of these scores have…

Atmospheric and Oceanic Physics · Physics 2026-03-17 Bobby Antonio

Operational meteorological forecasting has long relied on physics-based numerical weather prediction (NWP) models. Recently, this landscape has faced disruption by the advent of data-driven artificial intelligence (AI)-based weather models,…

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy…

Rolling origin forecast instability refers to variability in forecasts for a specific period induced by updating the forecast when new data points become available. Recently, an extension to the N-BEATS model for univariate time series…

Machine Learning · Computer Science 2025-01-22 Daan Caljon , Jeff Vercauteren , Simon De Vos , Wouter Verbeke , Jente Van Belle