English
Related papers

Related papers: Fixing the Double Penalty in Data-Driven Weather F…

200 papers

Penalization procedures often suffer from their dependence on multiplying factors, whose optimal values are either unknown or hard to estimate from the data. We propose a completely data-driven calibration algorithm for this parameter in…

Statistics Theory · Mathematics 2010-07-02 Sylvain Arlot , Pascal Massart

Accurate prediction of wind speed and power is vital for enhancing the efficiency of wind energy systems. Numerous solutions have been implemented to date, demonstrating their potential to improve forecasting. Among these, deep learning is…

Machine Learning · Computer Science 2024-01-17 Mulomba Mukendi Christian , Yun Seon Kim , Hyebong Choi , Jaeyoung Lee , SongHee You

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Doubly truncated data arise in many areas such as astronomy, econometrics, and medical studies. For the regression analysis with doubly truncated response variables, the existence of double truncation may bring bias for estimation as well…

Methodology · Statistics 2021-10-22 Ming Zheng , Chanjuan Lin , Wen Yu

Significant wave height is one of the most important parameters characterizing ocean waves, and accurate numerical ocean wave forecasting is crucial for coastal protection and shipping. However, due to the randomness and nonlinearity of the…

Atmospheric and Oceanic Physics · Physics 2023-12-01 Wei Zhang , Yu Sun , Yapeng Wu , Junyu Dong , Xiaojiang Song , Zhiyi Gao , Renbo Pang , Boyu Guoan

Weather forecasting is usually solved through numerical weather prediction (NWP), which can sometimes lead to unsatisfactory performance due to inappropriate setting of the initial states. In this paper, we design a data-driven method…

Machine Learning · Computer Science 2019-02-05 Bin Wang , Jie Lu , Zheng Yan , Huaishao Luo , Tianrui Li , Yu Zheng , Guangquan Zhang

Neural networks and in particular the attention mechanism have brought significant advances to the field of Automated Essay Scoring. Many of these systems use a regression-based model which may be prone to underfitting when the model only…

Computation and Language · Computer Science 2023-05-19 Oscar Morris

All machine learning algorithms use a loss, cost, utility or reward function to encode the learning objective and oversee the learning process. This function that supervises learning is a frequently unrecognized hyperparameter that…

Neural and Evolutionary Computing · Computer Science 2024-11-06 Mathew Mithra Noel , Arindam Banerjee , Yug Oswal , Geraldine Bessie Amali D , Venkataraman Muthiah-Nakarajan

Uncertainty analysis in the form of probabilistic forecasting can significantly improve decision making processes in the smart power grid for better integrating renewable energy sources such as wind. Whereas point forecasting provides a…

Machine Learning · Statistics 2017-10-05 Kostas Hatalis , Alberto J. Lamadrid , Katya Scheinberg , Shalinee Kishore

Forecasting weather accurately and efficiently is a critical capability in our ability to adapt to climate change. Data driven approaches to this problem have enjoyed much success recently providing forecasts with accuracy comparable to…

Atmospheric and Oceanic Physics · Physics 2025-06-11 Akshay Subramaniam , Dale Durran , David Pruitt , Nathaniel Cresswell-Clay , William Yik

Recent statistical postprocessing methods for wind speed forecasts have incorporated linear models and neural networks to produce more skillful probabilistic forecasts in the low-to-medium wind speed range. At the same time, these methods…

Applications · Statistics 2025-04-18 Simon Hakvoort , Bastien Francois , Kirien Whan , Sjoerd Dirksen

Machine learning emulators have shown extraordinary skill in forecasting atmospheric states, and their application to global ocean dynamics offers similar promise. Here, we adapt the GraphCast architecture into a dedicated ocean-only…

Atmospheric and Oceanic Physics · Physics 2026-04-22 Niraj Agarwal , Timothy A. Smith , Sergey Frolov , Laura C. Slivinski

Probabilistic wind power forecasting approaches have significantly advanced in recent decades. However, forecasters often assume data completeness and overlook the challenge of missing values resulting from sensor failures, network…

Applications · Statistics 2024-04-25 Honglin Wen

Motivated by recent advances in operational weather forecasting, we study the efficacy of low-precision arithmetic for climate simulations. We develop a framework to measure rounding error in a climate model which provides a stress-test for…

Atmospheric and Oceanic Physics · Physics 2022-02-23 E. Adam Paxton , Matthew Chantry , Milan Klöwer , Leo Saffin , Tim Palmer

Sudden Stratospheric Warmings (SSWs) are key sources of subseasonal predictability and major drivers of extreme weather in winter. Accurate and efficient probabilistic forecasting of these events remains a persistent challenge for Numerical…

Machine Learning · Computer Science 2026-02-24 Ningning Tao , Fei Xie , Baoxiang Pan , Hongyu Wang , Han Huang , Zhongpu Qiu , Ke Gui , Jiali Luo , Xiaosong Chen

Machine learning-based weather forecasting models now surpass state-of-the-art numerical weather prediction systems, but training and operating these models at high spatial resolution remains computationally expensive. We present a modular…

Machine Learning · Computer Science 2026-04-02 Aymeric Delefosse , Anastase Charantonis , Dominique Béréziat

Lossy data transformations by definition lose information. Yet, in modern machine learning, methods like data pruning and lossy data augmentation can help improve generalization performance. We study this paradox using a solvable model of…

Statistical Mechanics · Physics 2025-09-19 Alex Nguyen , David J. Schwab , Vudtiwat Ngampruetikorn

Data-driven models are revolutionizing weather forecasting. To optimize training efficiency and model performance, this paper analyzes empirical scaling laws within this domain. We investigate the relationship between model performance…

Machine Learning · Computer Science 2026-02-27 Yuejiang Yu , Langwen Huang , Alexandru Calotoiu , Torsten Hoefler

Evolving feature densities across batches of training data bias cross-validation, making model selection and assessment unreliable (\cite{sugiyama2012machine}). This work takes a distributed density estimation angle to the training setting…

Machine Learning · Computer Science 2025-02-25 Behraj Khan , Behroz Mirza , Tahir Syed

Weather forecasting remains a crucial yet challenging domain, where recently developed models based on deep learning (DL) have approached the performance of traditional numerical weather prediction (NWP) models. However, these DL models,…

Atmospheric and Oceanic Physics · Physics 2024-02-13 Zhanxiang Hua , Yutong He , Chengqian Ma , Alexandra Anderson-Frey