English
Related papers

Related papers: Utilizing Strategic Pre-training to Reduce Overfit…

200 papers

The rapid adoption of AI in Earth system science promises unprecedented speed and fidelity in the generation of climate information. However, this technological prowess rests on a fragile and unequal foundation: the current trajectory of AI…

The success of deep learning techniques over the last decades has opened up a new avenue of research for weather forecasting. Here, we take the novel approach of using a neural network to predict full probability density functions at each…

Machine Learning · Statistics 2022-01-05 Mariana Clare , Omar Jamil , Cyril Morcrette

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

The rise of accurate machine learning methods for weather forecasting is creating radical new possibilities for modeling the atmosphere. In the time of climate change, having access to high-resolution forecasts from models like these is…

Machine Learning · Computer Science 2023-11-16 Joel Oskarsson , Tomas Landelius , Fredrik Lindsten

Precipitation governs Earth's hydroclimate, and its daily spatiotemporal fluctuations have major socioeconomic effects. Advances in Numerical weather prediction (NWP) have been measured by the improvement of forecasts for various physical…

Atmospheric and Oceanic Physics · Physics 2022-11-14 Manmeet Singh , Vaisakh S B , Nachiketa Acharya , Aditya Grover , Suryachandra A Rao , Bipin Kumar , Zong-Liang Yang , Dev Niyogi

Over the past few years, machine learning-based data-driven weather prediction has been transforming operational weather forecasting by providing more accurate forecasts while using a mere fraction of computing power compared to traditional…

Atmospheric and Oceanic Physics · Physics 2025-08-27 Zekun Ni , Jonathan Weyn , Hang Zhang , Yanfei Xiang , Jiang Bian , Weixin Jin , Kit Thambiratnam , Qi Zhang , Haiyu Dong , Hongyu Sun

Designing early warning system for precipitation requires accurate short-term forecasting system. Climate change has led to an increase in frequency of extreme weather events, and hence such systems can prevent disasters and loss of life.…

Atmospheric and Oceanic Physics · Physics 2023-12-11 Ajitabh Kumar

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Water managers in the western United States (U.S.) rely on longterm forecasts of temperature and precipitation to prepare for droughts and other wet weather extremes. To improve the accuracy of these longterm forecasts, the U.S. Bureau of…

Applications · Statistics 2019-05-23 Jessica Hwang , Paulo Orenstein , Judah Cohen , Karl Pfeiffer , Lester Mackey

The advents of Artificial Intelligence (AI)-driven models marks a paradigm shift in risk management strategies for meteorological hazards. This study specifically employs tropical cyclones (TCs) as a focal example. We engineer a…

Atmospheric and Oceanic Physics · Physics 2024-04-30 Kairui Feng , Dazhi Xi , Wei Ma , Cao Wang , Yuanlong Li , Xuanhong Chen

Numerical Weather Prediction (NWP) system is an infrastructure that exerts considerable impacts on modern society.Traditional NWP system, however, resolves it by solving complex partial differential equations with a huge computing cluster,…

Artificial Intelligence · Computer Science 2024-09-26 Junchao Gong , Tao Han , Kang Chen , Lei Bai

Deep learning models for meteorological forecasting often fail in rare but high-impact events such as typhoons, where relevant data is scarce. Existing fine-tuning methods typically face a trade-off between overlooking these extreme events…

Machine Learning · Computer Science 2026-03-23 Shijie Ren , Xinyue Gu , Ziheng Peng , Haifan Zhang , Peisong Niu , Bo Wu , Xiting Wang , Liang Sun , Jirong Wen

Recently, deep-learning weather forecasting models have surpassed traditional numerical models in terms of the accuracy of meteorological variables. However, there is considerable potential for improvements in precipitation forecasts,…

Atmospheric and Oceanic Physics · Physics 2024-11-20 Weiwen Ji , Jin Feng , Yueqi Liu , Yulu Qiu , Hua Gao

One of the guiding principles for designing AI-based weather forecasting systems is to embed physical constraints as inductive priors in the neural network architecture. A popular prior is locality, where the atmospheric data is processed…

Machine Learning · Computer Science 2024-07-04 Guillaume Couairon , Christian Lessig , Anastase Charantonis , Claire Monteleoni

Long-term stability and physical consistency are critical properties for AI-based weather models if they are going to be used for subseasonal-to-seasonal forecasts or beyond, e.g., climate change projection. However, current AI-based…

Fluid Dynamics · Physics 2024-12-10 Ashesh Chattopadhyay , Y. Qiang Sun , Pedram Hassanzadeh

Climate change is intensifying rainfall extremes, making high-resolution precipitation projections crucial for society to better prepare for impacts such as flooding. However, current Global Climate Models (GCMs) operate at spatial…

Machine Learning · Computer Science 2024-12-20 Ran Lyu , Linhan Wang , Yanshen Sun , Hedanqiu Bai , Chang-Tien Lu

Recent advances in AI-based weather prediction have led to the development of artificial intelligence weather prediction (AIWP) models with competitive forecast skill compared to traditional NWP models, but with substantially reduced…

Atmospheric and Oceanic Physics · Physics 2025-10-30 Nicholas Loveday , Tracy Hertneky

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

Data augmentation serves as a popular regularization technique to combat overfitting challenges in neural networks. While automatic augmentation has demonstrated success in image classification tasks, its application to time-series…

Machine Learning · Computer Science 2025-06-19 Liran Nochumsohn , Omri Azencot

Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time. Although test-time training techniques have been explored to enable adaptation, current approaches rely on an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yuning Wang , Pu Zhang , Yuan He , Ke Wang , Jianru Xue