English
Related papers

Related papers: CERA: A Framework for Improved Generalization of M…

200 papers

We introduce a self-supervised speech pre-training method called TERA, which stands for Transformer Encoder Representations from Alteration. Recent approaches often learn by using a single auxiliary task like contrastive prediction,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-05 Andy T. Liu , Shang-Wen Li , Hung-yi Lee

Persistent systematic errors in Earth system models (ESMs) arise from difficulties in representing the full diversity of subgrid, multiscale atmospheric convection and turbulence. Machine learning (ML) parameterizations trained on short…

Atmospheric and Oceanic Physics · Physics 2026-05-18 Helge Heuer , Tom Beucler , Mierk Schwabe , Julien Savre , Manuel Schlund , Veronika Eyring

Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources.…

Machine Learning · Computer Science 2024-03-19 Minjong Cheon , Yo-Hwan Choi , Seon-Yu Kang , Yumi Choi , Jeong-Gil Lee , Daehyun Kang

Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables,…

Machine Learning · Computer Science 2023-12-19 Tung Nguyen , Johannes Brandstetter , Ashish Kapoor , Jayesh K. Gupta , Aditya Grover

This study introduces ReSA-ConvLSTM, an artificial intelligence (AI) framework for systematic bias correction in numerical weather prediction (NWP). We propose three innovations by integrating dynamic climatological normalization, ConvLSTM…

Machine Learning · Computer Science 2025-04-23 Xiao Zhou , Yuze Sun , Jie Wu , Xiaomeng Huang

Due to the rapidly changing climate, the frequency and severity of extreme weather is expected to increase over the coming decades. As fully-resolved climate simulations remain computationally intractable, policy makers must rely on…

Atmospheric and Oceanic Physics · Physics 2024-02-29 Benedikt Barthel Sorensen , Alexis Charalampopoulos , Shixuan Zhang , Bryce Harrop , Ruby Leung , Themistoklis Sapsis

Weather and climate models rely on parametrisations to represent unresolved sub-grid processes. Traditional schemes rely on fixed coefficients that are weakly constrained and tuned offline, contributing to persistent biases that limit their…

Machine Learning · Computer Science 2026-04-09 Pritthijit Nath , Sebastian Schemm , Henry Moss , Peter Haynes , Emily Shuckburgh , Mark J. Webb

Most operational climate services providers base their seasonal predictions on initialised general circulation models (GCMs) or statistical techniques that fit past observations. GCMs require substantial computational resources, which…

Climate models play a critical role in understanding and projecting climate change. Due to their complexity, their horizontal resolution of about 40-100 km remains too coarse to resolve processes such as clouds and convection, which need to…

Machine Learning · Computer Science 2025-03-18 Birgit Kühbacher , Fernando Iglesias-Suarez , Niki Kilbertus , Veronika Eyring

Data assimilation (DA) integrates observations with model forecasts to produce optimized atmospheric states, whose physical consistency is critical for stable weather forecasting and reliable climate research. Traditional Bayesian DA…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Hang Fan , Lei Bai , Ben Fei , Yi Xiao , Kun Chen , Yubao Liu , Yongquan Qu , Fenghua Ling , Pierre Gentine

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Climate simulations, at all grid resolutions, rely on approximations that encapsulate the forcing due to unresolved processes on resolved variables, known as parameterizations. Parameterizations often lead to inaccuracies in climate models,…

Producing high-quality forecasts of key climate variables, such as temperature and precipitation, on subseasonal time scales has long been a gap in operational forecasting. This study explores an application of machine learning (ML) models…

Machine Learning · Computer Science 2024-09-17 Elena Orlova , Haokun Liu , Raphael Rossellini , Benjamin A. Cash , Rebecca Willett

Quantifying the impacts of anthropogenic global warming requires accurate Earth system model (ESM) simulations. Statistical bias correction and downscaling can be applied to reduce errors and increase the resolution of ESMs. However,…

Geophysics · Physics 2024-06-24 Philipp Hess , Niklas Boers

Climate models are essential to understand and project climate change, yet long-standing biases and uncertainties in their projections remain. This is largely associated with the representation of subgrid-scale processes, particularly…

Weather forecasting refers to learning evolutionary patterns of some key upper-air and surface variables which is of great significance. Recently, deep learning-based methods have been increasingly applied in the field of weather…

Machine Learning · Computer Science 2024-07-30 Shuangliang Li , Siwei Li

Machine learning and deep learning methods have been widely explored in understanding the chaotic behavior of the atmosphere and furthering weather forecasting. There has been increasing interest from technology companies, government…

Dynamical weather and climate prediction models underpin many studies of the Earth system and hold the promise of being able to make robust projections of future climate change based on physical laws. However, simulations from these models…

Atmospheric and Oceanic Physics · Physics 2019-09-04 Peter A. G. Watson

In this paper we discuss and address the challenges of predicting extreme atmospheric events like intense rainfall, hail, and strong winds. These events can cause significant damage and have become more frequent due to climate change.…

Atmospheric and Oceanic Physics · Physics 2023-10-06 Mikhail Mozikov , Ilya Makarov , Alexandr Bulkin , Daria Taniushkina , Roland Grinis , Yury Maximov

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik