English
Related papers

Related papers: Earth System Foundation Model (ESFM): A unified fr…

200 papers

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

As artificial intelligence (AI) continues to rapidly evolve, the realm of Earth and atmospheric sciences is increasingly adopting data-driven models, powered by progressive developments in deep learning (DL). Specifically, DL techniques are…

Machine Learning · Computer Science 2023-12-07 Shengchao Chen , Guodong Long , Jing Jiang , Dikai Liu , Chengqi Zhang

A key challenge for computationally intensive state-of-the-art Earth System models is to distinguish global warming signals from interannual variability. Here we introduce DLESyM, a parsimonious deep learning model that accurately simulates…

Atmospheric and Oceanic Physics · Physics 2025-10-21 Nathaniel Cresswell-Clay , Bowen Liu , Dale Durran , Zihui Liu , Zachary I. Espinosa , Raul Moreno , Matthias Karlbauer

In the fields of computer vision (CV) and remote sensing (RS), foundational models typically follow the "big data + large model parameters" paradigm. However, the application of this strategy in seismic data processing faces several…

Geophysics · Physics 2025-03-14 Xintong Dong , Wenshuo Yu , Jun Lin , Zhenbo Guo , Hongzhou Wang , Jianhao Yang

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most…

Advances in machine learning over the past decade have resulted in a proliferation of algorithmic applications for encoding, characterizing, and acting on complex data that may contain many high dimensional features. Recently, the emergence…

The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g.,…

To tackle the global climate challenge, it urgently needs to develop a collaborative platform for comprehensive weather forecasting on large-scale meteorological data. Despite urgency, heterogeneous meteorological sensors across countries…

Machine Learning · Computer Science 2023-05-30 Shengchao Chen , Guodong Long , Tao Shen , Jing Jiang

Geospatial foundation models (GFMs) for Earth observation often fail to perform reliably in environments underrepresented during pretraining. We introduce SHRUG-FM, a framework for reliability-aware prediction that enables GFMs to identify…

The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time…

Machine Learning · Computer Science 2025-07-15 Sami Achour , Yassine Bouher , Duong Nguyen , Nicolas Chesneau

Climate models, such as Earth system models (ESMs), are crucial for simulating future climate change based on projected Shared Socioeconomic Pathways (SSP) greenhouse gas emissions scenarios. While ESMs are sophisticated and invaluable,…

Foundation models (FMs) currently dominate news headlines. They employ advanced deep learning architectures to extract structural information autonomously from vast datasets through self-supervision. The resulting rich representations of…

This study investigates zero-shot forecasting capabilities of Time Series Foundation Models (TSFMs) for macroeconomic indicators. We apply TSFMs to forecasting economic indicators under univariate conditions, bypassing the need for train…

Machine Learning · Computer Science 2025-11-05 Jittarin Jetwiriyanon , Teo Susnjak , Surangika Ranathunga

Machine learning and deep learning methods have been widely explored in understanding the chaotic behavior of the atmosphere and furthering weather forecasting. There has been increasing interest from technology companies, government…

Modeling environmental ecosystems is critical for the sustainability of our planet, but is extremely challenging due to the complex underlying processes driven by interactions amongst a large number of physical variables. As many variables…

Machine Learning · Computer Science 2025-10-13 Shiyuan Luo , Juntong Ni , Shengyu Chen , Runlong Yu , Yiqun Xie , Licheng Liu , Zhenong Jin , Huaxiu Yao , Xiaowei Jia

Large computer models are ubiquitous in the earth sciences. These models often have tens or hundreds of tuneable parameters and can take thousands of core-hours to run to completion while generating terabytes of output. It is becoming…

Atmospheric and Oceanic Physics · Physics 2022-03-21 Duncan Watson-Parris , Andrew Williams , Lucia Deaconu , Philip Stier

Reliable forecasts of the Earth system are crucial for human progress and safety from natural disasters. Artificial intelligence offers substantial potential to improve prediction accuracy and computational efficiency in this field, however…

The development of Time-Series Forecasting (TSF) models is often constrained by the lack of comprehensive datasets, especially in Global Station Weather Forecasting (GSWF), where existing datasets are small, temporally short, and spatially…

Machine Learning · Computer Science 2026-04-01 Tao Han , Zhibin Wen , Zhenghao Chen , Dazhao Du , Song Guo , Lei Bai

We present an operations-ready multi-model ensemble weather forecasting system which uses hybrid data-driven weather prediction models coupled with the European Centre for Medium-range Weather Forecasts (ECMWF) ocean model to predict global…

Atmospheric and Oceanic Physics · Physics 2024-03-26 Jonathan A. Weyn , Divya Kumar , Jeremy Berman , Najeeb Kazmi , Sylwester Klocek , Pete Luferenko , Kit Thambiratnam