English
Related papers

Related papers: Earth System Foundation Model (ESFM): A unified fr…

200 papers

Weather forecasting plays a critical role in various sectors, driving decision-making and risk management. However, traditional methods often struggle to capture the complex dynamics of meteorological systems, particularly in the presence…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jiaze Wang , Hao Chen , Hongcan Xu , Jinpeng Li , Bowen Wang , Kun Shao , Furui Liu , Huaxi Chen , Guangyong Chen , Pheng-Ann Heng

Foundation models, as a mainstream technology in artificial intelligence, have demonstrated immense potential across various domains in recent years, particularly in handling complex tasks and multimodal data. In the field of geophysics,…

Geophysics · Physics 2025-04-28 Hanlin Sheng , Xinming Wu , Hang Gao , Haibin Di , Sergey Fomel , Jintao Li , Xu Si

Deep learning-based methods have been widely researched in the areas of language and vision, demonstrating their capacity to understand long sequences of data and their usefulness in numerous helio-physics applications. Foundation models…

Producing high-quality forecasts of key climate variables, such as temperature and precipitation, on subseasonal time scales has long been a gap in operational forecasting. This study explores an application of machine learning (ML) models…

Machine Learning · Computer Science 2024-09-17 Elena Orlova , Haokun Liu , Raphael Rossellini , Benjamin A. Cash , Rebecca Willett

Small Earth data are geoscience observations with limited short-term monitoring variability, providing sparse but meaningful measurements, typically exhibiting spatiotemporal correlations. Spatiotemporal forecasting on such data is crucial…

Machine Learning · Computer Science 2025-10-13 Yuting Yang , Gang Mei , Zhengjing Ma , Nengxiong Xu , Jianbing Peng

Improving predictive understanding of Earth system variability and change requires data-model integration. Efficient data-model integration for complex models requires surrogate modeling to reduce model evaluation time. However, building a…

Machine Learning · Statistics 2019-01-17 Dan Lu , Daniel Ricciuto

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Time-Series Foundation Models (TSFMs) are rapidly transitioning from research prototypes to core components of critical decision-making systems, driven by their impressive zero-shot forecasting capabilities. However, as their deployment…

Machine Learning · Computer Science 2025-12-09 Jiawen Zhang , Zhenwei Zhang , Shun Zheng , Xumeng Wen , Jia Li , Jiang Bian

Regional climate information at kilometer scales is essential for assessing the impacts of climate change, but generating it with global climate models is too expensive due to their high computational costs. Machine learning models offer a…

Atmospheric and Oceanic Physics · Physics 2026-04-07 Kevin Debeire , Aytaç Paçal , Pierre Gentine , Luis Medrano-Navarro , Nils Thuerey , Veronika Eyring

Geospatial Foundation Models (GFMs) provide powerful representations, but high compute costs hinder their widespread use. Pre-computed embedding data products offer a practical "frozen" alternative, yet they currently exist in a fragmented…

Software Engineering · Computer Science 2026-02-25 Heng Fang , Adam J. Stewart , Isaac Corley , Xiao Xiang Zhu , Hossein Azizpour

Droughts and flash droughts (rapidly developing droughts; FDs) remain impactful events that are known to desiccate landscape and destroy crops. In particular, droughts in Africa are often more impactful than in other locations, such as the…

Applications · Statistics 2026-05-08 Stuart Edris , Amy McGovern , Jason Hickey

Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our…

Artificial Intelligence · Computer Science 2024-02-14 Minjong Cheon , Daehyun Kang , Yo-Hwan Choi , Seon-Yu Kang

We present EPT-2, the latest iteration in our Earth Physics Transformer (EPT) family of foundation AI models for Earth system forecasting. EPT-2 delivers substantial improvements over its predecessor, EPT-1.5, and sets a new state of the…

Accurate medium-range precipitation forecasting is crucial for hydrometeorological risk management and disaster mitigation, yet remains challenging for current numerical weather prediction (NWP) systems. Traditional ensemble systems such as…

Atmospheric and Oceanic Physics · Physics 2025-10-24 Tianyi Xiong , Haonan Chen

Time-series forecasting models (TSFM) have evolved from classical statistical methods to sophisticated foundation models, yet understanding why and when these models succeed or fail remains challenging. Despite this known limitation, time…

Machine Learning · Computer Science 2025-08-29 Michael Widener , Kausik Lakkaraju , John Aydin , Biplav Srivastava

Due to the rapidly changing climate, the frequency and severity of extreme weather is expected to increase over the coming decades. As fully-resolved climate simulations remain computationally intractable, policy makers must rely on…

Atmospheric and Oceanic Physics · Physics 2024-02-29 Benedikt Barthel Sorensen , Alexis Charalampopoulos , Shixuan Zhang , Bryce Harrop , Ruby Leung , Themistoklis Sapsis

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

This paper introduces WavesFM, a novel Wireless Foundation Model (WFM) framework, capable of supporting a wide array of communication, sensing, and localization tasks. Our proposed architecture combines a shared Vision Transformer (ViT)…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Ahmed Aboulfotouh , Elsayed Mohammed , Hatem Abou-Zeid

Foundation models have revolutionized artificial intelligence, setting new benchmarks in performance and enabling transformative capabilities across a wide range of vision and language tasks. However, despite the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Adam Goodge , Wee Siong Ng , Bryan Hooi , See Kiong Ng

Forecasting agricultural markets remains challenging due to nonlinear dynamics, structural breaks, and sparse data. A long-standing belief holds that simple time-series methods outperform more advanced alternatives. This paper provides the…

Econometrics · Economics 2026-01-21 Le Wang , Boyuan Zhang