English
Related papers

Related papers: Foundation Models for Weather and Climate Data Und…

200 papers

Global warming leads to the increase in frequency and intensity of climate extremes that cause tremendous loss of lives and property. Accurate long-range climate prediction allows more time for preparation and disaster risk management for…

Machine Learning · Computer Science 2021-12-13 Ken C. L. Wong , Hongzhi Wang , Etienne E. Vos , Bianca Zadrozny , Campbell D. Watson , Tanveer Syeda-Mahmood

The field of meteorological forecasting has undergone a significant transformation with the integration of large models, especially those employing deep learning techniques. This paper reviews the advancements and applications of these…

Machine Learning · Computer Science 2024-04-11 Hailong Shu , Yue Wang , Weiwei Song , Huichuang Guo , Zhen Song

The added value of machine learning for weather and climate applications is measurable through performance metrics, but explaining it remains challenging, particularly for large deep learning models. Inspired by climate model hierarchies,…

Computational Physics · Physics 2025-01-22 Tom Beucler , Arthur Grundner , Sara Shamekh , Peter Ukkonen , Matthew Chantry , Ryan Lagerquist

The understanding and prediction of large wildland fire events around the world is a growing interdisciplinary research area advanced rapidly by development and use of computational models. Recent models bidirectionally couple computational…

Atmospheric and Oceanic Physics · Physics 2020-07-06 J. L. Coen , W. Schroeder , S. Conway , L. Tarnay

Artificial Intelligence (AI) is making a profound impact in almost every domain. A vital enabler of its great success is the availability of abundant and high-quality data for building machine learning models. Recently, the role of data in…

Machine Learning · Computer Science 2023-06-13 Daochen Zha , Zaid Pervaiz Bhat , Kwei-Herng Lai , Fan Yang , Zhimeng Jiang , Shaochen Zhong , Xia Hu

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their…

Machine Learning · Computer Science 2022-07-14 Rishi Bommasani , Drew A. Hudson , Ehsan Adeli , Russ Altman , Simran Arora , Sydney von Arx , Michael S. Bernstein , Jeannette Bohg , Antoine Bosselut , Emma Brunskill , Erik Brynjolfsson , Shyamal Buch , Dallas Card , Rodrigo Castellon , Niladri Chatterji , Annie Chen , Kathleen Creel , Jared Quincy Davis , Dora Demszky , Chris Donahue , Moussa Doumbouya , Esin Durmus , Stefano Ermon , John Etchemendy , Kawin Ethayarajh , Li Fei-Fei , Chelsea Finn , Trevor Gale , Lauren Gillespie , Karan Goel , Noah Goodman , Shelby Grossman , Neel Guha , Tatsunori Hashimoto , Peter Henderson , John Hewitt , Daniel E. Ho , Jenny Hong , Kyle Hsu , Jing Huang , Thomas Icard , Saahil Jain , Dan Jurafsky , Pratyusha Kalluri , Siddharth Karamcheti , Geoff Keeling , Fereshte Khani , Omar Khattab , Pang Wei Koh , Mark Krass , Ranjay Krishna , Rohith Kuditipudi , Ananya Kumar , Faisal Ladhak , Mina Lee , Tony Lee , Jure Leskovec , Isabelle Levent , Xiang Lisa Li , Xuechen Li , Tengyu Ma , Ali Malik , Christopher D. Manning , Suvir Mirchandani , Eric Mitchell , Zanele Munyikwa , Suraj Nair , Avanika Narayan , Deepak Narayanan , Ben Newman , Allen Nie , Juan Carlos Niebles , Hamed Nilforoshan , Julian Nyarko , Giray Ogut , Laurel Orr , Isabel Papadimitriou , Joon Sung Park , Chris Piech , Eva Portelance , Christopher Potts , Aditi Raghunathan , Rob Reich , Hongyu Ren , Frieda Rong , Yusuf Roohani , Camilo Ruiz , Jack Ryan , Christopher Ré , Dorsa Sadigh , Shiori Sagawa , Keshav Santhanam , Andy Shih , Krishnan Srinivasan , Alex Tamkin , Rohan Taori , Armin W. Thomas , Florian Tramèr , Rose E. Wang , William Wang , Bohan Wu , Jiajun Wu , Yuhuai Wu , Sang Michael Xie , Michihiro Yasunaga , Jiaxuan You , Matei Zaharia , Michael Zhang , Tianyi Zhang , Xikun Zhang , Yuhui Zhang , Lucia Zheng , Kaitlyn Zhou , Percy Liang

Data assimilation (DA), as an indispensable component within contemporary Numerical Weather Prediction (NWP) systems, plays a crucial role in generating the analysis that significantly impacts forecast performance. Nevertheless, the…

Machine Learning · Computer Science 2026-03-17 Xiaoze Xu , Xiuyu Sun , Wei Han , Xiaohui Zhong , Lei Chen , Hao Li

Climate models (CM) are used to evaluate the impact of climate change on the risk of floods and strong precipitation events. However, these numerical simulators have difficulties representing precipitation events accurately, mainly due to…

Computational Engineering, Finance, and Science · Computer Science 2021-02-15 Rilwan Adewoyin , Peter Dueben , Peter Watson , Yulan He , Ritabrata Dutta

Climate change impacts a broad spectrum of human resources and activities, necessitating the use of climate models to project long-term effects and inform mitigation and adaptation strategies. These models generate multiple datasets by…

There has been active investigation into deep learning approaches for time series analysis, including foundation models. However, most studies do not address significant scientific applications. This paper aims to identify key features in…

Machine Learning · Computer Science 2025-09-22 Junyang He , Ying-Jung Chen , Alireza Jafari , Anushka Idamekorala , Geoffrey Fox

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

Given that observational and numerical climate data are being produced at ever more prodigious rates, increasingly sophisticated and automated analysis techniques have become essential. Deep learning is quickly becoming a standard approach…

Fluid Dynamics · Physics 2017-09-12 A. Rupe , J. P. Crutchfield , K. Kashinath , Prabhat

Aspects of operational modeling for climate, weather, and space weather forecasts are contrasted, with a particular focus on the somewhat conflicting demands of 'operational stability' versus 'dynamic development' of the involved models.…

Earth and Planetary Astrophysics · Physics 2018-05-01 Doris Folini

In recent years, AI-based weather forecasting models have matched or even outperformed numerical weather prediction systems. However, most of these models have been trained and evaluated on reanalysis datasets like ERA5. These datasets,…

Atmospheric and Oceanic Physics · Physics 2024-09-17 Weixin Jin , Jonathan Weyn , Pengcheng Zhao , Siqi Xiang , Jiang Bian , Zuliang Fang , Haiyu Dong , Hongyu Sun , Kit Thambiratnam , Qi Zhang

With advancements in GPS, remote sensing, and computational simulation, an enormous volume of spatiotemporal data is being collected at an increasing speed from various application domains, spanning Earth sciences, agriculture, smart…

Machine Learning · Computer Science 2023-11-01 Zhe Jiang

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

Large Language Models (LLMs) have transformed numerous domains by providing advanced capabilities in natural language understanding, generation, and reasoning. Despite their groundbreaking applications across industries such as research,…

Artificial Intelligence · Computer Science 2025-01-22 Aditi Singh , Nirmal Prakashbhai Patel , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei

The problem of high-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance. Yet, it is still unsolved with reasonable accuracy due to data complexity and aridity stochasticity. We tackle…

Machine Learning · Computer Science 2024-07-15 Alexander Marusov , Vsevolod Grabar , Yury Maximov , Nazar Sotiriadi , Alexander Bulkin , Alexey Zaytsev

Advances in deep learning methods for weather forecasting are creating opportunities to computationally explore the potential for steering or control of extreme weather trajectories for societal risk reduction. We present initial…

Atmospheric and Oceanic Physics · Physics 2026-04-22 Moyan Liu , Qin Huang , Upmanu Lall

Deep learning models have gained popularity in climate science, following their success in computer vision and other domains. For instance, researchers are increasingly employing deep learning techniques for downscaling climate data,…

Machine Learning · Computer Science 2023-06-21 Xingying Huang