English
Related papers

Related papers: CLLMate: A Multimodal Benchmark for Weather and Cl…

200 papers

Weather forecasts sit upstream of high-stakes decisions in domains such as grid operations, aviation, agriculture, and emergency response. Yet forecast users often face a difficult trade-off. Many decision-relevant targets are functionals…

Machine Learning · Computer Science 2026-01-08 Paulius Rauba , Viktor Cikojevic , Fran Bartolic , Sam Levang , Ty Dickinson , Chase Dwelle

An impact of climate change is the increase in frequency and intensity of extreme precipitation events. However, confidently predicting the likelihood of extreme precipitation at seasonal scales remains an outstanding challenge. Here, we…

Machine Learning · Computer Science 2021-07-15 Daniel Salles Civitarese , Daniela Szwarcman , Bianca Zadrozny , Campbell Watson

Numerical weather prediction has traditionally been based on physical models of the atmosphere. Recently, however, the rise of deep learning has created increased interest in purely data-driven medium-range weather forecasting with first…

Atmospheric and Oceanic Physics · Physics 2021-03-17 Stephan Rasp , Nils Thuerey

Despite the advancements and impressive performance of Multimodal Large Language Models (MLLMs) on benchmarks, their effectiveness in real-world, long-context, and multi-image tasks is unclear due to the benchmarks' limited scope. Existing…

Computation and Language · Computer Science 2024-05-16 Dingjie Song , Shunian Chen , Guiming Hardy Chen , Fei Yu , Xiang Wan , Benyou Wang

While climate models provide insights for climate decision-making, their use is constrained by significant computational and technical demands. Although machine learning (ML) emulators offer a way to bypass the high computational costs,…

Machine Learning · Computer Science 2026-03-25 Luca Schmidt , Nina Effenberger

Climate models play a crucial role in understanding the effect of environmental and man-made changes on climate to help mitigate climate risks and inform governmental decisions. Large global climate models such as the Community Earth System…

Applications · Statistics 2020-12-02 Niccolò Dalmasso , Galen Vincent , Dorit Hammerling , Ann B. Lee

The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal…

Computation and Language · Computer Science 2025-09-19 Kaichen Zhang , Bo Li , Peiyuan Zhang , Fanyi Pu , Joshua Adrian Cahyono , Kairui Hu , Shuai Liu , Yuanhan Zhang , Jingkang Yang , Chunyuan Li , Ziwei Liu

Subseasonal-to-seasonal (S2S) forecasts play an essential role in providing a decision-critical weeks-to-months planning window for climate resilience and sustainability, yet a growing bottleneck is the last-mile gap: translating scientific…

Machine Learning · Computer Science 2026-02-17 Chenyue Li , Wen Deng , Zhuotao Sun , Mengxi Jin , Hanzhe Cui , Han Li , Shentong Li , Man Kit Yu , Ming Long Lai , Yuhao Yang , Mengqian Lu , Binhang Yuan

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

Accurate net load forecasting is vital for energy planning, aiding decisions on trade and load distribution. However, assessing the performance of forecasting models across diverse input variables, like temperature and humidity, remains…

Human-Computer Interaction · Computer Science 2024-03-11 Kaustav Bhattacharjee , Soumya Kundu , Indrasis Chakraborty , Aritra Dasgupta

Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approach as a novel paradigm to overcome these limitations, not by…

Machine learning (ML) is transforming modeling and control in the physical, engineering, and biological sciences. However, rapid development has outpaced the creation of standardized, objective benchmarks - leading to weak baselines,…

In order to oversee advanced AI systems, it is important to understand their underlying decision-making process. When prompted, large language models (LLMs) can provide natural language explanations or reasoning traces that sound plausible…

Computation and Language · Computer Science 2024-06-10 Noah Y. Siegel , Oana-Maria Camburu , Nicolas Heess , Maria Perez-Ortiz

Previously, using forward-flux sampling (FFS) and machine learning (ML), we developed multivariate alarm systems to counter rare un-postulated abnormal events. Our alarm systems utilized ML-based predictive models to quantify committer…

Machine Learning · Computer Science 2024-09-04 Vikram Sudarshan , Warren D. Seider

Forecasting the weather is an increasingly data intensive exercise. Numerical Weather Prediction (NWP) models are becoming more complex, with higher resolutions, and there are increasing numbers of different models in operation. While the…

Applications · Statistics 2021-03-17 Charlie Kirkwood , Theo Economou , Henry Odbert , Nicolas Pugeault

Social and collaborative platforms emit multivariate time-series traces in which early interactions-such as views, likes, or downloads-are followed, sometimes months or years later, by higher impact like citations, sales, or reviews. We…

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of…

Artificial Intelligence · Computer Science 2024-10-08 Chathurangi Shyalika , Ruwan Wickramarachchi , Amit Sheth

In this paper we discuss and address the challenges of predicting extreme atmospheric events like intense rainfall, hail, and strong winds. These events can cause significant damage and have become more frequent due to climate change.…

Atmospheric and Oceanic Physics · Physics 2023-10-06 Mikhail Mozikov , Ilya Makarov , Alexandr Bulkin , Daria Taniushkina , Roland Grinis , Yury Maximov

While recent advances in machine learning have equipped Weather Foundation Models (WFMs) with substantial generalization capabilities across diverse downstream tasks, the escalating computational requirements associated with their expanding…

Machine learning has been increasingly applied in climate modeling on system emulation acceleration, data-driven parameter inference, forecasting, and knowledge discovery, addressing challenges such as physical consistency, multi-scale…