English
Related papers

Related papers: ClimateLLM: Efficient Weather Forecasting via Freq…

200 papers

Extreme weather events are increasing in frequency and intensity due to climate change. This, in turn, is exacting a significant toll in communities worldwide. While prediction skills are increasing with advances in numerical weather…

Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. These gains come with a drastic increase in the models' size, potentially leading to slow and costly use…

Computation and Language · Computer Science 2022-10-26 Tal Schuster , Adam Fisch , Jai Gupta , Mostafa Dehghani , Dara Bahri , Vinh Q. Tran , Yi Tay , Donald Metzler

Subseasonal forecasting of the weather two to six weeks in advance is critical for resource allocation and advance disaster notice but poses many challenges for the forecasting community. At this forecast horizon, physics-based dynamical…

When extreme weather events affect large areas, their regional to sub-continental spatial scale is important for their impacts. We propose a novel machine learning (ML) framework that integrates spatial extreme-value theory to model weather…

Applications · Statistics 2025-05-29 Jonathan Koh , Daniel Steinfeld , Olivia Martius

Accurate analysis of industrial time-series big data is critical for the Prognostics and Health Management (PHM) of industrial equipment. While recent advancements in Large Language Models (LLMs) have shown promise in time-series analysis,…

Machine Learning · Computer Science 2026-03-10 Haiteng Wang , Yikang Li , Yunfei Zhu , Jingheng Yan , Lei Ren , Laurence T. Yang

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

Retrieval and recommendation are two essential tasks in modern search tools. This paper introduces a novel retrieval-reranking framework leveraging Large Language Models (LLMs) to enhance the spatiotemporal and semantic associated mining…

Information Retrieval · Computer Science 2024-11-21 Yuanyuan Tian , Wenwen Li , Lei Hu , Xiao Chen , Michael Brook , Michael Brubaker , Fan Zhang , Anna K. Liljedahl

Climate change is one of the most critical challenges that our planet is facing today. Rising global temperatures are already bringing noticeable changes to Earth's weather and climate patterns with an increased frequency of unpredictable…

Atmospheric and Oceanic Physics · Physics 2024-01-19 Karandeep Singh , Chaeyoon Jeong , Naufal Shidqi , Sungwon Park , Arjun Nellikkattil , Elke Zeller , Meeyoung Cha

Deep learning models have achieved remarkable progress in precipitation prediction. However, they still face significant challenges in accurately capturing spatial details of radar images, particularly in regions of high precipitation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Li Chaorong , Ling Xudong , Yang Qiang , Qin Fengqing , Huang Yuanyuan

Traffic prediction constitutes a pivotal facet within the purview of Intelligent Transportation Systems (ITS), and the attainment of highly precise predictions holds profound significance for efficacious traffic management. The precision of…

Machine Learning · Computer Science 2024-10-27 Yilong Ren , Yue Chen , Shuai Liu , Boyue Wang , Haiyang Yu , Zhiyong Cui

The environmental impact of Large Language Models (LLMs) on data centers hosting these models is becoming a significant concern. While many efforts have focused on reducing the substantial training overhead of LLMs, carbon and water…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Arash Khalatbarisoltani , Amin Mahmoudi , Jie Han , Muhammad Saeed , Wenxue Liu , Jinwen Li , Solmaz Kahourzade , Amirmehdi Yazdani , Xiaosong Hu

Accurate weather forecasting holds significant importance, serving as a crucial tool for decision-making in various industrial sectors. The limitations of statistical models, assuming independence among data points, highlight the need for…

Machine Learning · Computer Science 2025-01-22 Anuvab Sen , Udayon Sen , Mayukhi Paul , Apurba Prasad Padhy , Sujith Sai , Aakash Mallik , Chhandak Mallick

Weather forecasting is a crucial task for meteorologic research, with direct social and economic impacts. Recently, data-driven weather forecasting models based on deep learning have shown great potential, achieving superior performance…

Atmospheric and Oceanic Physics · Physics 2024-08-26 Lihao Gan , Xin Man , Chenghong Zhang , Jie Shao

This paper presents a comparative analysis evaluating the accuracy of Large Language Models (LLMs) against traditional macro time series forecasting approaches. In recent times, LLMs have surged in popularity for forecasting due to their…

Econometrics · Economics 2025-09-25 Andrea Carriero , Davide Pettenuzzo , Shubhranshu Shekhar

The integration of Fourier transform and deep learning opens new avenues for time series forecasting. We reconsider the Fourier transform from a basis functions perspective. Specifically, the real and imaginary parts of the frequency…

Machine Learning · Computer Science 2025-08-05 Runze Yang , Longbing Cao , Xin You , Kun Fang , Jianxun Li , Jie Yang

The rapid advancement of Intelligent Transportation Systems (ITS) presents challenges, particularly with missing data in multi-modal transportation and the complexity of handling diverse sequential tasks within a centralized framework. To…

Machine Learning · Computer Science 2024-09-11 Zhiqi Shao , Haoning Xi , Haohui Lu , Ze Wang , Michael G. H. Bell , Junbin Gao

While accurate traffic forecasting is vital for Intelligent Transportation Systems (ITS), effectively communicating predicted conditions via natural language for human-centric decision support remains a challenge and is often handled…

Machine Learning · Computer Science 2026-01-13 Zeming Du , Qitan Shao , Hongfei Liu , Yong Zhang

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

Human-Computer Interaction · Computer Science 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on…