English
Related papers

Related papers: WeatherFormer: A Pretrained Encoder Model for Lear…

200 papers

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Long-term time-series forecasting (LTSF) is fundamental to various real-world applications, where Transformer-based models have become the dominant framework due to their ability to capture long-range dependencies. However, these models…

Machine Learning · Computer Science 2025-03-27 Mingjie Li , Rui Liu , Guangsi Shi , Mingfei Han , Changling Li , Lina Yao , Xiaojun Chang , Ling Chen

Change detection in remote sensing imagery is essential for a variety of applications such as urban planning, disaster management, and climate research. However, existing methods for identifying semantically changed areas overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Maximilian Bernhard , Niklas Strauß , Matthias Schubert

The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on…

Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spatial-temporal shifts. This issue is particularly acute in…

Machine Learning · Computer Science 2023-12-04 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Time series forecasting (TSF) faces challenges in modeling complex intra-channel temporal dependencies and inter-channel correlations. Although recent research has highlighted the efficiency of linear architectures in capturing global…

Machine Learning · Computer Science 2026-01-29 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

Machine Learning · Computer Science 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

Recent advances in AI weather forecasting have led to the emergence of so-called "foundation models", typically defined by expensive pretraining and minimal fine-tuning for downstream tasks. However, in the natural sciences, a desirable…

Machine Learning · Computer Science 2025-06-25 Fanny Lehmann , Firat Ozdemir , Benedikt Soja , Torsten Hoefler , Siddhartha Mishra , Sebastian Schemm

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Although Transformer-based methods have significantly improved state-of-the-art results for long-term series forecasting, they are not only computationally expensive but more importantly, are unable to capture the global view of time series…

Machine Learning · Computer Science 2022-06-17 Tian Zhou , Ziqing Ma , Qingsong Wen , Xue Wang , Liang Sun , Rong Jin

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

Machine Learning · Computer Science 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

The growth of global consumption has motivated important applications of deep learning to smart manufacturing and machine health monitoring. In particular, analyzing vibration data offers great potential to extract meaningful insights into…

Machine Learning · Computer Science 2024-05-30 Anthony Zhou , Amir Barati Farimani

The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g.,…

The Transformer model has shown leading performance in time series forecasting. Nevertheless, in some complex scenarios, it tends to learn low-frequency features in the data and overlook high-frequency features, showing a frequency bias.…

Machine Learning · Computer Science 2024-07-04 Xihao Piao , Zheng Chen , Taichi Murayama , Yasuko Matsubara , Yasushi Sakurai

Image restoration under adverse weather conditions (e.g., rain, snow and haze) is a fundamental computer vision problem and has important indications for various downstream applications. Different from early methods that are specially…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhentao Tan , Yue Wu , Qiankun Liu , Qi Chu , Le Lu , Jieping Ye , Nenghai Yu

Traffic prediction remains a key challenge in spatio-temporal data mining, despite progress in deep learning. Accurate forecasting is hindered by the complex influence of external factors such as traffic accidents and regulations, often…

Machine Learning · Computer Science 2025-12-11 Hongjun Wang , Jiawei Yong , Jiawei Wang , Shintaro Fukushima , Renhe Jiang

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

Weather radar data are critical for nowcasting and an integral component of numerical weather prediction models. While weather radar data provide valuable information at high resolution, their ground-based nature limits their availability,…

Atmospheric and Oceanic Physics · Physics 2024-03-07 Çağlar Küçük , Apostolos Giannakos , Stefan Schneider , Alexander Jann

Removing adverse weather conditions like rain, fog, and snow from images is an important problem in many applications. Most methods proposed in the literature have been designed to deal with just removing one type of degradation. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Jeya Maria Jose Valanarasu , Rajeev Yasarla , Vishal M. Patel