中文
相关论文

相关论文: WeatherFormer: A Pretrained Encoder Model for Lear…

200 篇论文

Wind power forecasting has drawn increasing attention among researchers as the consumption of renewable energy grows. In this paper, we develop a deep learning approach based on encoder-decoder structure. Our model forecasts wind power…

机器学习 · 计算机科学 2021-10-08 Jiangyuan Li , Mohammadreza Armandpour

The Weather4cast 2021 competition gave the participants a task of predicting the time evolution of two-dimensional fields of satellite-based meteorological data. This paper describes the author's efforts, after initial success in the first…

机器学习 · 计算机科学 2022-03-16 Jussi Leinonen

Short-term (0-24 hours) precipitation forecasting is highly valuable to socioeconomic activities and public safety. However, the highly complex evolution patterns of precipitation events, the extreme imbalance between precipitation and…

机器学习 · 计算机科学 2026-03-30 Shuangliang Li , Siwei Li , Li Li , Weijie Zou , Jie Yang , Maolin Zhang

The self-attention mechanism in Transformer architecture, invariant to sequence order, necessitates positional embeddings to encode temporal order in time series prediction. We argue that this reliance on positional embeddings restricts the…

机器学习 · 计算机科学 2024-08-21 Yongbo Yu , Weizhong Yu , Feiping Nie , Xuelong Li

Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in…

Most existing transformer based video instance segmentation methods extract per frame features independently, hence it is challenging to solve the appearance deformation problem. In this paper, we observe the temporal information is…

计算机视觉与模式识别 · 计算机科学 2023-01-24 Zhenghao Zhang , Fangtao Shao , Zuozhuo Dai , Siyu Zhu

Weather recognition is an essential support for many practical life applications, including traffic safety, environment, and meteorology. However, many existing related works cannot comprehensively describe weather conditions due to their…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Shengchao Chen , Ting Shu , Huan Zhao , Yuan Yan Tang

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

人工智能 · 计算机科学 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Predicting time-series is of great importance in various scientific and engineering fields. However, in the context of limited and noisy data, accurately predicting dynamics of all variables in a high-dimensional system is a challenging…

机器学习 · 计算机科学 2025-06-16 Zijian Wang , Peng Tao , Luonan Chen

Traffic prediction is a flourishing research field due to its importance in human mobility in the urban space. Despite this, existing studies only focus on short-term prediction of up to few hours in advance, with most being up to one hour…

机器学习 · 计算机科学 2023-03-06 David Alexander Tedjopurnomo , Farhana M. Choudhury , A. K. Qin

Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability…

机器学习 · 计算机科学 2021-03-30 Haoyi Zhou , Shanghang Zhang , Jieqi Peng , Shuai Zhang , Jianxin Li , Hui Xiong , Wancai Zhang

In this paper, we consider high-dimensional stationary processes where a new observation is generated from a compressed version of past observations. The specific evolution is modeled by an encoder-decoder structure. We estimate the…

统计理论 · 数学 2020-09-21 Nathawut Phandoidaen , Stefan Richter

Accurately forecasting the weather is an important task, as many real-world processes and decisions depend on future meteorological conditions. The NeurIPS 2022 challenge entitled Weather4cast poses the problem of predicting rainfall events…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yury Belousov , Sergey Polezhaev , Brian Pulfer

Sea Surface Temperature (SST) prediction plays a vital role in climate modeling and disaster forecasting. However, it remains challenging due to its nonlinear spatiotemporal dynamics and extended prediction horizons. To address this, we…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Yin Wang , Chunlin Gong , Zhuozhen Xu , Lehan Zhang , Xiang Wu

Blind face restoration is a challenging task due to the unknown and complex degradation. Although face prior-based methods and reference-based methods have recently demonstrated high-quality results, the restored images tend to contain…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Guojing Ge , Qi Song , Guibo Zhu , Yuting Zhang , Jinglu Chen , Miao Xin , Ming Tang , Jinqiao Wang

We assess empirical models in climate econometrics using modern statistical learning techniques. Existing approaches are prone to outliers, ignore sample dependencies, and lack principled model selection. To address these issues, we…

应用统计 · 统计学 2025-05-26 Christof Schötz , Jan Hassel , Christian Otto

Transformer-based large language models have remarkable potential to accelerate design optimization for applications such as drug development and materials discovery. Self-supervised pretraining of transformer models requires large-scale…

机器学习 · 计算机科学 2023-10-27 Pei Zhang , Logan Kearney , Debsindhu Bhowmik , Zachary Fox , Amit K. Naskar , John Gounley

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

机器学习 · 计算机科学 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

Accurately predicting short-term precipitation is critical for weather-sensitive applications such as disaster management, aviation, and urban planning. Traditional numerical weather prediction can be computationally intensive at high…

机器学习 · 计算机科学 2025-12-01 Sumit Mamtani , Maitreya Sonawane

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

机器学习 · 计算机科学 2026-01-29 Wei Li