English
Related papers

Related papers: SEER: Transformer-based Robust Time Series Forecas…

200 papers

Crop mapping based on satellite images time-series (SITS) holds substantial economic value in agricultural production settings, in which parcel segmentation is an essential step. Existing approaches have achieved notable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Juyuan Kang , Hao Zhu , Yan Zhu , Wei Zhang , Jianing Chen , Tianxiang Xiao , Yike Ma , Hao Jiang , Feng Dai

Time series forecasting (TSF) is crucial in fields like economic forecasting, weather prediction, traffic flow analysis, and public health surveillance. Real-world time series data often include noise, outliers, and missing values, making…

Machine Learning · Computer Science 2024-07-09 Quangao Liu , Ruiqi Li , Maowei Jiang , Wei Yang , Chen Liang , LongLong Pang , Zhuozhang Zou

A robust model for time series forecasting is highly important in many domains, including but not limited to financial forecast, air temperature and electricity consumption. To improve forecasting performance, traditional approaches usually…

Machine Learning · Computer Science 2019-09-19 Long H. Nguyen , Zhenhe Pan , Opeyemi Openiyi , Hashim Abu-gellban , Mahdi Moghadasi , Fang Jin

Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution…

Machine Learning · Computer Science 2025-10-02 Yanru Sun , Zongxia Xie , Emadeldeen Eldele , Dongyue Chen , Qinghua Hu , Min Wu

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

Current time-series forecasting models are primarily based on transformer-style neural networks. These models achieve long-term forecasting mainly by scaling up the model size rather than through genuinely autoregressive (AR) rollout. From…

Machine Learning · Computer Science 2026-05-08 Zheng Li , Jerry Cheng , Huanying Gu

Long-term time series forecasting using transformers is hampered by the quadratic complexity of self-attention and the rigidity of uniform patching, which may be misaligned with the data's semantic structure. In this paper, we introduce the…

Machine Learning · Computer Science 2026-01-05 Maximilian Reinwardt , Michael Eichelbeck , Matthias Althoff

Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update…

Machine Learning · Computer Science 2025-07-01 Heitor R. Medeiros , Hossein Sharifi-Noghabi , Gabriel L. Oliveira , Saghar Irandoust

Systems are commonly monitored for health and security through collection and streaming of multivariate time series. Advances in time series forecasting due to adoption of multilayer recurrent neural network architectures make it possible…

Machine Learning · Statistics 2022-03-10 Oshri Barazani , David Tolpin

Time series anomaly detection is critical for maintaining the reliability of mission-critical systems. While Transformer-based models like PatchTST have shown remarkable performance, their $\mathcal{O}(L^2)$ computational complexity…

Machine Learning · Computer Science 2026-05-28 Tae-Gyun Lee , Junyoung Park , Kyu Won Han

Forecasting can estimate the statement of events according to the historical data and it is considerably important in many disciplines. At present, time series models have been utilized to solve forecasting problems in various domains. In…

Data Analysis, Statistics and Probability · Physics 2014-03-10 S. Chen , X. Lan , Y. Hu , Q. Liu , Y. Deng

In the domain of multivariate forecasting, transformer models stand out as powerful apparatus, displaying exceptional capabilities in handling messy datasets from real-world contexts. However, the inherent complexity of these datasets,…

Machine Learning · Computer Science 2024-03-08 Jingjing Xu , Caesar Wu , Yuan-Fang Li , Pascal Bouvry

How to handle time features shall be the core question of any time series forecasting model. Ironically, it is often ignored or misunderstood by deep-learning based models, even those baselines which are state-of-the-art. This behavior…

Machine Learning · Computer Science 2022-07-25 Li Shen , Yuning Wei , Yangzhu Wang

Various modifications of TRANSFORMER were recently used to solve time-series forecasting problem. We propose Query Selector - an efficient, deterministic algorithm for sparse attention matrix. Experiments show it achieves state-of-the art…

Machine Learning · Computer Science 2021-08-18 Jacek Klimek , Jakub Klimek , Witold Kraskiewicz , Mateusz Topolewski

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Time series forecasting plays a crucial role in contemporary engineering information systems for supporting decision-making across various industries, where Recurrent Neural Networks (RNNs) have been widely adopted due to their capability…

Machine Learning · Computer Science 2026-01-14 Xin Lai , Shiming Deng , Lu Yu , Yumin Lai , Shenghao Qiao , Xinze Zhang

Time series forecasting involves collecting and analyzing past observations to develop a model to extrapolate such observations into the future. Forecasting of future events is important in many fields to support decision making as it…

Machine Learning · Computer Science 2020-09-22 Igor Ilic , Berk Gorgulu , Mucahit Cevik , Mustafa Gokce Baydogan

This paper introduces a novel two-dimensional (2D) time series forecasting model that integrates cohort behavior over time, addressing challenges in small data environments. We demonstrate its efficacy using multiple real-world datasets,…

Machine Learning · Computer Science 2025-08-22 Yonathan Guttel , Orit Moradov , Nachi Lieder , Asnat Greenstein-Messica

Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr,…

As a consequence of the high variability of load demand and renewable generation, long-term and high-resolution inputs are required for power system expansion planning, making the problem intractable in real-world applications. Time series…

Optimization and Control · Mathematics 2025-10-29 Ruiqi Zhang , Ensieh Sharifnia , Simon H. Tindemans