English
Related papers

Related papers: SEER: Transformer-based Robust Time Series Forecas…

200 papers

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

Machine Learning · Computer Science 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

Although recent studies on time-series anomaly detection have increasingly adopted ever-larger neural network architectures such as transformers and foundation models, they incur high computational costs and memory usage, making them…

Machine Learning · Computer Science 2026-05-15 Jinju Park , Seokho Kang

Time Series Forecasting (TSF) faces persistent challenges in modeling intricate temporal dependencies across different scales. Despite recent advances leveraging different decomposition operations and novel architectures based on CNN, MLP…

Machine Learning · Computer Science 2025-10-24 Haonan Yang , Jianchao Tang , Zhuo Li , Long Lan

We seek to enable classic processing of continuous ultra-sparse spatiotemporal data generated by event-based sensors with dense machine learning models. We propose a novel hybrid pipeline composed of asynchronous sensing and synchronous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Carmen Martin-Turrero , Maxence Bouvier , Manuel Breitenstein , Pietro Zanuttigh , Vincent Parret

Large-scale self-supervised pre-training Transformer architecture have significantly boosted the performance for various tasks in natural language processing (NLP) and computer vision (CV). However, there is a lack of researches on…

Machine Learning · Computer Science 2022-10-06 Peiwang Tang , Xianchao Zhang

Multivariate time series forecasting is essential in domains such as finance, transportation, climate, and energy. However, existing patch-based methods typically adopt fixed-length segmentation, overlooking the heterogeneity of local…

Machine Learning · Computer Science 2026-01-06 Kuiye Ding , Fanda Fan , Chunyi Hou , Zheya Wang , Lei Wang , Zhengxin Yang , Jianfeng Zhan

With the advent of Transformers, time series forecasting has seen significant advances, yet it remains challenging due to the need for effective sequence representation, memory construction, and accurate target projection. Time series…

Artificial Intelligence · Computer Science 2025-07-09 Robert Leppich , Michael Stenger , André Bauer , Samuel Kounev

Transformer-based models have greatly pushed the boundaries of time series forecasting recently. Existing methods typically encode time series data into $\textit{patches}$ using one or a fixed set of patch lengths. This, however, could…

Machine Learning · Computer Science 2024-02-09 Linfeng Du , Ji Xin , Alex Labach , Saba Zuberi , Maksims Volkovs , Rahul G. Krishnan

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Spatial-temporal forecasting systems play a crucial role in addressing numerous real-world challenges. In this paper, we investigate the potential of addressing spatial-temporal forecasting problems using general time series forecasting…

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

Time series forecasting methods generally fall into two main categories: Channel Independent (CI) and Channel Dependent (CD) strategies. While CI overlooks important covariate relationships, CD captures all dependencies without distinction,…

Machine Learning · Computer Science 2025-05-21 Yifan Hu , Guibin Zhang , Peiyuan Liu , Disen Lan , Naiqi Li , Dawei Cheng , Tao Dai , Shu-Tao Xia , Shirui Pan

Although the Transformer has been the dominant architecture for time series forecasting tasks in recent years, a fundamental challenge remains: the permutation-invariant self-attention mechanism within Transformers leads to a loss of…

Machine Learning · Computer Science 2024-10-15 Zeying Gong , Yujin Tang , Junwei Liang

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

We introduce a novel modeling approach for time series imputation and forecasting, tailored to address the challenges often encountered in real-world data, such as irregular samples, missing data, or unaligned measurements from multiple…

In long-term multivariate time series forecasting, effectively capturing both periodic patterns and residual dynamics is essential. To address this within standard deep learning benchmark settings, we propose the Hierarchical Patching Mixer…

Machine Learning · Computer Science 2026-02-20 Jung Min Choi , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Accurate time series forecasting is critical for a wide range of problems with temporal data. Ensemble modeling is a well-established technique for leveraging multiple predictive models to increase accuracy and robustness, as the…

Machine Learning · Computer Science 2023-04-11 Dimitris Bertsimas , Leonard Boussioux

Effective multivariate time series forecasting often benefits from accurately modeling complex inter-variable dependencies. However, existing attention- or graph-based methods face three key issues: (a) strong temporal self-dependencies are…

Machine Learning · Computer Science 2025-12-19 Feng Xiong , Zongxia Xie , Yanru Sun , Haoyu Wang , Jianhong Lin

Time series forecasting plays an increasingly important role in modern business decisions. In today's data-rich environment, people often aim to choose the optimal forecasting model for their data. However, identifying the optimal model…

Applications · Statistics 2021-12-17 Xixi Li , Fotios Petropoulos , Yanfei Kang

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang