English
Related papers

Related papers: Transformer Multivariate Forecasting: Less is More…

200 papers

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Spatiotemporal Graph Neural Networks (ST-GNNs) and Transformers have shown significant promise in traffic forecasting by effectively modeling temporal and spatial correlations. However, rapid urbanization in recent years has led to dynamic…

Machine Learning · Computer Science 2024-11-19 Hongjun Wang , Jiyuan Chen , Lingyu Zhang , Renhe Jiang , Xuan Song

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

The current landscape in time-series forecasting is dominated by Transformer-based models. Their high parameter count and corresponding demand in computational resources pose a challenge to real-world deployment, especially for commercial…

Machine Learning · Computer Science 2024-12-18 Nicholas Kiefer , Arvid Weyrauch , Muhammed Öz , Achim Streit , Markus Götz , Charlotte Debus

Radio map, or pathloss map prediction, is a crucial method for wireless network modeling and management. By leveraging deep learning to construct pathloss patterns from geographical maps, an accurate digital replica of the transmission…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Yuxuan Li , Cheng Zhang , Wen Wang , Yongming Huang

This paper proposes a novel dynamic forecasting method using a new supervised Principal Component Analysis (PCA) when a large number of predictors are available. The new supervised PCA provides an effective way to bridge the gap between…

Econometrics · Economics 2024-06-14 Zhaoxing Gao , Ruey S. Tsay

Time series forecasting is an important problem, with many real world applications. Ensembles of deep neural networks have recently achieved impressive forecasting accuracy, but such large ensembles are impractical in many real world…

Machine Learning · Computer Science 2022-08-31 Espen Haugsdal , Erlend Aune , Massimiliano Ruocco

The emergence of deep learning has yielded noteworthy advancements in time series forecasting (TSF). Transformer architectures, in particular, have witnessed broad utilization and adoption in TSF tasks. Transformers have proven to be the…

Machine Learning · Computer Science 2023-11-01 Liyilei Su , Xumin Zuo , Rui Li , Xin Wang , Heng Zhao , Bingding Huang

Multi-dimensional time series data, such as matrix and tensor-variate time series, are increasingly prevalent in fields such as economics, finance, and climate science. Traditional Transformer models, though adept with sequential data, do…

Machine Learning · Computer Science 2024-10-29 Linghang Kong , Elynn Chen , Yuzhou Chen , Yuefeng Han

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

Machine Learning · Computer Science 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Multivariate long-term time series forecasting is critical for applications such as weather prediction, and traffic analysis. In addition, the implementation of Transformer variants has improved prediction accuracy. Following these…

Machine Learning · Computer Science 2025-05-06 Minhyuk Lee , HyeKyung Yoon , MyungJoo Kang

Accurate forecasting of multivariate time series remains challenging due to the need to capture both short-term fluctuations and long-range temporal dependencies. Transformer-based models have emerged as a powerful approach, but their…

Machine Learning · Computer Science 2026-03-26 Aymane Harkati , Moncef Garouani , Olivier Teste , Julien Aligon , Mohamed Hamlich

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

Machine Learning · Computer Science 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

Wind power forecasting (WPF), as a significant research topic within renewable energy, plays a crucial role in enhancing the security, stability, and economic operation of power grids. However, due to the high stochasticity of…

Machine Learning · Computer Science 2025-04-16 Mingyi Zhu , Zhaoxin Li , Qiao Lin , Li Ding

Traffic prediction remains a key challenge in spatio-temporal data mining, despite progress in deep learning. Accurate forecasting is hindered by the complex influence of external factors such as traffic accidents and regulations, often…

Machine Learning · Computer Science 2025-12-11 Hongjun Wang , Jiawei Yong , Jiawei Wang , Shintaro Fukushima , Renhe Jiang

In this paper, we address the challenge of multivariate time-series forecasting using quantum machine learning techniques. We introduce adaptation strategies that extend variational quantum circuit models, traditionally limited to…

Large pre-trained models have demonstrated remarkable capabilities across domains, but their effectiveness in time series forecasting remains understudied. This work empirically examines whether pre-trained large-scale time series models…

Machine Learning · Computer Science 2025-07-08 Sanjay Chakraborty , Ibrahim Delibasoglu , Fredrik Heintz

Time series data is a key element of big data analytics, commonly found in domains such as finance, healthcare, climate forecasting, and transportation. In large scale real world settings, such data is often high dimensional and…

Machine Learning · Computer Science 2025-08-14 Younghwi Kim , Dohee Kim , Joongrock Kim , Sunghyun Sim

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev