English
Related papers

Related papers: A Time Series is Worth 64 Words: Long-term Forecas…

200 papers

Multivariate time series forecasting is crucial across a wide range of domains. While presenting notable progress for the Transformer architecture, iTransformer still lags behind the latest MLP-based models. We attribute this performance…

Machine Learning · Computer Science 2025-11-12 Zhiwei Zhang , Xinyi Du , Xuanchi Guo , Weihao Wang , Wenjuan Han

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models. The concept of universal forecasting,…

Machine Learning · Computer Science 2024-05-24 Gerald Woo , Chenghao Liu , Akshat Kumar , Caiming Xiong , Silvio Savarese , Doyen Sahoo

Accurate long-term predictions are the foundations for many machine learning applications and decision-making processes. Traditional time series approaches for prediction often focus on either autoregressive modeling, which relies solely on…

Machine Learning · Computer Science 2025-04-22 Kshitij Tayal , Arvind Renganathan , Xiaowei Jia , Vipin Kumar , Dan Lu

Multivariate long-term time series forecasting is critical for applications such as weather prediction, and traffic analysis. In addition, the implementation of Transformer variants has improved prediction accuracy. Following these…

Machine Learning · Computer Science 2025-05-06 Minhyuk Lee , HyeKyung Yoon , MyungJoo Kang

Temporal set prediction involves forecasting the elements that will appear in the next set, given a sequence of prior sets, each containing a variable number of elements. Existing methods often rely on intricate architectures with…

Machine Learning · Computer Science 2025-04-25 Ashish Ranjan , Ayush Agarwal , Shalin Barot , Sushant Kumar

Time-series data in real-world settings typically exhibit long-range dependencies and are observed at non-uniform intervals. In these settings, traditional sequence-based recurrent models struggle. To overcome this, researchers often…

Machine Learning · Statistics 2025-01-14 Fernando Moreno-Pino , Álvaro Arroyo , Harrison Waldon , Xiaowen Dong , Álvaro Cartea

Transformer-based architectures achieved breakthrough performance in natural language processing and computer vision, yet they remain inferior to simpler linear baselines in multivariate long-term forecasting. To better understand this…

Machine Learning · Computer Science 2024-06-04 Romain Ilbert , Ambroise Odonnat , Vasilii Feofanov , Aladin Virmaux , Giuseppe Paolo , Themis Palpanas , Ievgen Redko

Time series forecasting requires balancing short-term and long-term dependencies for accurate predictions. Existing methods mainly focus on long-term dependency modeling, neglecting the complexities of short-term dynamics, which may hinder…

Machine Learning · Computer Science 2024-08-29 Sijia Peng , Yun Xiong , Yangyong Zhu , Zhiqiang Shen

Most current multivariate time series (MTS) classification algorithms focus on improving the predictive accuracy. However, for large-scale (either high-dimensional or long-sequential) time series (TS) datasets, there is an additional…

Machine Learning · Computer Science 2022-03-29 Yuqing Wang , Yun Zhao , Linda Petzold

Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution…

Machine Learning · Computer Science 2025-10-02 Yanru Sun , Zongxia Xie , Emadeldeen Eldele , Dongyue Chen , Qinghua Hu , Min Wu

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

Machine Learning · Computer Science 2025-12-09 Andrey Savchenko , Oleg Kachan

Long-term time-series forecasting remains challenging due to the difficulty in capturing long-term dependencies, achieving linear scalability, and maintaining computational efficiency. We introduce TimeMachine, an innovative model that…

Machine Learning · Computer Science 2024-08-26 Md Atik Ahamed , Qiang Cheng

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

The extensive adoption of web technologies in the finance and investment sectors has led to an explosion of financial data, which contributes to the complexity of the forecasting task. Traditional machine learning models exhibit limitations…

Machine Learning · Computer Science 2026-01-21 Renjun Jia , Zian Liu , Peng Zhu , Dawei Cheng , Yuqi Liang

Multi-dimensional time series data, such as matrix and tensor-variate time series, are increasingly prevalent in fields such as economics, finance, and climate science. Traditional Transformer models, though adept with sequential data, do…

Machine Learning · Computer Science 2024-10-29 Linghang Kong , Elynn Chen , Yuzhou Chen , Yuefeng Han

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

Computation and Language · Computer Science 2020-04-02 Prakhar Thapak , Prodip Hore

Multivariate long-term time series forecasting aims to predict future sequences by utilizing historical observations, with a core focus on modeling intra-sequence and cross-channel dependencies. Numerous studies have developed diverse…

Machine Learning · Computer Science 2026-02-03 Gaoxiang Zhao , Chunmao Huang , Li Zhou , Xiaoqiang Wang

Time series forecasting presents significant challenges due to the complex temporal dependencies at multiple time scales. This paper introduces ScatterFusion, a novel framework that synergistically integrates scattering transforms with…

Machine Learning · Computer Science 2026-01-29 Wei Li

Time series forecasting has traditionally focused on univariate and multivariate numerical data, often overlooking the benefits of incorporating multimodal information, particularly textual data. In this paper, we propose a novel framework…

Artificial Intelligence · Computer Science 2025-01-14 Xin Zhou , Weiqing Wang , Shilin Qu , Zhiqiang Zhang , Christoph Bergmeir

Selecting the right deep learning model for power grid forecasting is challenging, as performance heavily depends on the data available to the operator. This paper presents a comprehensive benchmark of five modern neural architectures: two…

Machine Learning · Computer Science 2026-03-26 Sunki Hong , Jisoo Lee