English
Related papers

Related papers: MTS-Mixers: Multivariate Time Series Forecasting v…

200 papers

Deep models for Multivariate Time Series (MTS) forecasting have recently demonstrated significant success. Channel-dependent models capture complex dependencies that channel-independent models cannot capture. However, the number of channels…

Machine Learning · Computer Science 2024-08-09 Xin Zhou , Weiqing Wang , Wray Buntine , Shilin Qu , Abishek Sriramulu , Weicong Tan , Christoph Bergmeir

Time series forecasting remains a critical challenge across various domains, often complicated by high-dimensional data and long-term dependencies. This paper presents a novel transformer architecture for time series forecasting,…

Machine Learning · Computer Science 2025-02-12 Yanlong Wang , Jian Xu , Fei Ma , Shao-Lun Huang , Danny Dongning Sun , Xiao-Ping Zhang

Recent studies have attempted to refine the Transformer architecture to demonstrate its effectiveness in Long-Term Time Series Forecasting (LTSF) tasks. Despite surpassing many linear forecasting models with ever-improving performance, we…

Machine Learning · Computer Science 2024-12-30 Peiwang Tang , Weitai Zhang

Financial time series forecasting presents significant challenges due to complex nonlinear relationships, temporal dependencies, variable interdependencies and limited data availability, particularly for tasks involving low-frequency data,…

General Finance · Quantitative Finance 2025-07-11 Ben A. Marconi

While generative modeling on time series facilitates more capable and flexible probabilistic forecasting, existing generative time series models do not address the multi-dimensional properties of time series data well. The prevalent…

Machine Learning · Computer Science 2026-02-09 Haoran Zhang , Haixuan Liu , Yong Liu , Yunzhong Qiu , Yuxuan Wang , Jianmin Wang , Mingsheng Long

The non-stationary nature of real-world Multivariate Time Series (MTS) data presents forecasting models with a formidable challenge of the time-variant distribution of time series, referred to as distribution shift. Existing studies on the…

Machine Learning · Computer Science 2024-07-19 Hui He , Qi Zhang , Kun Yi , Xiaojun Xue , Shoujin Wang , Liang Hu , Longbing Cao

Accurate forecasting of multivariate time series data remains a formidable challenge, particularly due to the growing complexity of temporal dependencies in real-world scenarios. While neural network-based models have achieved notable…

Machine Learning · Computer Science 2025-12-09 Andrey Savchenko , Oleg Kachan

As Transformer-based models have achieved impressive performance on various time series tasks, Long-Term Series Forecasting (LTSF) tasks have also received extensive attention in recent years. However, due to the inherent computational…

Machine Learning · Computer Science 2024-02-06 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Xiaoyan Ma , Dongyang Li , Minggao Zhang

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

Machine Learning · Computer Science 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

Transformer-based architectures dominate time series modeling by enabling global attention over all timestamps, yet their rigid 'one-size-fits-all' context aggregation fails to address two critical challenges in real-world data: (1)…

Machine Learning · Computer Science 2025-09-30 Xiaowen Ma , Shuning Ge , Fan Yang , Xiangyu Li , Yun Chen , Mengting Ma , Wei Zhang , Zhipeng Liu

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

The paper develops a Transformer architecture for estimating dynamic factors from multivariate time series data under flexible identification assumptions. Performance on small datasets is improved substantially by using a conventional…

Econometrics · Economics 2026-01-21 Oliver Snellman

Multivariate time series forecasting is crucial for various applications, such as financial investment, energy management, weather forecasting, and traffic optimization. However, accurate forecasting is challenging due to two main factors.…

Machine Learning · Computer Science 2025-01-13 Xiangfei Qiu , Xingjian Wu , Yan Lin , Chenjuan Guo , Jilin Hu , Bin Yang

Time series forecasting is widely used in extensive applications, such as traffic planning and weather forecasting. However, real-world time series usually present intricate temporal variations, making forecasting extremely challenging.…

Machine Learning · Computer Science 2024-05-24 Shiyu Wang , Haixu Wu , Xiaoming Shi , Tengge Hu , Huakun Luo , Lintao Ma , James Y. Zhang , Jun Zhou

Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and structure of input…

Machine Learning · Computer Science 2026-02-11 Saurish Nagrath , Saroj Kumar Panigrahy

Multivariate time series forecasting is crucial across various industries, where accurate extraction of complex periodic and trend components can significantly enhance prediction performance. However, existing models often struggle to…

Machine Learning · Computer Science 2025-05-08 Yulong Wang , Yushuo Liu , Xiaoyi Duan , Kai Wang

Recent research in time series forecasting has explored integrating multimodal features into models to improve accuracy. However, the accuracy of such methods is constrained by three key challenges: inadequate extraction of fine-grained…

Machine Learning · Computer Science 2025-10-21 Shule Hao , Junpeng Bao , Wenli Li

Multivariate forecasting with Transformers faces a core scalability challenge: modeling cross-channel dependencies via attention compounds attention's quadratic sequence complexity with quadratic channel scaling, making full cross-channel…

Machine Learning · Computer Science 2026-05-12 Willa Potosnak , Nina Żukowska , Michał Wiliński , Dan Howarth , Ignacy Stępka , Mononito Goswami , Artur Dubrawski

Accurate univariate forecasting remains a pressing need in real-world systems, such as energy markets, hydrology, retail demand, and IoT monitoring, where signals are often intermittent and horizons span both short- and long-term. While…

Machine Learning · Computer Science 2025-08-26 Kyrylo Yemets , Mykola Lukashchuk , Ivan Izonin

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What…

Machine Learning · Computer Science 2025-07-18 Lefei Shen , Mouxiang Chen , Han Fu , Xiaoxue Ren , Xiaoyun Joy Wang , Jianling Sun , Zhuo Li , Chenghao Liu