English
Related papers

Related papers: XLinear: A Lightweight and Accurate MLP-Based Mode…

200 papers

Recently, significant advancements have been made in time-series forecasting research, with an increasing focus on analyzing the nature of time-series data, e.g, channel-independence (CI) and channel-dependence (CD), rather than solely…

Machine Learning · Computer Science 2023-08-04 Wei Li , Xiangxu Meng , Chuhao Chen , Jianing Chen

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Time series forecasting remains a challenging task, particularly in the context of complex multiscale temporal patterns. This study presents LLM-Mixer, a framework that improves forecasting accuracy through the combination of multiscale…

This paper demonstrates that pre-trained language models (PLMs) are strong foundation models for on-device meteorological variables modeling. We present LM-Weather, a generic approach to taming PLMs, that have learned massive sequential…

Atmospheric and Oceanic Physics · Physics 2024-06-03 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Transformers have gained popularity in time series forecasting for their ability to capture long-sequence interactions. However, their high memory and computing requirements pose a critical bottleneck for long-term forecasting. To address…

Machine Learning · Computer Science 2023-12-12 Vijay Ekambaram , Arindam Jati , Nam Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks mostly focuses on the…

Machine Learning · Computer Science 2018-06-19 Tian Guo , Tao Lin

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, and exhibits complex…

Machine Learning · Computer Science 2024-12-19 Tongtong Zhang , Zhiyong Cui , Bingzhang Wang , Yilong Ren , Haiyang Yu , Pan Deng , Yinhai Wang

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Multivariate Time Series (MTS) forecasting has a wide range of applications in both industry and academia. Recent advances in Spatial-Temporal Graph Neural Network (STGNN) have achieved great progress in modelling spatial-temporal…

Machine Learning · Computer Science 2025-05-22 Huiliang Zhang , Di Wu , Arnaud Zinflou , Stephane Dellacherie , Mouhamadou Makhtar Dione , Benoit Boulet

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

Machine Learning · Computer Science 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

Modeling multiscale patterns is crucial for long-term time series forecasting (TSF). However, redundancy and noise in time series, together with semantic gaps between non-adjacent scales, make the efficient alignment and integration of…

Machine Learning · Computer Science 2026-02-19 Xu Zhang , Qitong Wang , Peng Wang , Wei Wang

Time series forecasting holds significant importance across various industries, including finance, transportation, energy, healthcare, and climate. Despite the widespread use of linear networks due to their low computational cost and…

Machine Learning · Computer Science 2025-05-02 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jianxin Liao

Time series forecasting is a critical task across domains such as energy, finance, and meteorology, where accurate predictions enable informed decision-making. While transformer-based and large-parameter models have recently achieved…

Machine Learning · Computer Science 2026-02-11 Julien Guité-Vinet , Alexandre Blondin Massé , Éric Beaudry

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

Probabilistic forecasting of high dimensional multivariate time series is a notoriously challenging task, both in terms of computational burden and distribution modeling. Most previous work either makes simple distribution assumptions or…

Machine Learning · Computer Science 2021-01-27 Nam Nguyen , Brian Quanz

This paper introduces a novel framework that accelerates the discovery of actionable relationships in high-dimensional temporal data by integrating machine learning (ML), explainable AI (XAI), and natural language processing (NLP) to…

Machine Learning · Computer Science 2025-06-09 Jiztom Kavalakkatt Francis , Matthew J Darr

Covariates provide valuable information on external factors that influence time series and are critical in many real-world time series forecasting tasks. For example, in retail, covariates may indicate promotions or peak dates such as…