English
Related papers

Related papers: Channel Dependence, Limited Lookback Windows, and …

200 papers

The massive generation of time-series data by largescale Internet of Things (IoT) devices necessitates the exploration of more effective models for multivariate time-series forecasting. In previous models, there was a predominant use of the…

Machine Learning · Computer Science 2024-03-15 Wenyong Han , Tao Zhu Member , Liming Chen , Huansheng Ning , Yang Luo , Yaping Wan

Recent advancements in long-term time series forecasting (LTSF) have primarily focused on capturing cross-time and cross-variate (channel) dependencies within historical data. However, a critical aspect often overlooked by many existing…

Machine Learning · Computer Science 2024-12-03 Chaolv Zeng , Yuan Tian , Guanjie Zheng , Yunjun Gao

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

Machine Learning · Computer Science 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

Recent advancements have underscored the impact of deep learning techniques on multivariate time series forecasting (MTSF). Generally, these techniques are bifurcated into two categories: Channel-independence and Channel-mixing approaches.…

Machine Learning · Computer Science 2024-03-05 Shiyi Qi , Liangjian Wen , Yiduo Li , Yuanhang Yang , Zhe Li , Zhongwen Rao , Lujia Pan , Zenglin Xu

Time series forecasting is a critical task that provides key information for decision-making. After traditional statistical and machine learning approaches, various fundamental deep learning architectures such as MLPs, CNNs, RNNs, and GNNs…

Machine Learning · Computer Science 2025-05-02 Jongseon Kim , Hyungjoon Kim , HyunGi Kim , Dongjun Lee , Sungroh Yoon

Multivariate time series forecasting tasks are usually conducted in a channel-dependent (CD) way since it can incorporate more variable-relevant information. However, it may also involve a lot of irrelevant variables, and this even leads to…

Machine Learning · Computer Science 2024-05-15 Qinshuo Liu , Yanwen Fang , Pengtao Jiang , Guodong Li

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

Machine Learning · Computer Science 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Multivariate Time Series Forecasting (MTSF) plays a crucial role across diverse fields, ranging from economic, energy, to traffic. In recent years, deep learning has demonstrated outstanding performance in MTSF tasks. In MTSF, modeling the…

Machine Learning · Computer Science 2026-01-28 Xiangfei Qiu , Hanyin Cheng , Xingjian Wu , Junkai Lu , Jilin Hu , Chenjuan Guo , Christian S. Jensen , Bin Yang

There has been a recent surge of interest in time series modeling using the Transformer architecture. However, forecasting multivariate time series with Transformer presents a unique challenge as it requires modeling both temporal…

Machine Learning · Computer Science 2025-07-04 Yu-Hsiang Lan , Eric K. Oermann

The prevailing Direct Forecasting (DF) paradigm dominates Long-term Time Series Forecasting (LTSF) by forcing models to predict the entire future horizon in a single forward pass. While efficient, this rigid coupling of output and…

Machine Learning · Computer Science 2026-02-03 Jiaming Ma , Siyuan Mu , Ruilin Tang , Haofeng Ma , Qihe Huang , Zhengyang Zhou , Pengkun Wang , Binwu Wang , Yang Wang

Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder, and decoder-only designs, raise a crucial question: What…

Machine Learning · Computer Science 2025-07-18 Lefei Shen , Mouxiang Chen , Han Fu , Xiaoxue Ren , Xiaoyun Joy Wang , Jianling Sun , Zhuo Li , Chenghao Liu

The recent boom of linear forecasting models questions the ongoing passion for architectural modifications of Transformer-based forecasters. These forecasters leverage Transformers to model the global dependencies over temporal tokens of…

Machine Learning · Computer Science 2024-03-15 Yong Liu , Tengge Hu , Haoran Zhang , Haixu Wu , Shiyu Wang , Lintao Ma , Mingsheng Long

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Selecting an appropriate look-back horizon remains a fundamental challenge in time series forecasting (TSF), particularly in the federated learning scenarios where data is decentralized, heterogeneous, and often non-independent. While…

Machine Learning · Computer Science 2026-01-06 Dahao Tang , Nan Yang , Yanli Li , Zhiyu Zhu , Zhibo Jin , Dong Yuan

Long-term Time Series Forecasting is crucial across numerous critical domains, yet its accuracy remains fundamentally constrained by the receptive field bottleneck in existing models. Mainstream Transformer- and Multi-layer Perceptron…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Weixu Wang , Xiaobo Zhou , Xin Qiao , Lei Wang , Tie Qiu

Irregularly sampled multivariate time series (ISMTS) are prevalent in reality. Due to their non-uniform intervals between successive observations and varying sampling rates among series, the channel-independent (CI) strategy, which has been…

Machine Learning · Computer Science 2024-12-18 Jiexi Liu , Meng Cao , Songcan Chen

Long-term time series forecasting (LTSF) is a crucial aspect of modern society, playing a pivotal role in facilitating long-term planning and developing early warning systems. While many Transformer-based models have recently been…

Machine Learning · Computer Science 2023-05-31 Jiaxin Gao , Wenbo Hu , Yuntian Chen

Variable Subset Forecasting (VSF) refers to a unique scenario in multivariate time series forecasting, where available variables in the inference phase are only a subset of the variables in the training phase. VSF presents significant…

Machine Learning · Computer Science 2024-11-18 Qi Hao , Runchang Liang , Yue Gao , Hao Dong , Wei Fan , Lu Jiang , Pengyang Wang

Recent research demonstrates that linear models achieve forecasting performance competitive with complex architectures, yet methodologies for enhancing linear models remain underexplored. Motivated by the hypothesis that distinct time…

Machine Learning · Computer Science 2025-10-13 Zipo Jibao , Yingyi Fu , Xinyang Chen , Guoting Chen