English
Related papers

Related papers: DGCformer: Deep Graph Clustering Transformer for M…

200 papers

Long-term forecasting of multivariate urban data poses a significant challenge due to the complex spatiotemporal dependencies inherent in such datasets. This paper presents DST, a novel multivariate time-series forecasting model that…

Machine Learning · Computer Science 2025-08-28 Amirhossein Sohrabbeig , Omid Ardakanian , Petr Musilek

Transformers for time series forecasting mainly model time series from limited or fixed scales, making it challenging to capture different characteristics spanning various scales. We propose Pathformer, a multi-scale Transformer with…

Machine Learning · Computer Science 2024-09-17 Peng Chen , Yingying Zhang , Yunyao Cheng , Yang Shu , Yihang Wang , Qingsong Wen , Bin Yang , Chenjuan Guo

Industrial carbon emissions are a major driver of climate change, yet modeling these emissions is challenging due to multicollinearity among factors and complex interdependencies across sectors and time. We propose a novel graph-based deep…

Machine Learning · Computer Science 2025-11-07 Xuanming Zhang

Short-term precipitation forecasting remains challenging due to the difficulty in capturing long-term spatiotemporal dependencies. Current deep learning methods fall short in establishing effective dependencies between conditions and…

Machine Learning · Computer Science 2024-10-18 ChaoRong Li , XuDong Ling , YiLan Xue , Wenjie Luo , LiHong Zhu , FengQing Qin , Yaodong Zhou , Yuanyuan Huang

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Recent advancements have underscored the impact of deep learning techniques on multivariate time series forecasting (MTSF). Generally, these techniques are bifurcated into two categories: Channel-independence and Channel-mixing approaches.…

Machine Learning · Computer Science 2024-03-05 Shiyi Qi , Liangjian Wen , Yiduo Li , Yuanhang Yang , Zhe Li , Zhongwen Rao , Lujia Pan , Zenglin Xu

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

Machine Learning · Computer Science 2026-01-29 Wei Li

A variety of real-world applications rely on far future information to make decisions, thus calling for efficient and accurate long sequence multivariate time series forecasting. While recent attention-based forecasting models show strong…

Machine Learning · Computer Science 2022-05-02 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang , Tung Kieu , Xuanyi Dong , Shirui Pan

Predicting time-series is of great importance in various scientific and engineering fields. However, in the context of limited and noisy data, accurately predicting dynamics of all variables in a high-dimensional system is a challenging…

Machine Learning · Computer Science 2025-06-16 Zijian Wang , Peng Tao , Luonan Chen

Long-term time series forecasting (LTSF) has been widely applied in finance, traffic prediction, and other domains. Recently, patch-based transformers have emerged as a promising approach, segmenting data into sub-level patches that serve…

Machine Learning · Computer Science 2024-08-06 Ruixin Ding , Yuqi Chen , Yu-Ting Lan , Wei Zhang

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this…

Machine Learning · Computer Science 2026-02-16 Xingyu Zhang , Hanyun Du , Zeen Song , Siyu Zhao , Changwen Zheng , Wenwen Qiang

Transformer-based models for anomaly detection in multivariate time series can benefit from the self-attention mechanism due to its advantage in modeling long-term dependencies. However, Transformer-based anomaly detection models have…

Machine Learning · Computer Science 2023-12-05 Jie Liu , Qilin Li , Senjian An , Bradley Ezard , Ling Li

Recent advancements in foundation models have been successfully extended to the time series (TS) domain, facilitated by the emergence of large-scale TS datasets. However, previous efforts have primarily Capturing channel dependency (CD) is…

Machine Learning · Computer Science 2026-05-29 Seunghan Lee , Taeyoung Park , Kibok Lee

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Transformers have achieved great success in several domains, including Natural Language Processing and Computer Vision. However, its application to real-world graphs is less explored, mainly due to its high computation cost and its poor…

Machine Learning · Computer Science 2023-01-31 Weilin Cong , Yanhong Wu , Yuandong Tian , Mengting Gu , Yinglong Xia , Chun-cheng Jason Chen , Mehrdad Mahdavi

Accurate traffic flow prediction is essential for applications like transport logistics but remains challenging due to complex spatio-temporal correlations and non-linear traffic patterns. Existing methods often model spatial and temporal…

Machine Learning · Computer Science 2025-03-18 Jing Chen , Haocheng Ye , Zhian Ying , Yuntao Sun , Wenqiang Xu

Multivariate time series (MTS) forecasting has been extensively applied across diverse domains, such as weather prediction and energy consumption. However, current studies still rely on the vanilla point-wise self-attention mechanism to…

Machine Learning · Computer Science 2024-05-21 Yingnan Yang , Qingling Zhu , Jianyong Chen

Passenger demand forecasting helps optimize vehicle scheduling, thereby improving urban efficiency. Recently, attention-based methods have been used to adequately capture the dynamic nature of spatio-temporal data. However, existing methods…

Artificial Intelligence · Computer Science 2025-06-06 Haichen Wang , Liu Yang , Xinyuan Zhang , Haomin Yu , Ming Li , Jilin Hu

A reliable and efficient representation of multivariate time series is crucial in various downstream machine learning tasks. In multivariate time series forecasting, each variable depends on its historical values and there are…

Machine Learning · Computer Science 2022-08-22 William T. Ng , K. Siu , Albert C. Cheung , Michael K. Ng

The growing interest in Temporal Graph Neural Networks (TGNNs) stems from their ability to model complex dynamics and deliver superior performance. However, TGNNs encounter fundamental challenges in capturing long-term dependencies and…

Machine Learning · Computer Science 2026-05-26 Hongjiang Chen , Pengfei Jiao , Ming Du , Xuan Guo , Zhidong Zhao , Di Jin , Xiao Liu