English
Related papers

Related papers: Long-Range Transformers for Dynamic Spatiotemporal…

200 papers

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Demystifying interactions between temporal patterns of different scales is fundamental to precise long-range time series forecasting. However, previous works lack the ability to model high-order interactions. To promote more comprehensive…

Machine Learning · Computer Science 2024-12-24 Zongjiang Shang , Ling Chen , Binqing Wu , Dongliang Cui

Time series prediction is a prevalent issue across various disciplines, such as meteorology, traffic surveillance, investment, and energy production and consumption. Many statistical and machine-learning strategies have been developed to…

Machine Learning · Computer Science 2023-05-26 Wei Wang , Yang Liu , Hao Sun

Temporal graph classification plays a critical role in applications such as cybersecurity, brain connectivity analysis, social dynamics, and traffic monitoring. Despite its significance, this problem remains underexplored compared to…

Machine Learning · Computer Science 2025-11-26 Md. Joshem Uddin , Soham Changani , Baris Coskunuzer

Recent studies have shown great promise in applying graph neural networks for multivariate time series forecasting, where the interactions of time series are described as a graph structure and the variables are represented as the graph…

Machine Learning · Computer Science 2022-06-29 Junchen Ye , Zihan Liu , Bowen Du , Leilei Sun , Weimiao Li , Yanjie Fu , Hui Xiong

Time series forecasting lies at the core of important real-world applications in many fields of science and engineering. The abundance of large time series datasets that consist of complex patterns and long-term dependencies has led to the…

Machine Learning · Computer Science 2023-12-01 Nancy Xu , Chrysoula Kosma , Michalis Vazirgiannis

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Given a sequence of sets, where each set contains an arbitrary number of elements, the problem of temporal sets prediction aims to predict the elements in the subsequent set. In practice, temporal sets prediction is much more complex than…

Machine Learning · Computer Science 2020-07-09 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Hui Xiong , Weifeng Lv

Transformers have shown great power in time series forecasting due to their global-range modeling ability. However, their performance can degenerate terribly on non-stationary real-world data in which the joint distribution changes over…

Machine Learning · Computer Science 2023-11-27 Yong Liu , Haixu Wu , Jianmin Wang , Mingsheng Long

Real-world time series data are inherently multivariate, often exhibiting complex inter-channel dependencies. Each channel is typically sampled at its own period and is prone to missing values due to various practical and operational…

Machine Learning · Computer Science 2026-03-11 Jinkwan Jang , Hyungjin Park , Jinmyeong Choi , Taesup Kim

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Deep learning utilizing transformers has recently achieved a lot of success in many vital areas such as natural language processing, computer vision, anomaly detection, and recommendation systems, among many others. Among several merits of…

Machine Learning · Computer Science 2023-12-05 Lena Sasal , Tanujit Chakraborty , Abdenour Hadid

Time series forecasting is extensively applied across diverse domains. Transformer-based models demonstrate significant potential in modeling cross-time and cross-variable interaction. However, we notice that the cross-variable correlation…

Machine Learning · Computer Science 2024-10-08 Ao Hu , Dongkai Wang , Yong Dai , Shiyi Qi , Liangjian Wen , Jun Wang , Zhi Chen , Xun Zhou , Zenglin Xu , Jiang Duan

We present Timer-XL, a causal Transformer for unified time series forecasting. To uniformly predict multidimensional time series, we generalize next token prediction, predominantly adopted for 1D token sequences, to multivariate next token…

Machine Learning · Computer Science 2025-03-04 Yong Liu , Guo Qin , Xiangdong Huang , Jianmin Wang , Mingsheng Long

Predicting future locations of agents in the scene is an important problem in self-driving. In recent years, there has been a significant progress in representing the scene and the agents in it. The interactions of agents with the scene and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Görkay Aydemir , Adil Kaan Akan , Fatma Güney

Spatio-temporal forecasting is an open research field whose interest is growing exponentially. In this work we focus on creating a complex deep neural framework for spatio-temporal traffic forecasting with comparatively very good…

Machine Learning · Computer Science 2020-10-22 Rodrigo de Medrano , José L. Aznarte

Dynamic scene graph generation aims at generating a scene graph of the given video. Compared to the task of scene graph generation from images, it is more challenging because of the dynamic relationships between objects and the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuren Cong , Wentong Liao , Hanno Ackermann , Bodo Rosenhahn , Michael Ying Yang

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

Multivariate time-series forecasting plays a crucial role in many real-world applications. It is a challenging problem as one needs to consider both intra-series temporal correlations and inter-series correlations simultaneously. Recently,…

Machine Learning · Computer Science 2021-03-16 Defu Cao , Yujing Wang , Juanyong Duan , Ce Zhang , Xia Zhu , Conguri Huang , Yunhai Tong , Bixiong Xu , Jing Bai , Jie Tong , Qi Zhang

Accurate wind power forecasting can help formulate scientific dispatch plans, which is of great significance for maintaining the safety, stability, and efficient operation of the power system. In recent years, wind power forecasting methods…

Machine Learning · Computer Science 2025-05-05 Yajuan Zhang , Jiahai Jiang , Yule Yan , Liang Yang , Ping Zhang