English
Related papers

Related papers: Prompt-Based Spatio-Temporal Graph Transfer Learni…

200 papers

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs,…

Machine Learning · Computer Science 2024-06-18 Jinhyeok Choi , Heehyeon Kim , Minhyeong An , Joyce Jiyoung Whang

There is a recent surge in the development of spatio-temporal forecasting models in the transportation domain. Long-range traffic forecasting, however, remains a challenging task due to the intricate and extensive spatio-temporal…

Machine Learning · Computer Science 2023-06-02 Zibo Liu , Parshin Shojaee , Chandan K Reddy

Foundation models like ChatGPT and GPT-4 have revolutionized artificial intelligence, exhibiting remarkable abilities to generalize across a wide array of tasks and applications beyond their initial training objectives. However, graph…

Machine Learning · Computer Science 2025-01-22 Yufei He , Yuan Sui , Xiaoxin He , Bryan Hooi

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

Memory-based Temporal Graph Neural Networks are powerful tools in dynamic graph representation learning and have demonstrated superior performance in many real-world applications. However, their node memory favors smaller batch sizes to…

Machine Learning · Computer Science 2023-07-18 Hongkuan Zhou , Da Zheng , Xiang Song , George Karypis , Viktor Prasanna

Traffic flow prediction is a typical spatio-temporal prediction problem and has a wide range of applications. The core challenge lies in modeling the underlying complex spatio-temporal dependencies. Various methods have been proposed, and…

Machine Learning · Computer Science 2026-01-16 Yiqing Zou , Hanning Yuan , Qianyu Yang , Ziqiang Yuan , Shuliang Wang , Sijie Ruan

Spatial-temporal graph representations play a crucial role in urban sensing applications, including traffic analysis, human mobility behavior modeling, and citywide crime prediction. However, a key challenge lies in the noisy and sparse…

Machine Learning · Computer Science 2025-08-15 Qianru Zhang , Xinyi Gao , Haixin Wang , Dong Huang , Siu-Ming Yiu , Hongzhi Yin

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Spatial-temporal graph learning has emerged as a promising solution for modeling structured spatial-temporal data and learning region representations for various urban sensing tasks such as crime forecasting and traffic flow prediction.…

Machine Learning · Computer Science 2023-06-21 Qianru Zhang , Chao Huang , Lianghao Xia , Zheng Wang , Siuming Yiu , Ruihua Han

Graph Neural Networks (GNN) have recently gained popularity in the forecasting domain due to their ability to model complex spatial and temporal patterns in tasks such as traffic forecasting and region-based demand forecasting. Most of…

Machine Learning · Computer Science 2023-12-08 Abishek Sriramulu , Nicolas Fourrier , Christoph Bergmeir

Variations of human body skeletons may be considered as dynamic graphs, which are generic data representation for numerous real-world applications. In this paper, we propose a spatio-temporal graph convolution (STGC) approach for assembling…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Chaolong Li , Zhen Cui , Wenming Zheng , Chunyan Xu , Jian Yang

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung

Traffic flow forecasting is considered a critical task in the field of intelligent transportation systems. In this paper, to address the issue of low accuracy in long-term forecasting of spatial-temporal big data on traffic flow, we propose…

Machine Learning · Computer Science 2024-07-17 Baichao Long , Wang Zhu , Jianli Xiao

This paper addresses the problem of traffic prediction in distributed backend systems and proposes a graph neural network based modeling approach to overcome the limitations of traditional models in capturing complex dependencies and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Zhimin Qiu , Feng Liu , Yuxiao Wang , Chenrui Hu , Ziyu Cheng , Di Wu

This paper addresses the task of segmenting class-agnostic objects in semi-supervised setting. Although previous detection based methods achieve relatively good performance, these approaches extract the best proposal by a greedy strategy,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Daizong Liu , Shuangjie Xu , Xiao-Yang Liu , Zichuan Xu , Wei Wei , Pan Zhou

In the realm of applications where data dynamically evolves across spatial and temporal dimensions, Graph Neural Networks (GNNs) are often complemented by sequence modeling architectures, such as RNNs and transformers, to effectively model…

Machine Learning · Computer Science 2024-09-02 Osama Ahmad , Omer Abdul Jalil , Usman Nazir , Murtaza Taj

Spatio-temporal graph signal analysis has a significant impact on a wide range of applications, including hand/body pose action recognition. To achieve effective analysis, spatio-temporal graph convolutional networks (ST-GCN) leverage the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zida Cheng , Siheng Chen , Ya Zhang

Spatiotemporal graph neural networks (ST-GNNs) are powerful tools for modeling spatial and temporal data dependencies. However, their applications have been limited primarily to small-scale datasets because of memory constraints. While…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Seth Ockerman , Amal Gueroudji , Tanwi Mallick , Yixuan He , Line Pouchard , Robert Ross , Shivaram Venkataraman

Compared with artificial neural networks (ANNs), spiking neural networks (SNNs) are promising to explore the brain-like behaviors since the spikes could encode more spatio-temporal information. Although pre-training from ANN or direct…

Neural and Evolutionary Computing · Computer Science 2018-09-18 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

There have been many recent investigations into prompt-based training of transformer language models for new text genres in low-resource settings. The prompt-based training approach has been found to be effective in generalizing pre-trained…

Computation and Language · Computer Science 2023-06-13 Jennifer D'Souza , Moussab Hrou , Sören Auer