English
Related papers

Related papers: PromptST: Prompt-Enhanced Spatio-Temporal Multi-At…

200 papers

Recently, pre-trained state space models have shown great potential for video classification, which sequentially compresses visual tokens in videos with linear complexity, thereby improving the processing efficiency of video data while…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiahuan Zhou , Kai Zhu , Zhenyu Cui , Zichen Liu , Xu Zou , Gang Hua

Training models on spatio-temporal (ST) data poses an open problem due to the complicated and diverse nature of the data itself, and it is challenging to ensure the model's performance directly trained on the original ST data. While…

Machine Learning · Computer Science 2024-09-17 Du Yin , Jinliang Deng , Shuang Ao , Zechen Li , Hao Xue , Arian Prabowo , Renhe Jiang , Xuan Song , Flora Salim

Spatial Transcriptomics (ST) reveals the spatial distribution of gene expression in tissues, offering critical insights into biological processes and disease mechanisms. However, the high cost, limited coverage, and technical complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Yi Niu , Jiashuai Liu , Yingkang Zhan , Jiangbo Shi , Di Zhang , Marika Reinius , Ines Machado , Mireia Crispin-Ortuzar , Jialun Wu , Chen Li , Zeyu Gao

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Haoxing Chen , Zizheng Huang , Yan Hong , Yanshuo Wang , Zhongcai Lyu , Zhuoer Xu , Jun Lan , Zhangxuan Gu

Prompt tuning has become a new paradigm for model tuning and it has demonstrated success in natural language pretraining and even vision pretraining. In this work, we explore the transfer of prompt tuning to multimodal pretraining, with a…

Computation and Language · Computer Science 2022-08-05 Hao Yang , Junyang Lin , An Yang , Peng Wang , Chang Zhou , Hongxia Yang

Due to the extensive availability of operation data, data-driven methods show strong capabilities in predicting building energy loads. Buildings with similar features often share energy patterns, reflected by spatial dependencies in their…

Machine Learning · Computer Science 2025-07-29 Yongzheng Liu , Yiming Wang , Po Xu , Yingjie Xu , Yuntian Chen , Dongxiao Zhang

Although spatio-temporal graph neural networks have achieved great empirical success in handling multiple correlated time series, they may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.…

Signal Processing · Electrical Eng. & Systems 2021-02-10 Chao Pan , Siheng Chen , Antonio Ortega

Spatiotemporal predictive learning (ST-PL) is a hotspot with numerous applications, such as object movement and meteorological prediction. It aims at predicting the subsequent frames via observed sequences. However, inherent uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zenghao Chai , Zhengzhuo Xu , Yunpeng Bai , Zhihui Lin , Chun Yuan

Spatio-Temporal (ST) prediction is crucial for making informed decisions in urban location-based applications like ride-sharing. However, existing ST models often require region partition as a prerequisite, resulting in two main pitfalls.…

Machine Learning · Computer Science 2024-03-13 Liyue Chen , Jiangyi Fang , Tengfei Liu , Shaosheng Cao , Leye Wang

As deep spatio-temporal neural networks are increasingly utilised in urban computing contexts, the deployment of such methods can have a direct impact on users of critical urban infrastructure, such as public transport, emergency services,…

Machine Learning · Computer Science 2025-08-12 Sichen Zhao , Wei Shao , Jeffrey Chan , Ziqi Xu , Flora Salim

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chen Tang , Xinzhu Ma , Encheng Su , Xiufeng Song , Xiaohong Liu , Wei-Hong Li , Lei Bai , Wanli Ouyang , Xiangyu Yue

We study the forecasting problem for traffic with dynamic, possibly periodical, and joint spatial-temporal dependency between regions. Given the aggregated inflow and outflow traffic of regions in a city from time slots 0 to t-1, we predict…

Machine Learning · Computer Science 2022-05-05 Guanyao Li , Shuhan Zhong , S. -H. Gary Chan , Ruiyuan Li , Chih-Chieh Hung , Wen-Chih Peng

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent…

Databases · Computer Science 2025-03-19 Yuxuan Liang , Haomin Wen , Yutong Xia , Ming Jin , Bin Yang , Flora Salim , Qingsong Wen , Shirui Pan , Gao Cong

Traffic flow forecasting is a crucial task in urban computing. The challenge arises as traffic flows often exhibit intrinsic and latent spatio-temporal correlations that cannot be identified by extracting the spatial and temporal patterns…

Machine Learning · Computer Science 2022-02-02 Song Yang , Jiamou Liu , Kaiqi Zhao

The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural…

Machine Learning · Computer Science 2024-04-03 Defu Cao , Furong Jia , Sercan O Arik , Tomas Pfister , Yixiang Zheng , Wen Ye , Yan Liu

Prompt tuning, in which a base pretrained model is adapted to each task via conditioning on learned prompt vectors, has emerged as a promising approach for efficiently adapting large language models to multiple downstream tasks. However,…

Computation and Language · Computer Science 2023-03-07 Zhen Wang , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Huan Sun , Yoon Kim

Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current…

Machine Learning · Computer Science 2025-10-07 Haotian Gao , Zheng Dong , Jiawei Yong , Shintaro Fukushima , Kenjiro Taura , Renhe Jiang

Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to…

Machine Learning · Computer Science 2024-12-20 Qi Zheng , Zihao Yao , Yaying Zhang

Spatial-temporal forecasting plays an important role in many real-world applications, such as traffic forecasting, air pollutant forecasting, crowd-flow forecasting, and so on. State-of-the-art spatial-temporal forecasting models take…

Machine Learning · Computer Science 2024-01-22 Xinyu Su , Jianzhong Qi , Egemen Tanin , Yanchuan Chang , Majid Sarvi

Accurate traffic flow prediction heavily relies on the spatio-temporal correlation of traffic flow data. Most current studies separately capture correlations in spatial and temporal dimensions, making it difficult to capture complex…

Machine Learning · Computer Science 2025-01-03 Ben-Ao Dai , Nengchao Lyu , Yongchao Miao