English
Related papers

Related papers: Expand and Compress: Exploring Tuning Principles f…

200 papers

The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-trained model and a prompting function that applies a…

Machine Learning · Computer Science 2023-06-01 Xuansheng Wu , Kaixiong Zhou , Mingchen Sun , Xin Wang , Ninghao Liu

Spatio-temporal time series are widely used in real-world applications, including traffic prediction and weather forecasting. They are sequences of observations over extensive periods and multiple locations, naturally represented as…

Machine Learning · Computer Science 2026-03-12 Taehyung Kwon , Yeonje Choi , Yeongho Kim , Kijung Shin

Explosive growth in spatio-temporal data and its wide range of applications have attracted increasing interests of researchers in the statistical and machine learning fields. The spatio-temporal regression problem is of paramount importance…

Machine Learning · Computer Science 2020-09-15 Aniruddha Rajendra Rao , Qiyao Wang , Haiyan Wang , Hamed Khorasgani , Chetan Gupta

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

With increasingly more computation being shifted to the edge of the network, monitoring of critical infrastructures, such as intermediate processing nodes in autonomous driving, is further complicated due to the typically…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-31 Dominik Scheinert , Babak Sistani Zadeh Aghdam , Soeren Becker , Odej Kao , Lauritz Thamsen

Multivariate time series forecasting in graph-structured domains is critical for real-world applications, yet existing spatiotemporal models often suffer from performance degradation under data scarcity and cross-domain shifts. We address…

Machine Learning · Computer Science 2026-02-05 Zihao Jing , Yuxi Long , Ganlin Feng

Spatiotemporal dynamics models are fundamental for various domains, from heat propagation in materials to oceanic and atmospheric flows. However, currently available neural network-based spatiotemporal modeling approaches fall short when…

Machine Learning · Computer Science 2025-02-11 Valerii Iakovlev , Harri Lähdesmäki

With the rapid advances of data acquisition techniques, spatio-temporal data are becoming increasingly abundant in a diverse array of disciplines. Here we develop spatio-temporal regression methodology for analyzing large amounts of…

Methodology · Statistics 2021-12-01 Ting Fung Ma , Fangfang Wang , Jun Zhu , Anthony R. Ives , Katarzyna E. Lewińska

Graph Neural Networks have gained huge interest in the past few years. These powerful algorithms expanded deep learning models to non-Euclidean space and were able to achieve state of art performance in various applications including…

Machine Learning · Computer Science 2023-02-14 Zahraa Al Sahili , Mariette Awad

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Traffic flow forecasting is a crucial task in transportation management and planning. The main challenges for traffic flow forecasting are that (1) as the length of prediction time increases, the accuracy of prediction will decrease; (2)…

Artificial Intelligence · Computer Science 2024-05-13 Jianli Xiao , Baichao Long

Spatiotemporal graph neural networks have shown to be effective in time series forecasting applications, achieving better performance than standard univariate predictors in several settings. These architectures take advantage of a graph…

Machine Learning · Computer Science 2023-11-13 Andrea Cini , Ivan Marisca , Daniele Zambon , Cesare Alippi

We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these…

Machine Learning · Computer Science 2018-04-24 Ali Ziat , Edouard Delasalles , Ludovic Denoyer , Patrick Gallinari

How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Liangtao Shi , Bineng Zhong , Qihua Liang , Ning Li , Shengping Zhang , Xianxian Li

In recent years, prompt tuning has sparked a research surge in adapting pre-trained models. Unlike the unified pre-training strategy employed in the language field, the graph field exhibits diverse pre-training strategies, posing challenges…

Machine Learning · Computer Science 2024-04-11 Taoran Fang , Yunchao Zhang , Yang Yang , Chunping Wang , Lei Chen

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

This paper addresses the problem of online network topology inference for expanding graphs from a stream of spatiotemporal signals. Online algorithms for dynamic graph learning are crucial in delay-sensitive applications or when changes in…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Bishwadeep Das , Elvin Isufi

Traffic congestion event prediction is an important yet challenging task in intelligent transportation systems. Many existing works about traffic prediction integrate various temporal encoders and graph convolution networks (GCNs), called…

Machine Learning · Computer Science 2023-11-16 Guangyin Jin , Lingbo Liu , Fuxian Li , Jincai Huang

The "pre-train, prompt-tuning'' paradigm has demonstrated impressive performance for tuning pre-trained heterogeneous graph neural networks (HGNNs) by mitigating the gap between pre-trained models and downstream tasks. However, most…

Machine Learning · Computer Science 2024-11-05 Yujie Mo , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

Many real-world ubiquitous applications, such as parking recommendations and air pollution monitoring, benefit significantly from accurate long-term spatio-temporal forecasting (LSTF). LSTF makes use of long-term dependency between spatial…

Machine Learning · Computer Science 2022-09-02 Wei Shao , Zhiling Jin , Shuo Wang , Yufan Kang , Xiao Xiao , Hamid Menouar , Zhaofeng Zhang , Junshan Zhang , Flora Salim