English
Related papers

Related papers: Expand and Compress: Exploring Tuning Principles f…

200 papers

Graph-based spatio-temporal neural networks are effective to model the spatial dependency among discrete points sampled irregularly from unstructured grids, thanks to the great expressiveness of graph neural networks. However, these models…

Machine Learning · Computer Science 2022-04-22 Haitao Lin , Guojiang Zhao , Lirong Wu , Stan Z. Li

This paper proposes a spatiotemporal graph neural network-based performance prediction algorithm to address the challenge of forecasting performance fluctuations in distributed backend systems with multi-level service call structures. The…

Machine Learning · Computer Science 2025-08-12 Zhihao Xue , Yun Zi , Nia Qi , Ming Gong , Yujun Zou

In many problem settings that require spatio-temporal forecasting, the values in the time-series not only exhibit spatio-temporal correlations but are also influenced by spatial diffusion across locations. One such example is forecasting…

Machine Learning · Computer Science 2024-12-19 Malay Pandey , Vaishali Jain , Nimit Godhani , Sachchida Nand Tripathi , Piyush Rai

Self-supervised learning has been actively studied in time series domain recently, especially for masked reconstruction. Most of these methods follow the "Pre-training + Fine-tuning" paradigm in which a new decoder replaces the pre-trained…

Machine Learning · Computer Science 2023-11-08 Hao Liu , Jinrui Gan , Xiaoxuan Fan , Yi Zhang , Chuanxian Luo , Jing Zhang , Guangxin Jiang , Yucheng Qian , Changwei Zhao , Huan Ma , Zhenyu Guo

With recent advances in sensing technologies, a myriad of spatio-temporal data has been generated and recorded in smart cities. Forecasting the evolution patterns of spatio-temporal data is an important yet demanding aspect of urban…

Machine Learning · Computer Science 2023-11-27 Guangyin Jin , Yuxuan Liang , Yuchen Fang , Zezhi Shao , Jincai Huang , Junbo Zhang , Yu Zheng

Short-term demand forecasting models commonly combine convolutional and recurrent layers to extract complex spatiotemporal patterns in data. Long-term histories are also used to consider periodicity and seasonality patterns as time series…

Machine Learning · Computer Science 2019-10-15 Doyup Lee , Suehun Jung , Yeongjae Cheon , Dongil Kim , Seungil You

Several data compressors have been proposed in distributed optimization frameworks of network systems to reduce communication overhead in large-scale applications. In this paper, we demonstrate that effective information compression may…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Zihao Ren , Lei Wang , Xinlei Yi , Xi Wang , Deming Yuan , Tao Yang , Zhengguang Wu , Guodong Shi

In the evolving landscape of machine learning, the adaptation of pre-trained models through prompt tuning has become increasingly prominent. This trend is particularly observable in the graph domain, where diverse pre-training strategies…

Machine Learning · Computer Science 2026-05-18 Junhyun Lee , Wooseong Yang , Jaewoo Kang

Neural Temporal Point Processes (TPPs) are the prevalent paradigm for modeling continuous-time event sequences, such as user activities on the web and financial transactions. In real-world applications, event data is typically received in a…

Machine Learning · Computer Science 2023-10-16 Siqiao Xue , Yan Wang , Zhixuan Chu , Xiaoming Shi , Caigao Jiang , Hongyan Hao , Gangwei Jiang , Xiaoyun Feng , James Y. Zhang , Jun Zhou

The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction…

Machine Learning · Computer Science 2021-06-16 Bing Yu , Haoteng Yin , Zhanxing Zhu

The widespread deployment of wireless and mobile devices results in a proliferation of spatio-temporal data that is used in applications, e.g., traffic prediction, human mobility mining, and air quality prediction, where spatio-temporal…

Databases · Computer Science 2024-04-24 Hao Miao , Yan Zhao , Chenjuan Guo , Bin Yang , Kai Zheng , Feiteng Huang , Jiandong Xie , Christian S. Jensen

Dynamic graphs have attracted increasing attention due to their ability to model complex and evolving relationships in real-world scenarios. Traditional approaches typically pre-train models using dynamic link prediction and directly apply…

Machine Learning · Computer Science 2026-01-21 Yufei Peng , Cheng Yang , Zhengjie Fan , Chuan Shi

Spatio-temporal forecasting is an open research field whose interest is growing exponentially. In this work we focus on creating a complex deep neural framework for spatio-temporal traffic forecasting with comparatively very good…

Machine Learning · Computer Science 2020-10-22 Rodrigo de Medrano , José L. Aznarte

We present a generic framework for spatio-temporal (ST) data modeling, analysis, and forecasting, with a special focus on data that is sparse in both space and time. Our multi-scaled framework is a seamless coupling of two major components:…

Machine Learning · Computer Science 2018-04-04 Bao Wang , Xiyang Luo , Fangbo Zhang , Baichuan Yuan , Andrea L. Bertozzi , P. Jeffrey Brantingham

In this work, we explore "prompt tuning", a simple yet effective mechanism for learning "soft prompts" to condition frozen language models to perform specific downstream tasks. Unlike the discrete text prompts used by GPT-3, soft prompts…

Computation and Language · Computer Science 2021-09-03 Brian Lester , Rami Al-Rfou , Noah Constant

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Numerical weather forecasts can exhibit systematic errors due to simplifying model assumptions and computational approximations. Statistical postprocessing is a statistical approach to correcting such biases. A statistical postprocessing…

Methodology · Statistics 2022-09-02 Stefan Siegert , Ben Hooper , Joshua Lovegrove , Tyler Thomson , Birgir Hrafnkelsson

Spatio-temporal prediction is a pivotal task with broad applications in traffic management, climate monitoring, energy scheduling, etc. However, existing methodologies often struggle to balance model expressiveness and computational…

Machine Learning · Computer Science 2025-05-27 Jiawen Chen , Qi Shao , Duxin Chen , Wenwu Yu

Recently, pre-trained state space models have shown great potential for video classification, which sequentially compresses visual tokens in videos with linear complexity, thereby improving the processing efficiency of video data while…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jiahuan Zhou , Kai Zhu , Zhenyu Cui , Zichen Liu , Xu Zou , Gang Hua

GNN-based recommenders have excelled in modeling intricate user-item interactions through multi-hop message passing. However, existing methods often overlook the dynamic nature of evolving user-item interactions, which impedes the adaption…

Information Retrieval · Computer Science 2024-02-20 Yuhao Yang , Lianghao Xia , Da Luo , Kangyi Lin , Chao Huang