English
Related papers

Related papers: Bridging the Gap Between Training and Inference fo…

200 papers

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

Machine Learning · Computer Science 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approaches encounter a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Wenbo Xu , Yanan Wu , Haoran Jiang , Yang Wang , Qiang Wu , Jian Zhang

Spatio-temporal prediction aims to forecast and gain insights into the ever-changing dynamics of urban environments across both time and space. Its purpose is to anticipate future patterns, trends, and events in diverse facets of urban…

Computation and Language · Computer Science 2024-05-21 Zhonghang Li , Lianghao Xia , Jiabin Tang , Yong Xu , Lei Shi , Long Xia , Dawei Yin , Chao Huang

Multivariate time series forecasting requires models to simultaneously capture variable-wise structural dependencies and generalize across diverse tasks. While structural encoders are effective in modeling feature interactions, they lack…

Computation and Language · Computer Science 2025-06-26 Fengze Li , Yue Wang , Yangle Liu , Ming Huang , Dou Hong , Jieming Ma

Spatio-temporal prediction is a crucial research area in data-driven urban computing, with implications for transportation, public safety, and environmental monitoring. However, scalability and generalization challenges remain significant…

Machine Learning · Computer Science 2024-09-12 Jiabin Tang , Wei Wei , Lianghao Xia , Chao Huang

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Extreme precipitation causes severe societal and economic damage, and weather control has long been discussed as a potential mitigation strategy. However, to the best of our knowledge, perturbation-based interventions for weather control…

Machine Learning · Computer Science 2026-05-15 Ayumu Ueyama , Kazuhiko Kawamoto , Hiroshi Kera

Sequential Bayesian inference over predictive functions is a natural framework for continual learning from streams of data. However, applying it to neural networks has proved challenging in practice. Addressing the drawbacks of existing…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Freddie Bickford Smith , Qixuan Feng , Yee Whye Teh , Yarin Gal

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

Spatio-temporal kriging is an important problem in web and social applications, such as Web or Internet of Things, where things (e.g., sensors) connected into a web often come with spatial and temporal properties. It aims to infer knowledge…

Machine Learning · Computer Science 2023-02-07 Chuanpan Zheng , Xiaoliang Fan , Cheng Wang , Jianzhong Qi , Chaochao Chen , Longbiao Chen

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

Multi-step ahead prediction in language models is challenging due to the discrepancy between training and test time processes. At test time, a sequence predictor is required to make predictions given past predictions as the input, instead…

Computation and Language · Computer Science 2021-01-26 James O' Neill , Danushka Bollegala

Generative AI has achieved remarkable empirical success, but from the perspective of statistics it often remains opaque: its predictions may be accurate, yet the underlying mechanism is difficult to interpret, analyze, and trust. This book…

Machine Learning · Statistics 2026-03-11 Shinto Eguchi

Spatiotemporal systems are common in the real-world. Forecasting the multi-step future of these spatiotemporal systems based on the past observations, or, Spatiotemporal Sequence Forecasting (STSF), is a significant and challenging problem.…

Machine Learning · Computer Science 2018-08-22 Xingjian Shi , Dit-Yan Yeung

Online Surgical Phase Recognition (SPR) models can reach high frame-wise accuracy, yet their predictions often lack temporal stability, fragmenting workflow understanding and reducing the reliability of downstream assistance. We show that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yang Liu , Ning Zhu , Jingjing Peng , Xiwu Chen , Alejandro Granados , Guotai Wang , Sebastien Ourselin

Task embeddings in multi-layer perceptrons for multi-task learning and inductive transfer learning in renewable power forecasts have recently been introduced. In many cases, this approach improves the forecast error and reduces the required…

Machine Learning · Computer Science 2022-05-02 Jens Schreiber , Stephan Vogt , Bernhard Sick

Spatio-temporal problems exist in many areas of knowledge and disciplines ranging from biology to engineering and physics. However, solution strategies based on classical statistical techniques often fall short due to the large number of…

Applications · Statistics 2017-06-15 Emil B. Iversen , Rune Juhl , Jan K. Møller , Jan Kleissl , Henrik Madsen , Juan M. Morales

Time-evolving traffic flow forecasting are playing a vital role in intelligent transportation systems and smart cities. However, the dynamic traffic flow forecasting is a highly nonlinear problem with complex temporal-spatial dependencies.…

Machine Learning · Computer Science 2025-08-05 Zhenan Lin , Yuni Lai , Wai Lun Lo , Richard Tai-Chiu Hsung , Harris Sik-Ho Tsang , Xiaoyu Xue , Kai Zhou , Yulin Zhu

Spatio-Temporal Scene Graphs (STSGs) provide a concise and expressive representation of dynamic scenes by modeling objects and their evolving relationships over time. However, real-world visual relationships often exhibit a long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Rohith Peddi , Saurabh , Ayush Abhay Shrivastava , Parag Singla , Vibhav Gogate

How can neural networks be trained on large-volume temporal data efficiently? To compute the gradients required to update parameters, backpropagation blocks computations until the forward and backward passes are completed. For temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Mateusz Malinowski , Dimitrios Vytiniotis , Grzegorz Swirszcz , Viorica Patraucean , Joao Carreira