English
Related papers

Related papers: Continuous Spatiotemporal Transformers

200 papers

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

Object-centric slot attention is an emerging paradigm for unsupervised learning of structured, interpretable object-centric representations (slots). This enables effective reasoning about objects and events at a low computational cost and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Guiqiu Liao , Matjaz Jogan , Marcel Hussing , Edward Zhang , Eric Eaton , Daniel A. Hashimoto

Spatiotemporal dynamics models are fundamental for various domains, from heat propagation in materials to oceanic and atmospheric flows. However, currently available neural network-based spatiotemporal modeling approaches fall short when…

Machine Learning · Computer Science 2025-02-11 Valerii Iakovlev , Harri Lähdesmäki

Spatio-temporal (ST) data, which represent multiple time series data corresponding to different spatial locations, are ubiquitous in real-world dynamic systems, such as air quality readings. Forecasting over ST data is of great importance…

Machine Learning · Computer Science 2018-10-01 Zheyi Pan , Yuxuan Liang , Junbo Zhang , Xiuwen Yi , Yong Yu , Yu Zheng

Transformers are the de-facto choice for sequence modelling, yet their quadratic self-attention and weak temporal bias can make long-range forecasting both expensive and brittle. We introduce FreezeTST, a lightweight hybrid that interleaves…

Machine Learning · Computer Science 2025-10-21 Pradeep Singh , Mehak Sharma , Anupriya Dey , Balasubramanian Raman

Multivariate time series modeling and prediction problems are abundant in many machine learning application domains. Accurate interpretation of such prediction outcomes from a machine learning model that explicitly captures temporal…

Machine Learning · Computer Science 2020-10-27 Tryambak Gangopadhyay , Sin Yong Tan , Zhanhong Jiang , Rui Meng , Soumik Sarkar

Transformers have become the dominant architecture for sequence modeling tasks such as natural language processing or audio processing, and they are now even considered for tasks that are not naturally sequential such as image…

Machine Learning · Computer Science 2024-03-05 Jorg Bornschein , Yazhe Li , Amal Rannen-Triki

Representation learning is a fundamental but challenging problem, especially when the distribution of data is unknown. We propose a new representation learning method, termed Structure Transfer Machine (STM), which enables feature learning…

Machine Learning · Computer Science 2019-08-06 Baochang Zhang , Lian Zhuo , Ze Wang , Jungong Han , Xiantong Zhen

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Multi-modality spatio-temporal (MoST) data extends spatio-temporal (ST) data by incorporating multiple modalities, which is prevalent in monitoring systems, encompassing diverse traffic demands and air quality assessments. Despite…

Machine Learning · Computer Science 2024-05-07 Jiewen Deng , Renhe Jiang , Jiaqi Zhang , Xuan Song

Persistent monitoring of a spatiotemporal fluid process requires data sampling and predictive modeling of the process being monitored. In this paper we present PASST algorithm: Predictive-model based Adaptive Sampling of a Spatio-Temporal…

Robotics · Computer Science 2023-04-04 Sandeep Manjanna , Tom Z. Jiahao , M. Ani Hsieh

Effectively modeling long spatiotemporal sequences is challenging due to the need to model complex spatial correlations and long-range temporal dependencies simultaneously. ConvLSTMs attempt to address this by updating tensor-valued states…

Machine Learning · Computer Science 2023-10-31 Jimmy T. H. Smith , Shalini De Mello , Jan Kautz , Scott W. Linderman , Wonmin Byeon

Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current…

Machine Learning · Computer Science 2025-10-07 Haotian Gao , Zheng Dong , Jiawei Yong , Shintaro Fukushima , Kenjiro Taura , Renhe Jiang

Data-driven soft sensors have been widely applied in complex industrial processes. However, the interpretable spatio-temporal features extraction by soft sensors remains a challenge. In this light, this work introduces a novel method termed…

Systems and Control · Electrical Eng. & Systems 2025-11-04 Qianchao Wang , Peng Sha , Leena Heistrene , Yuxuan Ding , Yaping Du

We present a novel probabilistic deep learning approach, the 'Stochastic Latent Transformer' (SLT), designed for the efficient reduced-order modelling of stochastic partial differential equations. Stochastically driven flow models are…

Machine Learning · Computer Science 2024-06-21 Ira J. S. Shokar , Rich R. Kerswell , Peter H. Haynes

Predicting future states of dynamic agents is a fundamental task in autonomous driving. An expressive representation for this purpose is Occupancy Flow Fields, which provide a scalable and unified format for modeling motion, spatial extent,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Peter Lengyel

EEG-based emotion recognition plays an important role in developing adaptive brain-computer communication systems, yet faces two fundamental challenges in practical implementations: (1) effective integration of non-stationary…

Machine Learning · Computer Science 2025-08-20 Xuetao Lin , Tianhao Peng , Peihong Dai , Yu Liang , Wenjun Wu

Remote sensing spatiotemporal fusion (STF) addresses the fundamental trade-off between temporal and spatial resolution by combining high temporal-low spatial and high spatial-low temporal imagery. This paper presents the first comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Enzhe Sun , Yongchuan Cui , Peng Liu , Jining Yan

Spatial-temporal graph learning has emerged as a promising solution for modeling structured spatial-temporal data and learning region representations for various urban sensing tasks such as crime forecasting and traffic flow prediction.…

Machine Learning · Computer Science 2023-06-21 Qianru Zhang , Chao Huang , Lianghao Xia , Zheng Wang , Siuming Yiu , Ruihua Han

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

Machine Learning · Computer Science 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki