English
Related papers

Related papers: Capturing Complex Spatial-Temporal Dependencies in…

200 papers

Traffic prediction has been an active research topic in the domain of spatial-temporal data mining. Accurate real-time traffic prediction is essential to improve the safety, stability, and versatility of smart city systems, i.e., traffic…

Machine Learning · Computer Science 2024-06-19 Xunlian Luo , Chunjiang Zhu , Detian Zhang , Qing Li

Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Royden Wagner , Ömer Sahin Tas , Marlon Steiner , Fabian Konstantinidis , Hendrik Königshof , Marvin Klemp , Carlos Fernandez , Christoph Stiller

Street scene change detection continues to capture researchers' interests in the computer vision community. It aims to identify the changed regions of the paired street-view images captured at different times. The state-of-the-art network…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Shuo Chen , Kailun Yang , Rainer Stiefelhagen

Traffic forecasting in Intelligent Transportation Systems (ITS) is vital for intelligent traffic prediction. Yet, ITS often relies on data from traffic sensors or vehicle devices, where certain cities might not have all those smart devices…

Machine Learning · Computer Science 2024-10-22 Kishor Kumar Bhaumik , Minha Kim , Fahim Faisal Niloy , Amin Ahsan Ali , Simon S. Woo

This paper proposes a variational self-attention model (VSAM) that employs variational inference to derive self-attention. We model the self-attention vector as random variables by imposing a probabilistic distribution. The self-attention…

Computation and Language · Computer Science 2020-03-11 Qiang Zhang , Shangsong Liang , Emine Yilmaz

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Graph-based spatio-temporal neural networks are effective to model the spatial dependency among discrete points sampled irregularly from unstructured grids, thanks to the great expressiveness of graph neural networks. However, these models…

Machine Learning · Computer Science 2022-04-22 Haitao Lin , Guojiang Zhao , Lirong Wu , Stan Z. Li

In this paper, we propose an ETA model (Estimated Time of Arrival) that leverages an attention mechanism over historical road speed patterns. As autonomous driving and intelligent transportation systems become increasingly prevalent, the…

Machine Learning · Computer Science 2026-01-21 ByeoungDo Kim , JunYeop Na , Kyungwook Tak , JunTae Kim , DongHyeon Kim , Duckky Kim

Self-attention is a method of encoding sequences of vectors by relating these vectors to each-other based on pairwise similarities. These models have recently shown promising results for modeling discrete sequences, but they are non-trivial…

Computation and Language · Computer Science 2018-06-19 Matthias Sperber , Jan Niehues , Graham Neubig , Sebastian Stüker , Alex Waibel

We suggest a mechanism based on spike time dependent plasticity (STDP) of synapses to store, retrieve and predict temporal sequences. The mechanism is demonstrated in a model system of simplified integrate-and-fire type neurons densely…

Adaptation and Self-Organizing Systems · Physics 2009-11-07 Thomas Nowotny , Misha I. Rabinovich , Henry D. I. Abarbanel

Spatio-temporal forecasting is critical in applications such as traffic prediction, energy demand modeling, and weather monitoring. While Graph Attention Networks (GATs) are popular for modeling spatial dependencies, they rely on predefined…

Machine Learning · Computer Science 2025-06-03 Sai Vamsi Alisetti , Vikas Kalagi , Sanjukta Krishnagopal

Correlated time series analysis plays an important role in many real-world industries. Learning an efficient representation of this large-scale data for further downstream tasks is necessary but challenging. In this paper, we propose a…

Machine Learning · Computer Science 2023-06-21 Luxuan Wang , Lei Bai , Ziyue Li , Rui Zhao , Fugee Tsung

Considerable research efforts have been devoted to the development of motion planning algorithms, which form a cornerstone of the autonomous driving system (ADS). Nonetheless, acquiring an interactive and secure trajectory for the ADS…

Robotics · Computer Science 2024-02-19 Yingbing Chen , Jie Cheng , Lu Gan , Sheng Wang , Hongji Liu , Xiaodong Mei , Ming Liu

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Accurately estimating time of arrival (ETA) for trucks is crucial for optimizing transportation efficiency in logistics. GPS trajectory data offers valuable information for ETA, but challenges arise due to temporal sparsity, variable…

Artificial Intelligence · Computer Science 2024-12-03 Mengran Li , Junzhou Chen , Guanying Jiang , Fuliang Li , Ronghui Zhang , Siyuan Gong , Zhihan Lv

Network traffic forecasting plays a crucial role in intelligent network operations, but existing techniques often perform poorly when faced with limited data. Additionally, multi-task learning methods struggle with task imbalance and…

Machine Learning · Computer Science 2026-01-30 Hui Ma , Qingzhong Li , Jin Wang , Jie Wu , Shaoyu Dou , Li Feng , Xinjun Pei

Accuracy and timeliness are indeed often conflicting goals in prediction tasks. Premature predictions may yield a higher rate of false alarms, whereas delaying predictions to gather more information can render them too late to be useful. In…

Machine Learning · Computer Science 2024-06-19 Wei Shao , Yufan Kang , Ziyan Peng , Xiao Xiao , Lei Wang , Yuhui Yang , Flora D Salim

Finding sustainable and novel solutions to predict city-wide mobility behaviour is an ever-growing problem given increased urban complexity and growing populations. This paper seeks to address this by describing a traffic frame prediction…

Machine Learning · Computer Science 2020-12-01 Jay Santokhi , Pankaj Daga , Joned Sarwar , Anna Jordan , Emil Hewage

With the acceleration of urbanization, traffic forecasting has become an essential role in smart city construction. In the context of spatio-temporal prediction, the key lies in how to model the dependencies of sensors. However, existing…

Artificial Intelligence · Computer Science 2023-09-21 Qian Ma , Zijian Zhang , Xiangyu Zhao , Haoliang Li , Hongwei Zhao , Yiqi Wang , Zitao Liu , Wanyu Wang

Traffic prediction is a cornerstone of modern intelligent transportation systems and a critical task in spatio-temporal forecasting. Although advanced Spatio-temporal Graph Neural Networks (STGNNs) and pre-trained models have achieved…

Machine Learning · Computer Science 2026-01-01 Weilin Ruan , Xilin Dang , Ziyu Zhou , Sisuo Lyu , Yuxuan Liang