English
Related papers

Related papers: STDCformer: A Transformer-Based Model with a Spati…

200 papers

Spatiotemporal data is ubiquitous, and forecasting it has important applications in many domains. However, its complex cross-component dependencies and non-linear temporal dynamics can be challenging for traditional techniques. Existing…

Machine Learning · Computer Science 2025-03-27 Hao Yuan Bai , Xue Liu

Episodic memory plays a crucial role in various cognitive processes, such as the ability to mentally recall past events. While cognitive science emphasizes the significance of spatial context in the formation and retrieval of episodic…

Machine Learning · Computer Science 2024-03-04 Junmo Cho , Jaesik Yoon , Sungjin Ahn

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this…

Machine Learning · Computer Science 2026-02-16 Xingyu Zhang , Hanyun Du , Zeen Song , Siyu Zhao , Changwen Zheng , Wenwen Qiang

We present a conformal prediction method for time series using the Transformer architecture to capture long-memory and long-range dependencies. Specifically, we use the Transformer decoder as a conditional quantile estimator to predict the…

Machine Learning · Computer Science 2024-06-11 Junghwan Lee , Chen Xu , Yao Xie

Multivariate spatio-temporal data arise more and more frequently in a wide range of applications; however, there are relatively few general statistical methods that can readily use that incorporate spatial, temporal and variable…

Methodology · Statistics 2017-11-15 Elynn Yi Chen , Qiwei Yao , Rong Chen

Accurate prediction of driving intention is key to enhancing the safety and interactive efficiency of human-machine co-driving systems. It serves as a cornerstone for achieving high-level autonomous driving. However, current approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Sirui Wang , Zhou Guan , Bingxi Zhao , Tongjia Gu , Jie Liu

Traffic crashes profoundly impede traffic efficiency and pose economic challenges. Accurate prediction of post-crash traffic status provides essential information for evaluating traffic perturbations and developing effective solutions.…

Machine Learning · Computer Science 2024-07-22 Shuang Li , Ziyuan Pu , Nan Zhang , Duxin Chen , Lu Dong , Daniel J. Graham , Yinhai Wang

In this work, we propose a novel paradigm to encode the position of targets for target tracking in videos using transformers. The proposed paradigm, Dense Spatio-Temporal (DST) position encoding, encodes spatio-temporal position information…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jinkun Cao , Hao Wu , Kris Kitani

Individual trajectories, rich in human-environment interaction information across space and time, serve as vital inputs for geospatial foundation models (GeoFMs). However, existing attempts at learning trajectory representations have…

Machine Learning · Computer Science 2025-05-13 Fei Huang , Jianrong Lv , Yang Yue

In this work, we present a generalized formulation of the Transformer algorithm by reinterpreting its core mechanisms within the framework of Path Integral formalism. In this perspective, the attention mechanism is recast as a process that…

High Energy Physics - Phenomenology · Physics 2025-05-02 Won-Gi Paeng , Daesuk Kwon , Kyungwon Jeong , Honggyo Suh

Spatio-temporal epidemic forecasting is critical for public health management, yet existing methods often struggle with insensitivity to weak epidemic signals, over-simplified spatial relations, and unstable parameter estimation. To address…

Machine Learning · Computer Science 2026-05-22 Sijie Ruan , Jinyu Li , Jia Wei , Zenghao Xu , Jie Bao , Junshi Xu , Junyang Qiu , Shuliang Wang , Xiaoxiao Wang , Hanning Yuan

EEG-based emotion recognition plays an important role in developing adaptive brain-computer communication systems, yet faces two fundamental challenges in practical implementations: (1) effective integration of non-stationary…

Machine Learning · Computer Science 2025-08-20 Xuetao Lin , Tianhao Peng , Peihong Dai , Yu Liang , Wenjun Wu

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Incorporating the dynamics knowledge into the model is critical for achieving accurate trajectory prediction while considering the spatial and temporal characteristics of the vessel. However, existing methods rarely consider the underlying…

Machine Learning · Computer Science 2023-03-22 Huimin Qiang , Zhiyuan Guo , Shiyuan Xie , Xiaodong Peng

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lina Achaji , Julien Moreau , François Aioun , François Charpillet

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

In the era of information explosion, spatio-temporal data mining serves as a critical part of urban management. Considering the various fields demanding attention, e.g., traffic state, human activity, and social event, predicting multiple…

Artificial Intelligence · Computer Science 2023-09-19 Zijian Zhang , Xiangyu Zhao , Qidong Liu , Chunxu Zhang , Qian Ma , Wanyu Wang , Hongwei Zhao , Yiqi Wang , Zitao Liu

Estimating counterfactual outcomes over time from observational data is relevant for many applications (e.g., personalized medicine). Yet, state-of-the-art methods build upon simple long short-term memory (LSTM) networks, thus rendering…

Machine Learning · Computer Science 2022-06-06 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

What sets timeseries analysis apart from other machine learning exercises is that time representation becomes a primary aspect of the experiment setup, as it must adequately represent the temporal relations that are relevant for the…

Machine Learning · Computer Science 2024-11-20 Natalia Koliou , Tatiana Boura , Stasinos Konstantopoulos , George Meramveliotakis , George Kosmadakis

System identification in scenarios where the observed number of variables is less than the degrees of freedom in the dynamics is an important challenge. In this work we tackle this problem by using a recognition network to increase the…

Computational Physics · Physics 2020-10-14 Constantino A. Garcia , Paulo Felix , Jesus M. Presedo , Abraham Otero