English
Related papers

Related papers: Multi-modal Spatio-Temporal Transformer for High-r…

200 papers

Within the field of complicated multivariate time series forecasting (TSF), popular techniques frequently rely on intricate deep learning architectures, ranging from transformer-based designs to recurrent neural networks. However, recent…

Machine Learning · Computer Science 2023-12-25 Aiyinsi Zuo , Haixi Zhang , Zirui Li , Ce Zheng

Spatio-Temporal prediction plays a critical role in smart city construction. Jointly modeling multiple spatio-temporal tasks can further promote an intelligent city life by integrating their inseparable relationship. However, existing…

Machine Learning · Computer Science 2023-04-20 Zijian Zhang , Xiangyu Zhao , Hao Miao , Chunxu Zhang , Hongwei Zhao , Junbo Zhang

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and…

Robotics · Computer Science 2024-12-19 Chandra Raskoti , Weizi Li

Land Surface Temperature (LST) plays a key role in climate monitoring, urban heat assessment, and land-atmosphere interactions. However, current thermal infrared satellite sensors cannot simultaneously achieve high spatial and temporal…

Machine Learning · Computer Science 2025-12-24 Sofiane Bouaziz , Adel Hafiane , Raphael Canals , Rachid Nedjai

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models…

Machine Learning · Computer Science 2026-04-16 Xinjin Li , Jinghan Cao , Mengyue Wang , Yue Wu , Longxiang Yan , Yeyang Zhou , Ziqi Sha , Yu Ma

Previous methods for dynamic facial expression in the wild are mainly based on Convolutional Neural Networks (CNNs), whose local operations ignore the long-range dependencies in videos. To solve this problem, we propose the spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Fuyan Ma , Bin Sun , Shutao Li

Learned video compression (LVC) has witnessed remarkable advancements in recent years. Similar as the traditional video coding, LVC inherits motion estimation/compensation, residual coding and other modules, all of which are implemented…

Image and Video Processing · Electrical Eng. & Systems 2023-09-22 Yanbo Gao , Wenjia Huang , Shuai Li , Hui Yuan , Mao Ye , Siwei Ma

Accurate intraday solar irradiance forecasting is crucial for optimizing dispatch planning and electricity trading. For this purpose, we introduce a novel and effective approach that includes three distinguishing components from the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yanan Niu , Roy Sarkis , Demetri Psaltis , Mario Paolone , Christophe Moser , Luisa Lambertini

Spatio-temporal (ST) data, which represent multiple time series data corresponding to different spatial locations, are ubiquitous in real-world dynamic systems, such as air quality readings. Forecasting over ST data is of great importance…

Machine Learning · Computer Science 2018-10-01 Zheyi Pan , Yuxuan Liang , Junbo Zhang , Xiuwen Yi , Yong Yu , Yu Zheng

Long-term forecasting of multivariate urban data poses a significant challenge due to the complex spatiotemporal dependencies inherent in such datasets. This paper presents DST, a novel multivariate time-series forecasting model that…

Machine Learning · Computer Science 2025-08-28 Amirhossein Sohrabbeig , Omid Ardakanian , Petr Musilek

The precise prediction of human mobility has produced significant socioeconomic impacts, such as location recommendations and evacuation suggestions. However, existing methods suffer from limited generalization capability: unimodal…

Artificial Intelligence · Computer Science 2025-12-30 Junshu Dai , Yu Wang , Tongya Zheng , Wei Ji , Qinghong Guo , Ji Cao , Jie Song , Canghong Jin , Mingli Song

Multivariate spatio-temporal data arise more and more frequently in a wide range of applications; however, there are relatively few general statistical methods that can readily use that incorporate spatial, temporal and variable…

Methodology · Statistics 2017-11-15 Elynn Yi Chen , Qiwei Yao , Rong Chen

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Current forecasting approaches are largely unimodal and ignore the rich textual data that often accompany the time series due to lack of well-curated multimodal benchmark dataset. In this work, we develop TimeText Corpus (TTC), a carefully…

Artificial Intelligence · Computer Science 2024-11-22 Kai Kim , Howard Tsai , Rajat Sen , Abhimanyu Das , Zihao Zhou , Abhishek Tanpure , Mathew Luo , Rose Yu

Spatio-temporal traffic forecasting is a core component of intelligent transportation systems, supporting various downstream tasks such as signal control and network-level traffic management. In real-world deployments, forecasting models…

Machine Learning · Computer Science 2026-02-17 Yue Wang , Areg Karapetyan , Djellel Difallah , Samer Madanat

Glaucoma is one of the major eye diseases that leads to progressive optic nerve fiber damage and irreversible blindness, afflicting millions of individuals. Glaucoma forecast is a good solution to early screening and intervention of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Xikai Yang , Jian Wu , Xi Wang , Yuchen Yuan , Ning Li Wang , Pheng-Ann Heng

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

Multimodal change detection (MMCD) identifies changed areas in multimodal remote sensing (RS) data, demonstrating significant application value in land use monitoring, disaster assessment, and urban sustainable development. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Xuanguang Liu , Lei Ding , Yujie Li , Chenguang Dai , Zhenchao Zhang , Mengmeng Li , Ziyi Yang , Yifan Sun , Yongqi Sun , Hanyun Wang