English
Related papers

Related papers: Continuous Spatiotemporal Transformers

200 papers

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

Machine Learning · Computer Science 2022-02-15 Li Shen , Yangzhu Wang

Personal robots assisting humans must perform complex manipulation tasks that are typically difficult to specify in traditional motion planning pipelines, where multiple objectives must be met and the high-level context be taken into…

Robotics · Computer Science 2019-03-21 Hejia Zhang , Eric Heiden , Stefanos Nikolaidis , Joseph J. Lim , Gaurav S. Sukhatme

Accurate and reliable lane detection is vital for the safe performance of lane-keeping assistance and lane departure warning systems. However, under certain challenging circumstances, it is difficult to get satisfactory performance in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yongqi Dong , Sandeep Patil , Bart van Arem , Haneen Farah

Most recent transformer-based models show impressive performance on vision tasks, even better than Convolution Neural Networks (CNN). In this work, we present a novel, flexible, and effective transformer-based model for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ruohao Guo , Dantong Niu , Liao Qu , Zhenbo Li

In this paper, we propose Dynamic Compressive Transformer (DCT), a transformer-based framework for modeling the unbounded sequence. In contrast to the previous baselines which append every sentence representation to memory, conditionally…

Computation and Language · Computer Science 2021-10-12 Kai-Po Chang , Wei-Yun Ma

This study proposes a novel approach to ensemble prediction, called "covariate-dependent stacking" (CDST). Unlike traditional stacking and model averaging methods, CDST allows model weights to vary flexibly as a function of covariates,…

Methodology · Statistics 2025-09-29 Tomoya Wakayama , Shonosuke Sugasawa

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models…

Machine Learning · Computer Science 2026-04-16 Xinjin Li , Jinghan Cao , Mengyue Wang , Yue Wu , Longxiang Yan , Yeyang Zhou , Ziqi Sha , Yu Ma

Rapid developments in advanced sensing and imaging have significantly enhanced information visibility, opening opportunities for predictive modeling of complex dynamic systems. However, sensing signals acquired from such complex systems are…

Machine Learning · Statistics 2025-05-02 Xizhuo Zhang , Bing Yao

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Point cloud videos capture dynamic 3D motion while reducing the effects of lighting and viewpoint variations, making them highly effective for recognizing subtle and continuous human actions. Although Selective State Space Models (SSMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Peiming Li , Ziyi Wang , Yulin Yuan , Hong Liu , Xiangming Meng , Junsong Yuan , Mengyuan Liu

Temporal human action detection aims to identify and localize action segments within untrimmed videos, serving as a pivotal task in video understanding. Despite the progress achieved by prior architectures like CNN and Transformer models,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yicheng Qiu , Keiji Yanai

Spatiotemporal data analysis is pivotal across various domains, such as transportation, meteorology, and healthcare. The data collected in real-world scenarios are often incomplete due to device malfunctions and network errors.…

Machine Learning · Computer Science 2024-03-25 Yakun Chen , Kaize Shi , Zhangkai Wu , Juan Chen , Xianzhi Wang , Julian McAuley , Guandong Xu , Shui Yu

Two of the many trends in neural network research of the past few years have been (i) the learning of dynamical systems, especially with recurrent neural networks such as long short-term memory networks (LSTMs) and (ii) the introduction of…

Numerical Analysis · Mathematics 2024-11-15 Benedikt Brantner , Guillaume de Romemont , Michael Kraus , Zeyuan Li

Accurate spatiotemporal traffic forecasting is vital for intelligent resource management in 5G and beyond. However, conventional AI approaches often fail to capture the intricate spatial and temporal patterns that exist, due to e.g., the…

Machine Learning · Computer Science 2025-07-29 Khalid Ali , Zineddine Bettouche , Andreas Kassler , Andreas Fischer

Recent years have witnessed remarkable advances in spatiotemporal predictive learning, with methods incorporating auxiliary inputs, complex neural architectures, and sophisticated training strategies. While SimVP has introduced a simpler,…

Machine Learning · Computer Science 2024-12-13 Cheng Tan , Zhangyang Gao , Siyuan Li , Stan Z. Li

Among various region embedding methods, graph-based region relation learning models stand out, owing to their strong structure representation ability for encoding spatial correlations with graph neural networks. Despite their effectiveness,…

Machine Learning · Computer Science 2023-05-09 Qianru Zhang , Chao Huang , Lianghao Xia , Zheng Wang , Zhonghang Li , Siuming Yiu

Long-term satellite image time series (SITS) analysis in heterogeneous landscapes faces significant challenges, particularly in Mediterranean regions where complex spatial patterns, seasonal variations, and multi-decade environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ido Faran , Nathan S. Netanyahu , Maxim Shoshany

Video saliency prediction and detection are thriving research domains that enable computers to simulate the distribution of visual attention akin to how humans perceiving dynamic scenes. While many approaches have crafted task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Junwen Xiong , Peng Zhang , Chuanyue Li , Wei Huang , Yufei Zha , Tao You

Robust prediction of citywide traffic flows at different time periods plays a crucial role in intelligent transportation systems. While previous work has made great efforts to model spatio-temporal correlations, existing methods still…

Machine Learning · Computer Science 2024-03-07 Jiahao Ji , Jingyuan Wang , Chao Huang , Junjie Wu , Boren Xu , Zhenhe Wu , Junbo Zhang , Yu Zheng

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars
‹ Prev 1 8 9 10 Next ›