English
Related papers

Related papers: STeInFormer: Spatial-Temporal Interaction Transfor…

200 papers

Spatiotemporal and motion features are two complementary and crucial information for video action recognition. Recent state-of-the-art methods adopt a 3D CNN stream to learn spatiotemporal features and another flow stream to learn motion…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Boyuan Jiang , Mengmeng Wang , Weihao Gan , Wei Wu , Junjie Yan

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim

Effective and Efficient spatio-temporal modeling is essential for action recognition. Existing methods suffer from the trade-off between model performance and model complexity. In this paper, we present a novel Spatio-Temporal Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Xu Li , Jingwen Wang , Lin Ma , Kaihao Zhang , Fengzong Lian , Zhanhui Kang , Jinjun Wang

Most existing transformer based video instance segmentation methods extract per frame features independently, hence it is challenging to solve the appearance deformation problem. In this paper, we observe the temporal information is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Zhenghao Zhang , Fangtao Shao , Zuozhuo Dai , Siyu Zhu

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Despite great progress achieved by transformer in various vision tasks, it is still underexplored for skeleton-based action recognition with only a few attempts. Besides, these methods directly calculate the pair-wise global self-attention…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Zhimin Gao , Peitao Wang , Pei Lv , Xiaoheng Jiang , Qidong Liu , Pichao Wang , Mingliang Xu , Wanqing Li

The fully convolutional network (FCN) with an encoder-decoder architecture has been the standard paradigm for semantic segmentation. The encoder-decoder architecture utilizes an encoder to capture multilevel feature maps, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Libo Wang , Rui Li , Chenxi Duan , Ce Zhang , Xiaoliang Meng , Shenghui Fang

Modern remote sensing image change detection has witnessed substantial advancements by harnessing the potent feature extraction capabilities of CNNs and Transforms.Yet,prevailing change detection techniques consistently prioritize…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Chenglong Liu

Understanding user intent is essential for situational and context-aware decision-making. Motivated by a real-world scenario, this work addresses intent predictions of smart device users in the vicinity of vehicles by modeling sequential…

Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background. Nevertheless, an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Chiara Plizzari , Marco Cannici , Matteo Matteucci

Capturing the dependencies between joints is critical in skeleton-based action recognition task. Transformer shows great potential to model the correlation of important joints. However, the existing Transformer-based methods cannot capture…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Helei Qiu , Biao Hou , Bo Ren , Xiaohua Zhang

Change detection in remote sensing imagery is essential for a variety of applications such as urban planning, disaster management, and climate research. However, existing methods for identifying semantically changed areas overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Maximilian Bernhard , Niklas Strauß , Matthias Schubert

A target recognition framework relying on near-field integrated sensing and communication (ISAC) systems is proposed. By exploiting the distance-dependent spatial signatures provided by the near-field spherical wavefront, high-accuracy…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Zongyao Zhao , Zhaolin Wang , Lincong Han , Jing Jin , Kaibin Huang

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Detecting breast lesion in videos is crucial for computer-aided diagnosis. Existing video-based breast lesion detection approaches typically perform temporal feature aggregation of deep backbone features based on the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chao Qin , Jiale Cao , Huazhu Fu , Rao Muhammad Anwer , Fahad Shahbaz Khan

Accurate spatio-temporal prediction is crucial for the sustainable development of smart cities. However, current approaches often struggle to capture important spatio-temporal relationships, particularly overlooking global relations among…

Machine Learning · Computer Science 2024-11-12 Ashutosh Sao , Simon Gottschalk

Change detection in remote sensing imagery is a critical technique for Earth observation, primarily focusing on pixel-level segmentation of change regions between bi-temporal images. The essence of pixel-level change detection lies in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Sijun Dong , Fangcheng Zuo , Geng Chen , Siming Fu , Xiaoliang Meng

Change detection (CD) in remote sensing aims to identify semantic differences between satellite images captured at different times. While deep learning has significantly advanced this field, existing approaches based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Durgesh Ameta , Ujjwal Mishra , Praful Hambarde , Amit Shukla

Change detection, which aims to distinguish surface changes based on bi-temporal images, plays a vital role in ecological protection and urban planning. Since high resolution (HR) images cannot be typically acquired continuously over time,…

Image and Video Processing · Electrical Eng. & Systems 2021-06-24 Mengxi Liu , Qian Shi , Andrea Marinoni , Da He , Xiaoping Liu , Liangpei Zhang