English
Related papers

Related papers: Exploring Reliable Spatiotemporal Dependencies for…

200 papers

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang

With the advent of Transformer-based one-stream trackers that possess strong capability in inter-frame relation modeling, recent research has increasingly focused on how to introduce spatio-temporal context. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wenrui Cai , Zhenyi Lu , Yuzhe Li , Yongchao Feng , Jinqing Zhang , Qingjie Liu , Yunhong Wang

The recent advancements in transformer-based visual trackers have led to significant progress, attributed to their strong modeling capabilities. However, as performance improves, running latency correspondingly increases, presenting a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Qingmao Wei , Bi Zeng , Jianqi Liu , Li He , Guotian Zeng

We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Eslam Mohamed , Ahmad El-Sallab

Multi-object tracking (MOT) in computer vision remains a significant challenge, requiring precise localization and continuous tracking of multiple objects in video sequences. The emergence of data sets that emphasize robust…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Thuc Nguyen-Quang , Minh-Triet Tran

The success of visual tracking has been largely driven by datasets with manual box annotations. However, these box annotations require tremendous human effort, limiting the scale and diversity of existing tracking datasets. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Yaozong Zheng , Bineng Zhong , Qihua Liang , Ning Li , Shuxiang Song

As an important and challenging problem in computer vision and graphics, keypoint-based object tracking is typically formulated in a spatio-temporal statistical learning framework. However, most existing keypoint trackers are incapable of…

Computer Vision and Pattern Recognition · Computer Science 2014-12-05 Liming Zhao , Xi Li , Jun Xiao , Fei Wu , Yueting Zhuang

Traffic prediction has drawn increasing attention in AI research field due to the increasing availability of large-scale traffic data and its importance in the real world. For example, an accurate taxi demand prediction can assist taxi…

Machine Learning · Computer Science 2018-11-06 Huaxiu Yao , Xianfeng Tang , Hua Wei , Guanjie Zheng , Zhenhui Li

The integration of image and event streams offers a promising approach for achieving robust visual object tracking in complex environments. However, current fusion methods achieve high performance at the cost of significant computational…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jingjun Yang , Liangwei Fan , Jinpu Zhang , Xiangkai Lian , Hui Shen , Dewen Hu

How to effectively exploit spatio-temporal information is crucial to capture target appearance changes in visual tracking. However, most deep learning-based trackers mainly focus on designing a complicated appearance model or template…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Liangtao Shi , Bineng Zhong , Qihua Liang , Ning Li , Shengping Zhang , Xianxian Li

We introduce Spatial-Temporal Memory Networks for video object detection. At its core, a novel Spatial-Temporal Memory module (STMM) serves as the recurrent computation unit to model long-term temporal appearance and motion dynamics. The…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Fanyi Xiao , Yong Jae Lee

Recently, several studies have shown that utilizing contextual information to perceive target states is crucial for object tracking. They typically capture context by incorporating multiple video frames. However, these naive frame-context…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Chenlong Xu , Bineng Zhong , Qihua Liang , Yaozong Zheng , Guorong Li , Shuxiang Song

In IoT based distributed network of cameras, real-time multi-camera video analytics is challenged by high bandwidth demands and redundant visual data, creating a fundamental tension where reducing data saves network overhead but can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Ragini Gupta , Lingzhi Zhao , Jiaxi Li , Volodymyr Vakhniuk , Claudiu Danilov , Josh Eckhardt , Keyshla Bernard , Klara Nahrstedt

Dynamic scene graph generation aims at generating a scene graph of the given video. Compared to the task of scene graph generation from images, it is more challenging because of the dynamic relationships between objects and the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuren Cong , Wentong Liao , Hanno Ackermann , Bodo Rosenhahn , Michael Ying Yang

Mainstream visual object tracking frameworks predominantly rely on template matching paradigms. Their performance heavily depends on the quality of template features, which becomes increasingly challenging to maintain in complex scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Meng Zhou , Jiadong Xie , Mingsheng Xu

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren

Temporal human action detection aims to identify and localize action segments within untrimmed videos, serving as a pivotal task in video understanding. Despite the progress achieved by prior architectures like CNN and Transformer models,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yicheng Qiu , Keiji Yanai

Video transformers have achieved impressive results on major video recognition benchmarks, which however suffer from high computational cost. In this paper, we present STTS, a token selection framework that dynamically selects a few…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Junke Wang , Xitong Yang , Hengduo Li , Li Liu , Zuxuan Wu , Yu-Gang Jiang

With efficient appearance learning models, Discriminative Correlation Filter (DCF) has been proven to be very successful in recent video object tracking benchmarks and competitions. However, the existing DCF paradigm suffers from two major…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Tianyang Xu , Zhen-Hua Feng , Xiao-Jun Wu , Josef Kittler

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo