English
Related papers

Related papers: Transformer Meets Tracker: Exploiting Temporal Con…

200 papers

Recent years have witnessed a trend of applying context frames to boost the performance of object detection as video object detection. Existing methods usually aggregate features at one stroke to enhance the feature. These methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Han Wang , Jun Tang , Xiaodong Liu , Shanyan Guan , Rong Xie , Li Song

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been proven that an architecture with only attention-mechanisms…

Machine Learning · Computer Science 2021-08-19 Radostin Cholakov , Todor Kolev

In this thesis, we propose a pioneering work on sparse keypoints tracking across images using transformer networks. While deep learning-based keypoints matching have been widely investigated using graph neural networks - and more recently…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Oleksii Nasypanyi , Francois Rameau

In recent years, the trackers based on Siamese networks have emerged as highly effective and efficient for visual object tracking (VOT). While these methods were shown to be vulnerable to adversarial attacks, as most deep networks for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Krishna Kanth Nakka , Mathieu Salzmann

Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the search region.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xin Chen , Bin Yan , Jiawen Zhu , Dong Wang , Xiaoyun Yang , Huchuan Lu

The recent trend in multiple object tracking (MOT) is heading towards leveraging deep learning to boost the tracking performance. In this paper, we propose a novel solution named TransSTAM, which leverages Transformer to effectively model…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Peng Dai , Yiqiang Feng , Renliang Weng , Changshui Zhang

Most existing transformer based video instance segmentation methods extract per frame features independently, hence it is challenging to solve the appearance deformation problem. In this paper, we observe the temporal information is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Zhenghao Zhang , Fangtao Shao , Zuozhuo Dai , Siyu Zhu

Visual tracking has made significant improvements in the past few decades. Most existing state-of-the-art trackers 1) merely aim for performance in ideal conditions while overlooking the real-world conditions; 2) adopt the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ziang Cao , Ziyuan Huang , Liang Pan , Shiwei Zhang , Ziwei Liu , Changhong Fu

Visual object tracking is an important function in many real-time video surveillance applications, such as localization and spatio-temporal recognition of persons. In real-world applications, an object detector and tracker must interact on…

Computer Vision and Pattern Recognition · Computer Science 2019-11-01 Madhu Kiran , Vivek Tiwari , Le Thanh Nguyen-Meidine , Eric Granger

In the realm of unmanned aerial vehicle (UAV) tracking, Siamese-based approaches have gained traction due to their optimal balance between efficiency and precision. However, UAV scenarios often present challenges such as insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Xiaoying Yuan , Tingfa Xu , Xincong Liu , Ying Wang , Haolin Qin , Yuqiang Fang , Jianan Li

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Similarity matching is a core operation in Siamese trackers. Most Siamese trackers carry out similarity learning via cross correlation that originates from the image matching field. However, unlike 2-D image matching, the matching network…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Jinpu Zhang , Yuehuan Wang

The strong demand of autonomous driving in the industry has lead to strong interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Zhenxun Yuan , Xiao Song , Lei Bai , Wengang Zhou , Zhe Wang , Wanli Ouyang

In this paper, we consider the problem of long-term point tracking, which requires consistent identification of points across multiple frames in a video, despite changes in appearance, lighting, perspective, and occlusions. We target online…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Görkay Aydemir , Xiongyi Cai , Weidi Xie , Fatma Güney

We present a novel transformer-based architecture for global multi-object tracking. Our network takes a short sequence of frames as input and produces global trajectories for all objects. The core component is a global tracking transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xingyi Zhou , Tianwei Yin , Vladlen Koltun , Philipp Krähenbühl

Most deep trackers still follow the guidance of the siamese paradigms and use a template that contains only the target without any contextual information, which makes it difficult for the tracker to cope with large appearance changes, rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Kaijie He , Canlong Zhang , Sheng Xie , Zhixin Li , Zhiwen Wang

We consider the problem of localizing a spatio-temporal tube in a video corresponding to a given text query. This is a challenging task that requires the joint and efficient modeling of temporal, spatial and multi-modal interactions. To…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid

Understanding temporal dynamics of video is an essential aspect of learning better video representations. Recently, transformer-based architectural designs have been extensively explored for video tasks due to their capability to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Jaehyung Kim , Dongyoon Han , Hwanjun Song , Jung-Woo Ha , Jinwoo Shin

Accurate detection and tracking of objects is vital for effective video understanding. In previous work, the two tasks have been combined in a way that tracking is based heavily on detection, but the detection benefits marginally from the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Zheng Zhang , Dazhi Cheng , Xizhou Zhu , Stephen Lin , Jifeng Dai

Siamese network based trackers formulate tracking as convolutional feature cross-correlation between target template and searching region. However, Siamese trackers still have accuracy gap compared with state-of-the-art algorithms and they…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Bo Li , Wei Wu , Qiang Wang , Fangyi Zhang , Junliang Xing , Junjie Yan