English
Related papers

Related papers: TrTr: Visual Tracking with Transformer

200 papers

This study proposes an improved end-to-end multi-target tracking algorithm that adapts to multi-view multi-scale scenes based on the self-attentive mechanism of the transformer's encoder-decoder structure. A multi-dimensional feature…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Yong Hong , Deren Li , Shupei Luo , Xin Chen , Yi Yang , Mi Wang

This work proposes an attention-based sequence-to-sequence model for handwritten word recognition and explores transfer learning for data-efficient training of HTR systems. To overcome training data scarcity, this work leverages models…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Dmitrijs Kass , Ekta Vats

Evaluating lesion progression and treatment response via longitudinal lesion tracking plays a critical role in clinical practice. Automated approaches for this task are motivated by prohibitive labor costs and time consumption when lesion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Wen Tang , Han Kang , Haoyue Zhang , Pengxin Yu , Corey W. Arnold , Rongguo Zhang

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zikai Song , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

In this work, we propose TransTrack, a simple but efficient scheme to solve the multiple object tracking problems. TransTrack leverages the transformer architecture, which is an attention-based query-key mechanism. It applies object…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Peize Sun , Jinkun Cao , Yi Jiang , Rufeng Zhang , Enze Xie , Zehuan Yuan , Changhu Wang , Ping Luo

Existing Transformer-based RGBT trackers achieve remarkable performance benefits by leveraging self-attention to extract uni-modal features and cross-attention to enhance multi-modal feature interaction and template-search correlation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Yun Xiao , Jiacong Zhao , Andong Lu , Chenglong Li , Yin Lin , Bing Yin , Cong Liu

Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yubo Cui , Zheng Fang , Jiayao Shan , Zuoxu Gu , Sifan Zhou

Template-matching methods for visual tracking have gained popularity recently due to their good performance and fast speed. However, they lack effective ways to adapt to changes in the target object's appearance, making their tracking…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Tianyu Yang , Antoni B. Chan

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

We present a novel usage of Transformers to make image classification interpretable. Unlike mainstream classifiers that wait until the last fully connected layer to incorporate class information to make predictions, we investigate a…

Transformers have proven superior performance for a wide variety of tasks since they were introduced. In recent years, they have drawn attention from the vision community in tasks such as image classification and object detection. Despite…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Yihong Xu , Yutong Ban , Guillaume Delorme , Chuang Gan , Daniela Rus , Xavier Alameda-Pineda

Robust object tracking requires knowledge of tracked objects' appearance, motion and their evolution over time. Although motion provides distinctive and complementary information especially for fast moving objects, most of the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Hasan Saribas , Hakan Cevikalp , Okan Köpüklü , Bedirhan Uzun

Understanding trajectory diversity is a fundamental aspect of addressing practical traffic tasks. However, capturing the diversity of trajectories presents challenges, particularly with traditional machine learning and recurrent neural…

Artificial Intelligence · Computer Science 2023-12-04 Ruyi Feng , Zhibin Li , Bowen Liu , Yan Ding

Boosting performance of the offline trained siamese trackers is getting harder nowadays since the fixed information of the template cropped from the first frame has been almost thoroughly mined, but they are poorly capable of resisting…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Zhihong Fu , Qingjie Liu , Zehua Fu , Yunhong Wang

Robustness and discrimination power are two fundamental requirements in visual object tracking. In most tracking paradigms, we find that the features extracted by the popular Siamese-like networks cannot fully discriminatively model the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Fei Xie , Chunyu Wang , Guangting Wang , Yue Cao , Wankou Yang , Wenjun Zeng

Existing deep trackers mainly use convolutional neural networks pre-trained for generic object recognition task for representations. Despite demonstrated successes for numerous vision tasks, the contributions of using pre-trained deep…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Xin Li , Chao Ma , Baoyuan Wu , Zhenyu He , Ming-Hsuan Yang

Transformer-based multi-object tracking (MOT) methods have captured the attention of many researchers in recent years. However, these models often suffer from slow inference speeds due to their structure or other issues. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Wenhui Zhao , Dingwen Zhang

Visual place recognition is a challenging task for applications such as autonomous driving navigation and mobile robot localization. Distracting elements presenting in complex scenes often lead to deviations in the perception of visual…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ruotong Wang , Yanqing Shen , Weiliang Zuo , Sanping Zhou , Nanning Zheng

Developing robust and discriminative appearance models has been a long-standing research challenge in visual object tracking. In the prevalent Siamese-based paradigm, the features extracted by the Siamese-like networks are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Fei Xie , Wankou Yang , Chunyu Wang , Lei Chu , Yue Cao , Chao Ma , Wenjun Zeng

We propose a light-weight and highly efficient Joint Detection and Tracking pipeline for the task of Multi-Object Tracking using a fully-transformer architecture. It is a modified version of TransTrack, which overcomes the computational…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Siddharth Sagar Nijhawan , Leo Hoshikawa , Atsushi Irie , Masakazu Yoshimura , Junji Otsuka , Takeshi Ohashi