English
Related papers

Related papers: Separable Self and Mixed Attention Transformers fo…

200 papers

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to learn reinforced…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Peng Gao , Qiquan Zhang , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang

Vision Transformers has demonstrated competitive performance on computer vision tasks benefiting from their ability to capture long-range dependencies with multi-head self-attention modules and multi-layer perceptron. However, calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Xiangyu Chen , Qinghao Hu , Kaidong Li , Cuncong Zhong , Guanghui Wang

Deep learning based change detection methods have received wide attentoion, thanks to their strong capability in obtaining rich features from images. However, existing AI-based CD methods largely rely on three functionality-enhancing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Kaixuan Lu , Xiao Huang

We propose SFMNet, a novel 3D sparse detector that combines the efficiency of sparse convolutions with the ability to model long-range dependencies. While traditional sparse convolution techniques efficiently capture local structures, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Oren Shrout , Ayellet Tal

The recent advancements in transformer-based visual trackers have led to significant progress, attributed to their strong modeling capabilities. However, as performance improves, running latency correspondingly increases, presenting a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Qingmao Wei , Bi Zeng , Jianqi Liu , Li He , Guotian Zeng

Attention is a key part of the transformer architecture. It is a sequence-to-sequence mapping that transforms each sequence element into a weighted sum of values. The weights are typically obtained as the softmax of dot products between…

Object trackers deployed on low-power devices need to be light-weight, however, most of the current state-of-the-art (SOTA) methods rely on using compute-heavy backbones built using CNNs or transformers. Large sizes of such models do not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Saksham Aggarwal , Taneesh Gupta , Pawan Kumar Sahu , Arnav Chavan , Rishabh Tiwari , Dilip K. Prasad , Deepak K. Gupta

Tracking multiple objects in videos relies on modeling the spatial-temporal interactions of the objects. In this paper, we propose a solution named TransMOT, which leverages powerful graph transformers to efficiently model the spatial and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Peng Chu , Jiang Wang , Quanzeng You , Haibin Ling , Zicheng Liu

Tracking multiple particles in noisy and cluttered scenes remains challenging due to a combinatorial explosion of trajectory hypotheses, which scales super-exponentially with the number of particles and frames. The transformer architecture…

Machine Learning · Statistics 2025-06-12 Piyush Mishra , Philippe Roudot

We present a novel transformer-based architecture for global multi-object tracking. Our network takes a short sequence of frames as input and produces global trajectories for all objects. The core component is a global tracking transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xingyi Zhou , Tianwei Yin , Vladlen Koltun , Philipp Krähenbühl

Recent advances in visual tracking are based on siamese feature extractors and template matching. For this category of trackers, latest research focuses on better feature embeddings and similarity measures. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Axel Sauer , Elie Aljalbout , Sami Haddadin

The attention mechanism has been the core component in modern transformer architectures. However, the computation of standard full attention scales quadratically with the sequence length, serving as a major bottleneck in long-context…

Computation and Language · Computer Science 2026-04-28 Yusheng Zhao , Hourun Li , Bohan Wu , Yichun Yin , Lifeng Shang , Jingyang Yuan , Meng Zhang , Ming Zhang

This paper introduces SFSORT, the world's fastest multi-object tracking system based on experiments conducted on MOT Challenge datasets. To achieve an accurate and computationally efficient tracker, this paper employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 M. M. Morsali , Z. Sharifi , F. Fallah , S. Hashembeiki , H. Mohammadzade , S. Bagheri Shouraki

Vision Transformers (ViTs) have been shown to enhance visual recognition through modeling long-range dependencies with multi-head self-attention (MHSA), which is typically formulated as Query-Key-Value computation. However, the attention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chongjian Ge , Xiaohan Ding , Zhan Tong , Li Yuan , Jiangliu Wang , Yibing Song , Ping Luo

Very recently, a variety of vision transformer architectures for dense prediction tasks have been proposed and they show that the design of spatial attention is critical to their success in these tasks. In this work, we revisit the design…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Xiangxiang Chu , Zhi Tian , Yuqing Wang , Bo Zhang , Haibing Ren , Xiaolin Wei , Huaxia Xia , Chunhua Shen

The success of self-attention lies in its ability to capture long-range dependencies and enhance context understanding, but it is limited by its computational complexity and challenges in handling sequential data with inherent…

Computation and Language · Computer Science 2025-05-05 Md Kowsher , Nusrat Jahan Prottasha , Chun-Nam Yu , Ozlem Ozmen Garibay , Niloofar Yousefi

Existing Multiple-Object Tracking (MOT) methods either follow the tracking-by-detection paradigm to conduct object detection, feature extraction and data association separately, or have two of the three subtasks integrated to form a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Jinlong Peng , Changan Wang , Fangbin Wan , Yang Wu , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Yanwei Fu

Augmented Reality (AR) applications often require robust real-time tracking of objects in the user's environment to correctly overlay virtual content. Recent advances in computer vision have produced highly accurate deep learning-based…

Human-Computer Interaction · Computer Science 2025-11-25 Alice Smith , Bob Johnson , Xiaoyu Zhu , Carol Lee

Object detection often costs a considerable amount of computation to get satisfied performance, which is unfriendly to be deployed in edge devices. To address the trade-off between computational cost and detection accuracy, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Huimin Shi , Quan Zhou , Yinghao Ni , Xiaofu Wu , Longin Jan Latecki

Multi-Object Tracking (MOT) is a critical problem in computer vision, essential for understanding how objects move and interact in videos. This field faces significant challenges such as occlusions and complex environmental dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luiz C. S. de Araujo , Carlos M. S. Figueiredo