English
Related papers

Related papers: DMTrack: Spatio-Temporal Multimodal Tracking via D…

200 papers

End-to-end multi-object tracking (MOT) methods have recently achieved remarkable progress by unifying detection and association within a single framework. Despite their strong detection performance, these methods suffer from relatively low…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yuqing Shao , Yuchen Yang , Rui Yu , Weilong Li , Xu Guo , Huaicheng Yan , Wei Wang , Xiao Sun

Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich temporal contexts between…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yushan Han , Kaer Huang

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu

Multi-object tracking (MOT) is a vital component of intelligent video analytics applications such as surveillance and autonomous driving. The time and storage complexity required to execute deep learning models for visual object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Keivan Nalaie , Rong Zheng

To reduce the reliance on large-scale annotations, self-supervised RGB-T tracking approaches have garnered significant attention. However, the omission of the object region by erroneous pseudo-label or the introduction of background noise…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Shenglan Li , Rui Yao , Yong Zhou , Hancheng Zhu , Kunyang Sun , Bing Liu , Zhiwen Shao , Jiaqi Zhao

Nighttime UAV tracking faces significant challenges in real-world robotics operations. Low-light conditions not only limit visual perception capabilities, but cluttered backgrounds and frequent viewpoint changes also cause existing trackers…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Xuzhao Li , Xuchen Li , Shiyu Hu

Most state-of-the-art trackers adopt one-stream paradigm, using a single Vision Transformer for joint feature extraction and relation modeling of template and search region images. However, relation modeling between different image patches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wenrui Cai , Qingjie Liu , Yunhong Wang

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

Tracking tasks based on deep neural networks have greatly improved with the emergence of Siamese trackers. However, the appearance of targets often changes during tracking, which can reduce the robustness of the tracker when facing…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Yucheng Huang , Eksan Firkat , Ziwang Xiao , Jihong Zhu , Askar Hamdulla

Multispectral oriented object detection faces challenges due to both inter-modal and intra-modal discrepancies. Recent studies often rely on transformer-based models to address these issues and achieve cross-modal fusion detection. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Minghang Zhou , Tianyu Li , Chaofan Qiao , Dongyu Xie , Guoqing Wang , Ningjuan Ruan , Lin Mei , Yang Yang

Continual Test-Time Adaptation (CTTA) generalizes conventional Test-Time Adaptation (TTA) by assuming that the target domain is dynamic over time rather than stationary. In this paper, we explore Multi-Modal Continual Test-Time Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haozhi Cao , Yuecong Xu , Jianfei Yang , Pengyu Yin , Shenghai Yuan , Lihua Xie

In recent years, the deployment of large-scale pre-trained models in audio-visual downstream tasks has yielded remarkable outcomes. However, these models, primarily trained on single-modality unconstrained datasets, still encounter…

Machine Learning · Computer Science 2023-12-22 Haoyi Duan , Yan Xia , Mingze Zhou , Li Tang , Jieming Zhu , Zhou Zhao

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve the target and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shang Gao , Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Skeleton-based action recognition faces two longstanding challenges: the scarcity of labeled training samples and difficulty modeling short- and long-range temporal dependencies. To address these issues, we propose a unified framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Feng Ding , Haisheng Fu , Soroush Oraki , Jie Liang

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

RGB-T tracking leverages the complementary strengths of RGB and thermal infrared (TIR) modalities to address challenging scenarios such as low illumination and adverse weather. However, existing methods often fail to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhongxuan Zhang , Bi Zeng , Xinyu Ni , Yimin Du

Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Siyuan Yao , Rui Zhu , Ziqi Wang , Wenqi Ren , Yanyang Yan , Xiaochun Cao

Temporal information is crucial for visual tracking, but existing multi-frame trackers are vulnerable to model drift caused by naively aggregating noisy historical predictions. In this paper, we introduce DTPTrack, a lightweight and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yuqing Huang , Liting Lin , Weijun Zhuang , Zhenyu He , Xin Li

Prompt tuning methods have achieved remarkable success in parameter-efficient fine-tuning on large pre-trained models. However, their application to dual-modal fusion-based visual-language pre-trained models (VLPMs), such as GLIP, has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yang Zhou , Yongjian Wu , Jiya Saiyin , Bingzheng Wei , Maode Lai , Eric Chang , Yan Xu

Adapting pre-trained image models to video modality has proven to be an effective strategy for robust few-shot action recognition. In this work, we explore the potential of adapter tuning in image-to-video model adaptation and propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Wenjie Pei , Qizhong Tan , Guangming Lu , Jiandong Tian , Jun Yu