English
Related papers

Related papers: Adaptive Perception for Unified Visual Multi-modal…

200 papers

Multimodal tracking has garnered widespread attention as a result of its ability to effectively address the inherent limitations of traditional RGB tracking. However, existing multimodal trackers mainly focus on the fusion and enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Xiantao Hu , Ying Tai , Xu Zhao , Chen Zhao , Zhenyu Zhang , Jun Li , Bineng Zhong , Jian Yang

Existing Transformer-based RGBT tracking methods either use cross-attention to fuse the two modalities, or use self-attention and cross-attention to model both modality-specific and modality-sharing information. However, the significant…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yabin Zhu , Chenglong Li , Xiao Wang , Jin Tang , Zhixiang Huang

The main challenge of Multi-Object Tracking~(MOT) lies in maintaining a continuous trajectory for each target. Existing methods often learn reliable motion patterns to match the same target between adjacent frames and discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zheng Qin , Sanping Zhou , Le Wang , Jinghai Duan , Gang Hua , Wei Tang

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao

Unsupervised pre-training has shown great success in skeleton-based action understanding recently. Existing works typically train separate modality-specific models, then integrate the multi-modal information for action understanding by a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Shengkai Sun , Daizong Liu , Jianfeng Dong , Xiaoye Qu , Junyu Gao , Xun Yang , Xun Wang , Meng Wang

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

The ability to learn robust multi-modality representation has played a critical role in the development of RGBT tracking. However, the regular fusion paradigm and the invariable tracking template remain restrictive to the feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ruichao Hou , Boyue Xu , Tongwei Ren , Gangshan Wu

Cross-modal object tracking is an important research topic in the field of information fusion, and it aims to address imaging limitations in challenging scenarios by integrating switchable visible and near-infrared modalities. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Chenglong Li , Futian Wang , Longfeng Shen , Jin Tang

Visual multi-object tracking has the potential to accelerate many forms of quantitative analyses, especially in research communities investigating the motion, behavior, or social interactions within groups of animals. Despite its potential…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Lance Rice , Samual Tate , David Farynyk , Joshua Sun , Greg Chism , Daniel Charbonneau , Thomas Fasciano , Anna Dornhaus , Min C. Shin

Unmanned aerial vehicle (UAV) tracking is critical for applications like surveillance, search-and-rescue, and autonomous navigation. However, the high-speed movement of UAVs and targets introduces unique challenges, including real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 You Wu , Xucheng Wang , Dan Zeng , Hengzhou Ye , Xiaolan Xie , Qijun Zhao , Shuiwang Li

As a key research direction in the field of multi-object tracking (MOT), UAV-based multi-object tracking has significant application value in the analysis and understanding of urban intelligent transportation systems. However, in complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wenguang Tao , Xiaotian Wang , Tian Yan , Jie Yan , Guodong Li , Kun Bai

Efficiently modeling spatio-temporal relations of objects is a key challenge in visual object tracking (VOT). Existing methods track by appearance-based similarity or long-term relation modeling, resulting in rich temporal contexts between…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yushan Han , Kaer Huang

Visual object tracking, as a fundamental task in computer vision, has drawn much attention in recent years. To extend trackers to a wider range of applications, researchers have introduced information from multiple modalities to handle…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Pengyu Zhang , Dong Wang , Huchuan Lu

Most of the existing single object trackers track the target in a unitary local search window, making them particularly vulnerable to challenging factors such as heavy occlusions and out-of-view movements. Despite the attempts to further…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xiao Wang , Zhe Chen , Jin Tang , Bin Luo , Yaowei Wang , Yonghong Tian , Feng Wu

A typical pipeline for multi-object tracking (MOT) is to use a detector for object localization, and following re-identification (re-ID) for object association. This pipeline is partially motivated by recent progress in both object…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Peize Sun , Jinkun Cao , Yi Jiang , Zehuan Yuan , Song Bai , Kris Kitani , Ping Luo

RGB-D tracking significantly improves the accuracy of object tracking. However, its dependency on real depth inputs and the complexity involved in multi-modal fusion limit its applicability across various scenarios. The utilization of depth…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhenyu Wei , Yujie He , Zhanchuan Cai

Prior correlation filter (CF)-based tracking methods for unmanned aerial vehicles (UAVs) have virtually focused on tracking in the daytime. However, when the night falls, the trackers will encounter more harsh scenes, which can easily lead…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Bowen Li , Changhong Fu , Fangqiang Ding , Junjie Ye , Fuling Lin

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Automated animal behavior analysis relies on long-term, interpretable individual trajectories; however, multi-animal tracking in space science experimental videos remains highly challenging due to weak appearance cues, low-quality imaging,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jianing You , Han Wang , Kang Liu , Jiale Ding , Fengjie Chu , Zihan Guo , Shengyang Li

Nighttime UAV tracking faces significant challenges in real-world robotics operations. Low-light conditions not only limit visual perception capabilities, but cluttered backgrounds and frequent viewpoint changes also cause existing trackers…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Xuzhao Li , Xuchen Li , Shiyu Hu