English
Related papers

Related papers: Motion-Aware Transformer for Multi-Object Tracking

200 papers

We propose a 3D multi-object tracking (MOT) solution using only 2D detections from monocular cameras, which automatically initiates/terminates tracks as well as resolves track appearance-reappearance and occlusions. Moreover, this approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Linh Van Ma , Tran Thien Dat Nguyen , Ba-Ngu Vo , Hyunsung Jang , Moongu Jeon

Video-to-video moment retrieval (Vid2VidMR) is the task of localizing unseen events or moments in a target video using a query video. This task poses several challenges, such as the need for semantic frame-level alignment and modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yogesh Kumar , Uday Agarwal , Manish Gupta , Anand Mishra

Multi-object tracking (MOT) is a fundamental task in computer vision that requires continuously tracking multiple targets while maintaining consistent identities across frames. However, most existing approaches primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanchao Wang , Dawei Zhang , Chengzhuan Yang , Wei Liu , Minglu Li , Hua Wang , Zhonglong Zheng , Ming-Hsuan Yang

Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks by incorporating the extraction of appearance features as auxiliary tasks through embedding Re-Identification task…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Yunfei Zhang , Chao Liang , Jin Gao , Zhipeng Zhang , Weiming Hu , Stephen Maybank , Xue Zhou , Liang Li

Recent multi-camera 3D object detectors usually leverage temporal information to construct multi-view stereo that alleviates the ill-posed depth estimation. However, they typically assume all the objects are static and directly aggregate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Qing Lian , Tai Wang , Dahua Lin , Jiangmiao Pang

Detection Transformer (DETR) has redefined object detection by casting it as a set prediction task within an end-to-end framework. Despite its elegance, DETR and its variants still rely on fixed learnable queries and suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhengjian Kang , Jun Zhuang , Kangtong Mo , Qi Chen , Rui Liu , Ye Zhang

The challenge of 3D multi-object tracking is achieving robustness in real-world applications, for example under adverse conditions and maintaining consistency as distance increases. To overcome these challenges, sensor fusion approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Bingxue Xu , Emil Hedemalm , Ajinkya Khoche , Patric Jensfelt

Multi-object tracking (MOT) aims at estimating bounding boxes and identities of objects across video frames. Detection boxes serve as the basis of both 2D and 3D MOT. The inevitable changing of detection scores leads to object missing after…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yifu Zhang , Xinggang Wang , Xiaoqing Ye , Wei Zhang , Jincheng Lu , Xiao Tan , Errui Ding , Peize Sun , Jingdong Wang

We present TransMOT, a novel transformer-based end-to-end trainable online tracker and detector for point cloud data. The model utilizes a cross- and a self-attention mechanism and is applicable to lidar data in an automotive context, as…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Felicia Ruppel , Florian Faion , Claudius Gläser , Klaus Dietmayer

Many multi-object tracking (MOT) approaches, which employ the Kalman Filter as a motion predictor, assume constant velocity and Gaussian-distributed filtering noises. These assumptions render the Kalman Filter-based trackers effective in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Vitaliy Kim , Gunho Jung , Seong-Whan Lee

Mobile autonomy relies on the precise perception of dynamic environments. Robustly tracking moving objects in 3D world thus plays a pivotal role for applications like trajectory prediction, obstacle avoidance, and path planning. While most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zhijun Pan , Fangqiang Ding , Hantao Zhong , Chris Xiaoxuan Lu

Unmanned aerial vehicle (UAV) detection and aerial object recognition are critical for modern surveillance and security, prompting a need for robust systems that overcome limitations of single-modality approaches. This research addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Mauro Larrat , Claudomiro Sales

Current motion-based multiple object tracking (MOT) approaches rely heavily on Intersection-over-Union (IoU) for object association. Without using 3D features, they are ineffective in scenarios with occlusions or visually similar objects.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Milad Khanchi , Maria Amer , Charalambos Poullis

The unique complementarity of frame-based and event cameras for high frame rate object tracking has recently inspired some research attempts to develop multi-modal fusion approaches. However, these methods directly fuse both modalities and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yucheng Chen , Lin Wang

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao

Multiple object tracking (MOT) from unmanned aerial vehicle (UAV) platforms requires efficient motion modeling. This is because UAV-MOT faces both local object motion and global camera motion. Motion blur also increases the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mufeng Yao , Jinlong Peng , Qingdong He , Bo Peng , Hao Chen , Mingmin Chi , Chao Liu , Jon Atli Benediktsson

Multi-object tracking (MOT) from unmanned aerial vehicles (UAVs) presents unique challenges due to unpredictable object motion, frequent occlusions, and limited appearance cues inherent to aerial viewpoints. These issues are further…

Systems and Control · Electrical Eng. & Systems 2025-10-22 Zenghuang Fu , Xiaofeng Han , Mingda Jia , Jin ming Yang , Qi Zeng , Muyang Zahng , Changwei Wang , Weiliang Meng , Xiaopeng Zhang

3D multiple object tracking (MOT) plays a crucial role in autonomous driving perception. Recent end-to-end query-based trackers simultaneously detect and track objects, which have shown promising potential for the 3D MOT task. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Tao Tang , Lijun Zhou , Pengkun Hao , Zihang He , Kalok Ho , Shuo Gu , Zhihui Hao , Haiyang Sun , Kun Zhan , Peng Jia , XianPeng Lang , Xiaodan Liang

3D Multi-object tracking (MOT) ensures consistency during continuous dynamic detection, conducive to subsequent motion planning and navigation tasks in autonomous driving. However, camera-based methods suffer in the case of occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Li Wang , Xinyu Zhang , Wenyuan Qin , Xiaoyu Li , Lei Yang , Zhiwei Li , Lei Zhu , Hong Wang , Jun Li , Huaping Liu

Multi-object tracking (MOT) in human-dominant scenarios, which involves continuously tracking multiple people within video sequences, remains a significant challenge in computer vision due to targets' complex motion and severe occlusions.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yingjie Wang , Zhixing Wang , Le Zheng , Tianxiao Liu , Roujing Li , Xueyao Hu