English
Related papers

Related papers: QTrack: Query-Driven Reasoning for Multi-modal MOT

200 papers

Multiple-object tracking and segmentation (MOTS) is a novel computer vision task that aims to jointly perform multiple object tracking (MOT) and instance segmentation. In this work, we present PointTrack++, an effective on-line framework…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Zhenbo Xu , Wei Zhang , Xiao Tan , Wei Yang , Xiangbo Su , Yuchen Yuan , Hongwu Zhang , Shilei Wen , Errui Ding , Liusheng Huang

Multi-modal object tracking (MMOT) is an emerging field that combines data from various modalities, \eg vision (RGB), depth, thermal infrared, event, language and audio, to estimate the state of an arbitrary object in a video sequence. It…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Chunhui Zhang , Li Liu , Hao Wen , Xi Zhou , Yanfeng Wang

Multi-Object Tracking (MOT) is a critical problem in computer vision, essential for understanding how objects move and interact in videos. This field faces significant challenges such as occlusions and complex environmental dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Luiz C. S. de Araujo , Carlos M. S. Figueiredo

Tracking by natural language specification (TNL) aims to consistently localize a target in a video sequence given a linguistic description in the initial frame. Existing methodologies perform language-based and template-based matching for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Yanyan Shao , Shuting He , Qi Ye , Yuchao Feng , Wenhan Luo , Jiming Chen

Multi-object tracking (MOT) is a critical technology in computer vision, designed to detect multiple targets in video sequences and assign each target a unique ID per frame. Existed MOT methods excel at accurately tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Lifan Jiang , Zhihui Wang , Siqi Yin , Guangxiao Ma , Peng Zhang , Boxi Wu

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Changcheng Xiao , Qiong Cao , Yujie Zhong , Xiang Zhang , Tao Wang , Canqun Yang , Long Lan

Modern online multiple object tracking (MOT) methods usually focus on two directions to improve tracking performance. One is to predict new positions in an incoming frame based on tracking information from previous frames, and the other is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Song Guo , Jingya Wang , Xinchao Wang , Dacheng Tao

Multiple Object Tracking (MOT) is a core capability in modern computer vision, essential to autonomous driving, surveillance, sports analytics, robotics, and biomedical imaging. Persistent identity assignment across frames remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Mk Bashar , Samia Islam , Kashifa Kawaakib Hussain , Md. Bakhtiar Hasan , A. B. M. Ashikur Rahman , Md. Hasanul Kabir

3D multi-object tracking aims to uniquely and consistently identify all mobile entities through time. Despite the rich spatiotemporal information available in this setting, current 3D tracking methods primarily rely on abstracted…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Colton Stearns , Davis Rempe , Jie Li , Rares Ambrus , Sergey Zakharov , Vitor Guizilini , Yanchao Yang , Leonidas J Guibas

Multi-object tracking (MOT) has profound applications in a variety of fields, including surveillance, sports analytics, self-driving, and cooperative robotics. Despite considerable advancements, existing MOT methodologies tend to falter…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Hamza Mukhtar , Muhammad Usman Ghani Khan

Multimodal vision-language (VL) learning has noticeably pushed the tendency toward generic intelligence owing to emerging large foundation models. However, tracking, as a fundamental vision problem, surprisingly enjoys less bonus from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingzhe Guo , Zhipeng Zhang , Liping Jing , Haibin Ling , Heng Fan

Tracking a time-varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field. Most existing approaches are not able to properly handle multi-object tracking challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Tianyu Zhu , Markus Hiller , Mahsa Ehsanpour , Rongkai Ma , Tom Drummond , Ian Reid , Hamid Rezatofighi

Online 3D multi-object tracking (MOT) has witnessed significant research interest in recent years, largely driven by demand from the autonomous systems community. However, 3D offline MOT is relatively less explored. Labeling 3D trajectory…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Martin Buchner , Abhinav Valada

Referring multi-object tracking (RMOT) is a task of associating all the objects in a video that semantically match with given textual queries or referring expressions. Existing RMOT approaches decompose object grounding and tracking into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zijia Lu , Jingru Yi , Jue Wang , Yuxiao Chen , Junwen Chen , Xinyu Li , Davide Modolo

Multiple Object Tracking (MOT) has witnessed remarkable advances in recent years. However, existing studies dominantly request prior knowledge of the tracking target, and hence may not generalize well to unseen categories. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Hexin Bai , Wensheng Cheng , Peng Chu , Juehuan Liu , Kai Zhang , Haibin Ling

By extending the advantage of chain-of-thought (CoT) reasoning in human-like step-by-step processes to multimodal contexts, multimodal CoT (MCoT) reasoning has recently garnered significant research attention, especially in the integration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yaoting Wang , Shengqiong Wu , Yuecheng Zhang , Shuicheng Yan , Ziwei Liu , Jiebo Luo , Hao Fei

Many Multi-Object Tracking (MOT) approaches exploit motion information to associate all the detected objects across frames. However, many methods that rely on filtering-based algorithms, such as the Kalman Filter, often work well in linear…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Xudong Han , Nobuyuki Oishi , Yueying Tian , Elif Ucurum , Rupert Young , Chris Chatwin , Philip Birch

Standardized benchmarks have been crucial in pushing the performance of computer vision algorithms, especially since the advent of deep learning. Although leaderboards should not be over-claimed, they often provide the most objective…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Patrick Dendorfer , Aljoša Ošep , Anton Milan , Konrad Schindler , Daniel Cremers , Ian Reid , Stefan Roth , Laura Leal-Taixé

Multiple Object Tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Tao Wang , Kean Chen , Weiyao Lin , John See , Zenghui Zhang , Qian Xu , Xia Jia

Cross-modal object tracking (CMOT) is an emerging task that maintains target consistency while the video stream switches between different modalities, with only one modality available in each frame, mostly focusing on RGB-Near Infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Boyue Xu , Ruichao Hou , Tongwei Ren , Dongming Zhou , Gangshan Wu , Jinde Cao