English
Related papers

Related papers: Awesome Multi-modal Object Tracking

200 papers

Multiple object tracking (MOT) in Unmanned Aerial Vehicle (UAV) videos is important for diverse applications in computer vision. Current MOT trackers rely on accurate object detection results and precise matching of target reidentification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jianbo Ma , Chuanming Tang , Fei Wu , Can Zhao , Jianlin Zhang , Zhiyong Xu

Multi-object tracking (MOT) has traditionally focused on estimating trajectories of all objects in a video, without selectively reasoning about user-specified targets under semantic instructions. In this work, we introduce a query-driven…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tajamul Ashraf , Tavaheed Tariq , Sonia Yadav , Abrar Ul Riyaz , Wasif Tak , Moloud Abdar , Janibul Bashir

Multi-Object Tracking (MOT) aims to associate multiple objects across video frames and is a challenging vision task due to inherent complexities in the tracking environment. Most existing approaches train and track within a single domain,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Run Luo , Zikai Song , Longze Chen , Yunshui Li , Min Yang , Wei Yang

Multimodal sensing has proven valuable for visual tracking, as different sensor types offer unique strengths in handling one specific challenging scene where object appearance varies. While a generalist model capable of leveraging all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuedong Tan , Zongwei Wu , Yuqian Fu , Zhuyun Zhou , Guolei Sun , Eduard Zamfi , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Object tracking is an important functionality of edge video analytic systems and services. Multi-object tracking (MOT) detects the moving objects and tracks their locations frame by frame as real scenes are being captured into a video.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Sanjana Vijay Ganesh , Yanzhao Wu , Gaowen Liu , Ramana Kompella , Ling Liu

Multi-view object tracking (MVOT) offers promising solutions to challenges such as occlusion and target loss, which are common in traditional single-view tracking. However, progress has been limited by the lack of comprehensive multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Mengjie Xu , Yitao Zhu , Haotian Jiang , Jiaming Li , Zhenrong Shen , Sheng Wang , Haolin Huang , Xinyu Wang , Qing Yang , Han Zhang , Qian Wang

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Robust multi-object tracking (MOT) is a prerequisite fora safe deployment of self-driving cars. Tracking objects, however, remains a highly challenging problem, especially in cluttered autonomous driving scenes in which objects tend to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Wei-Chih Hung , Henrik Kretzschmar , Tsung-Yi Lin , Yuning Chai , Ruichi Yu , Ming-Hsuan Yang , Dragomir Anguelov

RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hao Li , Yuhao Wang , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

Robots navigating autonomously need to perceive and track the motion of objects and other agents in its surroundings. This information enables planning and executing robust and safe trajectories. To facilitate these processes, the motion…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Abhijeet Shenoi , Mihir Patel , JunYoung Gwak , Patrick Goebel , Amir Sadeghian , Hamid Rezatofighi , Roberto Martín-Martín , Silvio Savarese

Multi-object tracking (MOT) is an important and practical task related to both surveillance systems and moving camera applications, such as autonomous driving and robotic vision. However, due to unreliable detection, occlusion and fast…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gaoang Wang , Yizhou Wang , Haotian Zhang , Renshu Gu , Jenq-Neng Hwang

Gait recognition has emerged as a powerful biometric technique for identifying individuals at a distance without requiring user cooperation. Most existing methods focus primarily on RGB-derived modalities, which fall short in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Chenye Wang , Qingyuan Cai , Saihui Hou , Aoqi Li , Yongzhen Huang

This paper introduces the task of Auditory Referring Multi-Object Tracking (AR-MOT), which dynamically tracks specific objects in a video sequence based on audio expressions and appears as a challenging problem in autonomous driving. Due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Jiacheng Lin , Jiajun Chen , Kunyu Peng , Xuan He , Zhiyong Li , Rainer Stiefelhagen , Kailun Yang

RGBT tracking draws increasing attention because its robustness in multi-modal warranting (MMW) scenarios, such as nighttime and adverse weather conditions, where relying on a single sensing modality fails to ensure stable tracking results.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Zhangyong Tang , Tianyang Xu , Zhenhua Feng , Xuefeng Zhu , Chunyang Cheng , Xiao-Jun Wu , Josef Kittler

In this paper we present a robust tracker to solve the multiple object tracking (MOT) problem, under the framework of tracking-by-detection. As the first contribution, we innovatively combine single object tracking (SOT) algorithms with…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Qizheng He , Jianan Wu , Gang Yu , Chi Zhang

The ability to recognize, localize and track dynamic objects in a scene is fundamental to many real-world applications, such as self-driving and robotic systems. Yet, traditional multiple object tracking (MOT) benchmarks rely only on a few…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Siyuan Li , Tobias Fischer , Lei Ke , Henghui Ding , Martin Danelljan , Fisher Yu

Multi-object tracking (MOT) on static platforms, such as by surveillance cameras, has achieved significant progress, with various paradigms providing attractive performances. However, the effectiveness of traditional MOT methods is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Peng Wang , Yongcai Wang , Deying Li

Multiple object tracking (MOT) in urban traffic aims to produce the trajectories of the different road users that move across the field of view with different directions and speeds and that can have varying appearances and sizes. Occlusions…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Hui-Lee Ooi , Guillaume-Alexandre Bilodeau , Nicolas Saunier , David-Alexandre Beaupré

Multiple-object tracking (MOT) is a challenging task that requires simultaneous reasoning about location, appearance, and identity of the objects in the scene over time. Our aim in this paper is to move beyond tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Bruno Korbar , Andrew Zisserman

Referring Multi-Object Tracking (RMOT) aims to achieve precise object detection and tracking through natural language instructions, representing a fundamental capability for intelligent robotic systems. However, current RMOT research…