English
Related papers

Related papers: Awesome Multi-modal Object Tracking

200 papers

Multi-object tracking (MOT) is a core task in computer vision that involves detecting objects in video frames and associating them across time. The rise of deep learning has significantly advanced MOT, particularly within the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Momir Adžemović

Referring Multi-Object Tracking (RMOT) aims to track specific targets based on language descriptions and is vital for interactive AI systems such as robotics and autonomous driving. However, existing RMOT models rely solely on 2D RGB data,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Sijia Chen , Lijuan Ma , Yanqiu Yu , En Yu , Liman Liu , Wenbing Tao

Most existing Multi-Object Tracking (MOT) approaches follow the Tracking-by-Detection paradigm and the data association framework where objects are firstly detected and then associated. Although deep-learning based method can noticeably…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xingyu Wan , Jiakai Cao , Sanping Zhou , Jinjun Wang

Object tracking based on the fusion of visible and thermal im-ages, known as RGB-T tracking, has gained increasing atten-tion from researchers in recent years. How to achieve a more comprehensive fusion of information from the two…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yang Luo , Xiqing Guo , Hui Feng , Lei Ao

Attributes of sound inherent to objects can provide valuable cues to learn rich representations for object detection and tracking. Furthermore, the co-occurrence of audiovisual events in videos can be exploited to localize objects over the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Francisco Rivera Valverde , Juana Valeria Hurtado , Abhinav Valada

We propose an online tracking algorithm that performs the object detection and data association under a common framework, capable of linking objects after a long time span. This is realized by preserving a large spatio-temporal memory to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jiarui Cai , Mingze Xu , Wei Li , Yuanjun Xiong , Wei Xia , Zhuowen Tu , Stefano Soatto

Deep learning-based Multiple Object Tracking (MOT) currently relies on off-the-shelf detectors for tracking-by-detection.This results in deep models that are detector biased and evaluations that are detector influenced. To resolve this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 ShiJie Sun , Naveed Akhtar , XiangYu Song , HuanSheng Song , Ajmal Mian , Mubarak Shah

The goal of multi-object tracking (MOT) is to detect and track all objects in a scene across frames, while maintaining a unique identity for each object. Most existing methods rely on the spatial-temporal motion features and appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yanzhao Fang

Multimodal visual object tracking can be divided into to several kinds of tasks (e.g. RGB and RGB+X tracking), based on the input modality. Existing methods often train separate models for each modality or rely on pretrained models to adapt…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lingyi Hong , Jinglun Li , Xinyu Zhou , Kaixun Jiang , Pinxue Guo , Zhaoyu Chen , Runze Li , Xingdong Sheng , Wenqiang Zhang

Multiple object tracking (MOT) is a crucial task in computer vision society. However, most tracking-by-detection MOT methods, with available detected bounding boxes, cannot effectively handle static, slow-moving and fast-moving camera…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Jiarui Cai , Yizhou Wang , Haotian Zhang , Hung-Min Hsu , Chengqian Ma , Jenq-Neng Hwang

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to locate an arbitrary number of target objects and maintain their identities referred by a language expression in a video. This intricate task involves the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Changcheng Xiao , Qiong Cao , Yujie Zhong , Xiang Zhang , Tao Wang , Canqun Yang , Long Lan

Underwater Object Tracking (UOT) is crucial for efficient marine robotics, large scale ecological monitoring, and ocean exploration; however, progress has been hindered by the scarcity of large, multimodal, and diverse datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Ahsan Baidar Bakht , Mohamad Alansari , Muhayy Ud Din , Muzammal Naseer , Sajid Javed , Irfan Hussain , Jiri Matas , Arif Mahmood

Despite recent progress, Multi-Object Tracking (MOT) continues to face significant challenges, particularly its dependence on prior knowledge and predefined categories, complicating the tracking of unfamiliar objects. Generic Multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Duy Le Dinh Anh , Kim Hoang Tran , Quang-Thuc Nguyen , Ngan Hoang Le

Current approaches in Multiple Object Tracking (MOT) rely on the spatio-temporal coherence between detections combined with object appearance to match objects from consecutive frames. In this work, we explore MOT using object appearances as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Andreu Girbau , Ferran Marqués , Shin'ichi Satoh

We introduce a one-shot learning approach for video object tracking. The proposed algorithm requires seeing the object to be tracked only once, and employs an external memory to store and remember the evolving features of the foreground…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Boyu Liu , Yanzhao Wang , Yu-Wing Tai , Chi-Keung Tang

The ability to detect and track the dynamic objects in different scenes is fundamental to real-world applications, e.g., autonomous driving and robot navigation. However, traditional Multi-Object Tracking (MOT) is limited to tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Qiankun Liu , Yichen Li , Yuqi Jiang , Ying Fu

Referring Multi-Object Tracking has attracted increasing attention due to its human-friendly interactive characteristics, yet it exhibits limitations in low-visibility conditions, such as nighttime, smoke, and other challenging scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yanqiu Yu , Zhifan Jin , Sijia Chen , Tongfei Chu , En Yu , Liman Liu , Wenbing Tao

Multiple Object Tracking (MOT) is a core capability in modern computer vision, essential to autonomous driving, surveillance, sports analytics, robotics, and biomedical imaging. Persistent identity assignment across frames remains…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Mk Bashar , Samia Islam , Kashifa Kawaakib Hussain , Md. Bakhtiar Hasan , A. B. M. Ashikur Rahman , Md. Hasanul Kabir

One of the recent trends in vision problems is to use natural language captions to describe the objects of interest. This approach can overcome some limitations of traditional methods that rely on bounding boxes or category annotations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Pha Nguyen , Kha Gia Quach , Kris Kitani , Khoa Luu

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu