English
Related papers

Related papers: DM$^3$T: Harmonizing Modalities via Diffusion for …

200 papers

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

Multi-modal 3D object detection has received growing attention as the information from different sensors like LiDAR and cameras are complementary. Most fusion methods for 3D detection rely on an accurate alignment and calibration between 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Zhe Liu , Xiaoqing Ye , Zhikang Zou , Xinwei He , Xiao Tan , Errui Ding , Jingdong Wang , Xiang Bai

With the rapid advancement of remote sensing technology, high-resolution multi-modal imagery is now more widely accessible. Conventional Object detection models are trained on a single dataset, often restricted to a specific imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Li , Xiang Li , Yunheng Li , Yicheng Zhang , Yimian Dai , Qibin Hou , Ming-Ming Cheng , Jian Yang

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

Visual Multi-Object Tracking (MOT) is a crucial component of robotic perception, yet existing Tracking-By-Detection (TBD) methods often rely on 2D cues, such as bounding boxes and motion modeling, which struggle under occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Buyin Deng , Lingxin Huang , Kai Luo , Fei Teng , Kailun Yang

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

Current motion-based multiple object tracking (MOT) approaches rely heavily on Intersection-over-Union (IoU) for object association. Without using 3D features, they are ineffective in scenarios with occlusions or visually similar objects.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Milad Khanchi , Maria Amer , Charalambos Poullis

Most end-to-end Multi-Object Tracking (MOT) methods face the problems of low accuracy and poor generalization ability. Although traditional filter-based methods can achieve better results, they are difficult to be endowed with optimal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Guangyao Zhai , Xin Kong , Jinhao Cui , Yong Liu , Zhen Yang

3D Multi-Object Tracking (MOT) obtains significant performance improvements with the rapid advancements in 3D object detection, particularly in cost-effective multi-camera setups. However, the prevalent end-to-end training approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Xiaoyu Li , Peidong Li , Lijun Zhao , Dedong Liu , Jinghan Gao , Xian Wu , Yitao Wu , Dixiao Cui

The fusion of camera- and LiDAR-based detections offers a promising solution to mitigate tracking failures in 3D multi-object tracking (MOT). However, existing methods predominantly exploit camera detections to correct tracking failures…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Lipeng Gu , Xuefeng Yan , Weiming Wang , Honghua Chen , Dingkun Zhu , Liangliang Nan , Mingqiang Wei

We propose a 3D multi-object tracking (MOT) solution using only 2D detections from monocular cameras, which automatically initiates/terminates tracks as well as resolves track appearance-reappearance and occlusions. Moreover, this approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Linh Van Ma , Tran Thien Dat Nguyen , Ba-Ngu Vo , Hyunsung Jang , Moongu Jeon

Object tracking is divided into single-object tracking (SOT) and multi-object tracking (MOT). MOT aims to maintain the identities of multiple objects across a series of continuous video sequences. In recent years, MOT has made rapid…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yukuan Zhang , Yunhua Jia , Housheng Xie , Mengzhen Li , Limin Zhao , Yang Yang , Shan Zhao

Referring multi-object tracking (RMOT) is an emerging cross-modal task that aims to localize an arbitrary number of targets based on a language expression and continuously track them in a video. This intricate task involves reasoning on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Wenjun Huang , Yang Ni , Hanning Chen , Yirui He , Ian Bryant , Yezi Liu , Mohsen Imani

Online multi-object tracking (MOT) is extremely important for high-level spatial reasoning and path planning for autonomous and highly-automated vehicles. In this paper, we present a modular framework for tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Akshay Rangesh , Mohan M. Trivedi

Most modern multiple object tracking (MOT) systems follow the tracking-by-detection paradigm, consisting of a detector followed by a method for associating detections into tracks. There is a long history in tracking of combining motion and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mohamed Chaabane , Peter Zhang , J. Ross Beveridge , Stephen O'Hara

Multi-object tracking (MOT) on static platforms, such as by surveillance cameras, has achieved significant progress, with various paradigms providing attractive performances. However, the effectiveness of traditional MOT methods is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Peng Wang , Yongcai Wang , Deying Li

In the current demand for automation in the agro-food industry, accurately detecting and localizing relevant objects in 3D is essential for successful robotic operations. However, this is a challenge due the presence of occlusions.…

Robotics · Computer Science 2024-12-19 David Rapado-Rincon , Henk Nap , Katarina Smolenova , Eldert J. van Henten , Gert Kootstra

3D multi-object tracking (MOT) and trajectory forecasting are two critical components in modern 3D perception systems. We hypothesize that it is beneficial to unify both tasks under one framework to learn a shared feature representation of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Xinshuo Weng , Ye Yuan , Kris Kitani

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

3D multi-object tracking and trajectory prediction are two crucial modules in autonomous driving systems. Generally, the two tasks are handled separately in traditional paradigms and a few methods have started to explore modeling these two…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jiaheng Zhuang , Guoan Wang , Siyu Zhang , Xiyang Wang , Hangning Zhou , Ziyao Xu , Chi Zhang , Zhiheng Li