English
Related papers

Related papers: MMF-Track: Multi-modal Multi-level Fusion for 3D S…

200 papers

Accurate and robust 3D object detection is a critical component in autonomous vehicles and robotics. While recent radar-camera fusion methods have made significant progress by fusing information in the bird's-eye view (BEV) representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jisong Kim , Minjae Seong , Jun Won Choi

Multi-sensor perception is crucial to ensure the reliability and accuracy in autonomous driving system, while multi-object tracking (MOT) improves that by tracing sequential movement of dynamic objects. Most current approaches for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Wenwei Zhang , Hui Zhou , Shuyang Sun , Zhe Wang , Jianping Shi , Chen Change Loy

For 3D object detection, both camera and lidar have been demonstrated to be useful sensory devices for providing complementary information about the same scenery with data representations in different modalities, e.g., 2D RGB image vs 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Jiawei Zhang

Monocular 3D Object Detection represents a challenging Computer Vision task due to the nature of the input used, which is a single 2D image, lacking in any depth cues and placing the depth estimation problem as an ill-posed one. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Diana-Alexandra Sas , Florin Oniga

Accurate and consistent 3D tracking from multiple cameras is a key component in a vision-based autonomous driving system. It involves modeling 3D dynamic objects in complex scenes across multiple cameras. This problem is inherently…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianyuan Zhang , Xuanyao Chen , Yue Wang , Yilun Wang , Hang Zhao

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

3D single object tracking is essential in autonomous driving and robotics. Existing methods often struggle with sparse and incomplete point cloud scenarios. To address these limitations, we propose a Multimodal-guided Virtual Cues…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Zhaofeng Hu , Sifan Zhou , Zhihang Yuan , Dawei Yang , Shibo Zhao , Ci-Jyun Liang

Accurate tracking of transparent objects, such as glasses, plays a critical role in many robotic tasks such as robot-assisted living. Due to the adaptive and often reflective texture of such objects, traditional tracking algorithms that…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Kalyan Garigapati , Erik Blasch , Jie Wei , Haibin Ling

Single Object Tracking in LiDAR point cloud is one of the most essential parts of environmental perception, in which small objects are inevitable in real-world scenarios and will bring a significant barrier to the accurate location.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Shengjing Tian , Yinan Han , Xiuping Liu , Xiantong Zhao

Object tracking and 3D reconstruction are often performed together, with tracking used as input for reconstruction. However, the obtained reconstructions also provide useful information for improving tracking. We propose a novel method that…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Jonathon Luiten , Tobias Fischer , Bastian Leibe

LIDAR point clouds and RGB-images are both extremely essential for 3D object detection. So many state-of-the-art 3D detection algorithms dedicate in fusing these two types of data effectively. However, their fusion methods based on Birds…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Liang Xie , Chao Xiang , Zhengxu Yu , Guodong Xu , Zheng Yang , Deng Cai , Xiaofei He

Multi-modal fusion is increasingly being used for autonomous driving tasks, as different modalities provide unique information for feature extraction. However, the existing two-stream networks are only fused at a specific network layer,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yan Gong , Xinyu Zhang , Hao Liu , Xinmin Jiang , Zhiwei Li , Xin Gao , Lei Lin , Dafeng Jin , Jun Li , Huaping Liu

Siamese network based trackers formulate 3D single object tracking as cross-correlation learning between point features of a template and a search area. Due to the large appearance variation between the template and search area during…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Le Hui , Lingpeng Wang , Linghua Tang , Kaihao Lan , Jin Xie , Jian Yang

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Mengya Zhang , Cheng Li , Chenglong Li , Jin Tang

Visual-based target tracking is easily influenced by multiple factors, such as background clutter, targets fast-moving, illumination variation, object shape change, occlusion, etc. These factors influence the tracking accuracy of a target…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Yanyan Liu , Changcheng Pan , Minglin Bie , Jin Li

3D multi-object tracking (MOT) is a key problem for autonomous vehicles, required to perform well-informed motion planning in dynamic environments. Particularly for densely occupied scenes, associating existing tracks to new detections…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 John Willes , Cody Reading , Steven L. Waslander

State-of-the-art LiDAR-camera 3D object detectors usually focus on feature fusion. However, they neglect the factor of depth while designing the fusion strategy. In this work, we are the first to observe that different modalities play…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mingqian Ji , Jian Yang , Shanshan Zhang

With the advancement of IoT and artificial intelligence technologies, and the need for rapid application growth in fields such as security entrance control and financial business trade, facial information processing has become an important…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Tianping Li , Zhifeng Liu , Jianping Qiao

Most modern multiple object tracking (MOT) systems follow the tracking-by-detection paradigm, consisting of a detector followed by a method for associating detections into tracks. There is a long history in tracking of combining motion and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Mohamed Chaabane , Peter Zhang , J. Ross Beveridge , Stephen O'Hara

3D single object tracking plays an essential role in many applications, such as autonomous driving. It remains a challenging problem due to the large appearance variation and the sparsity of points caused by occlusion and limited sensor…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Tian-Xing Xu , Yuan-Chen Guo , Yu-Kun Lai , Song-Hai Zhang