English
Related papers

Related papers: MMDR: A Result Feature Fusion Object Detection App…

200 papers

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

In this paper, we propose a novel and effective Multi-Level Fusion network, named as MLF-DET, for high-performance cross-modal 3D object DETection, which integrates both the feature-level fusion and decision-level fusion to fully utilize…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Zewei Lin , Yanqing Shen , Sanping Zhou , Shitao Chen , Nanning Zheng

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

Object detection is an essential task for autonomous robots operating in dynamic and changing environments. A robot should be able to detect objects in the presence of sensor noise that can be induced by changing lighting conditions for…

Robotics · Computer Science 2019-11-20 Oier Mees , Andreas Eitel , Wolfram Burgard

3D object detection is a significant task for autonomous driving. Recently with the progress of vision transformers, the 2D object detection problem is being treated with the set-to-set loss. Inspired by these approaches on 2D object…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Gopi Krishna Erabati , Helder Araujo

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

Point cloud sequences are commonly used to accurately detect 3D objects in applications such as autonomous driving. Current top-performing multi-frame detectors mostly follow a Detect-and-Fuse framework, which extracts features from each…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Chenhang He , Ruihuang Li , Yabin Zhang , Shuai Li , Lei Zhang

This paper presents a modular lightweight network model for road objects detection, such as car, pedestrian and cyclist, especially when they are far away from the camera and their sizes are small. Great advances have been made for the deep…

Computer Vision and Pattern Recognition · Computer Science 2018-11-19 Sen Cao , Yazhou Liu , Pongsak Lasang , Shengmei Shen

Multi-sensor fusion (MSF) is widely used in autonomous vehicles (AVs) for perception, particularly for 3D object detection with camera and LiDAR sensors. The purpose of fusion is to capitalize on the advantages of each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhiyuan Cheng , Hongjun Choi , James Liang , Shiwei Feng , Guanhong Tao , Dongfang Liu , Michael Zuzak , Xiangyu Zhang

Multi-Modal Object Detection (MMOD), due to its stronger adaptability to various complex environments, has been widely applied in various applications. Extensive research is dedicated to the RGB-IR object detection, primarily focusing on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Tianyi Zhao , Boyang Liu , Yanglei Gao , Yiming Sun , Maoxun Yuan , Xingxing Wei

Camera and LiDAR sensor modalities provide complementary appearance and geometric information useful for detecting 3D objects for autonomous vehicle applications. However, current end-to-end fusion methods are challenging to train and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Anas Mahmoud , Jordan S. K. Hu , Steven L. Waslander

3D object detection serves as the core basis of the perception tasks in autonomous driving. Recent years have seen the rapid progress of multi-modal fusion strategies for more robust and accurate 3D object detection. However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Bingqi Shen , Shuwei Dai , Yuyin Chen , Rong Xiong , Yue Wang , Yanmei Jiao

Cross-modality fusing complementary information of multispectral remote sensing image pairs can improve the perception ability of detection algorithms, making them more robust and reliable for a wider range of applications, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Qingyun Fang , Zhaokui Wang

We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Carlo Sgaravatti , Roberto Basla , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yubo Cui , Zheng Fang , Jiayao Shan , Zuoxu Gu , Sifan Zhou

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering…

Robotics · Computer Science 2024-05-14 Riccardo Pieroni , Simone Specchia , Matteo Corno , Sergio Matteo Savaresi

Multimodal remote sensing object detection aims to achieve more accurate and robust perception under challenging conditions by fusing complementary information from different modalities. However, existing approaches that rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jianhong Han , Yupei Wang , Yuan Zhang , Liang Chen