English
Related papers

Related papers: MSF3DDETR: Multi-Sensor Fusion 3D Detection Transf…

200 papers

Point clouds and images could provide complementary information when representing 3D objects. Fusing the two kinds of data usually helps to improve the detection results. However, it is challenging to fuse the two data modalities, due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Xun Tan , Xingyu Chen , Guowei Zhang , Jishiyu Ding , Xuguang Lan

The emerging 4D millimeter-wave radar, measuring the range, azimuth, elevation, and Doppler velocity of objects, is recognized for its cost-effectiveness and robustness in autonomous driving. Nevertheless, its point clouds exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yuzhi Wu , Li Xiao , Jun Liu , Guangfeng Jiang , XiangGen Xia

DETR-based methods, which use multi-layer transformer decoders to refine object queries iteratively, have shown promising performance in 3D indoor object detection. However, the scene point features in the transformer decoder remain fixed,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chuxin Wang , Wenfei Yang , Xiang Liu , Tianzhu Zhang

Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar fusion solution for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Su Pang , Daniel Morris , Hayder Radha

3D object detection in point cloud data remains a challenging task due to the sparsity and lack of global structure inherent in the input. In this work, we propose a novel Multi-Scale Attention (MSA) mechanism integrated into the 3DETR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mustaqeem Khan , Aidana Nurakhmetova , Wail Gueaieb , Abdulmotaleb El Saddik

Camera, LiDAR and radar are common perception sensors for autonomous driving tasks. Robust prediction of 3D object detection is optimally based on the fusion of these sensors. To exploit their abilities wisely remains a challenge because…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ziang Guo , Zakhar Yagudin , Selamawit Asfaw , Artem Lykov , Dzmitry Tsetserukou

Infrared-visible object detection aims to achieve robust object detection by leveraging the complementary information of infrared and visible image pairs. However, the commonly existing modality misalignment problem presents two challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Junjie Guo , Chenqiang Gao , Fangcen Liu , Deyu Meng

Camera and LiDAR sensor modalities provide complementary appearance and geometric information useful for detecting 3D objects for autonomous vehicle applications. However, current end-to-end fusion methods are challenging to train and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Anas Mahmoud , Jordan S. K. Hu , Steven L. Waslander

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Object detection has recently seen an interesting trend in terms of the most innovative research work, this task being of particular importance in the field of remote sensing, given the consistency of these images in terms of geographical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Anasse Boutayeb , Iyad Lahsen-cherif , Ahmed El Khadimi

This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Gustavo A. Salazar-Gomez , Miguel A. Saavedra-Ruiz , Victor A. Romero-Cano

Object detection with Transformers (DETR) has achieved a competitive performance over traditional detectors, such as Faster R-CNN. However, the potential of DETR remains largely unexplored for the more challenging task of arbitrary-oriented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Teli Ma , Mingyuan Mao , Honghui Zheng , Peng Gao , Xiaodi Wang , Shumin Han , Errui Ding , Baochang Zhang , David Doermann

In human-centered environments such as restaurants, homes, and warehouses, robots often face challenges in accurately recognizing 3D objects. These challenges stem from the complexity and variability of these environments, including diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Songsong Xiong , Hamidreza Kasaei

Compared to monocular 3D object detection, stereo-based 3D methods offer significantly higher accuracy but still suffer from high computational overhead and latency. The state-of-the-art stereo 3D detection method achieves twice the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shiyi Mu , Zichong Gu , Zhiqi Ai , Anqi Liu , Yilin Gao , Shugong Xu

Supervised 3D Object Detection models have been displaying increasingly better performance in single-domain cases where the training data comes from the same environment and sensor as the testing data. However, in real-world scenarios data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Louis Soum-Fontez , Jean-Emmanuel Deschaud , François Goulette

Light Detection And Ranging (LiDAR) has been widely used in autonomous vehicles for perception and localization. However, the cost of a high-resolution LiDAR is still prohibitively expensive, while its low-resolution counterpart is much…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Lin Bai , Yiming Zhao , Xinming Huang

The DEtection TRansformer (DETR) opened new possibilities for object detection by modeling it as a translation task: converting image features into object-level representations. Previous works typically add expensive modules to DETR to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Pierre-François De Plaen , Nicola Marinello , Marc Proesmans , Tinne Tuytelaars , Luc Van Gool

DETR is a recently proposed Transformer-based method which views object detection as a set prediction problem and achieves state-of-the-art performance but demands extra-long training time to converge. In this paper, we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Zhiqing Sun , Shengcao Cao , Yiming Yang , Kris Kitani

Monocular 3D object detection is very challenging in autonomous driving due to the lack of depth information. This paper proposes a one-stage monocular 3D object detection algorithm based on multi-scale depth stratification, which uses the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Zhouzhen Xie , Yuying Song , Jingxuan Wu , Zecheng Li , Chunyi Song , Zhiwei Xu

There has been significant progress made in the field of autonomous vehicles. Object detection and tracking are the primary tasks for any autonomous vehicle. The task of object detection in autonomous vehicles relies on a variety of sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Gaurav Raut , Advait Patole