English
Related papers

Related papers: Control Your Queries: Heterogeneous Query Interact…

200 papers

We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we design an early fusion…

Robotics · Computer Science 2024-02-20 Jingyu Song , Lingjun Zhao , Katherine A. Skinner

Radars and cameras are mature, cost-effective, and robust sensors and have been widely used in the perception stack of mass-produced autonomous driving systems. Due to their complementary properties, outputs from radar detection (radar…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Xu Dong , Binnan Zhuang , Yunxiang Mao , Langechuan Liu

To track the 3D locations and trajectories of the other traffic participants at any given time, modern autonomous vehicles are equipped with multiple cameras that cover the vehicle's full surroundings. Yet, camera-based 3D object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Tobias Fischer , Yung-Hsu Yang , Suryansh Kumar , Min Sun , Fisher Yu

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Jin Fang , Dingfu Zhou , Xibin Song , Liangjun Zhang

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of camera-only solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Nicolas Baumann , Michael Baumgartner , Edoardo Ghignone , Jonas Kühne , Tobias Fischer , Yung-Hsu Yang , Marc Pollefeys , Michele Magno

Sensor fusion of camera, LiDAR, and 4-dimensional (4D) Radar has brought a significant performance improvement in autonomous driving. However, there still exist fundamental challenges: deeply coupled fusion methods assume continuous sensor…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Dong-Hee Paek , Seung-Hyun Kong

When localizing and detecting 3D objects for autonomous driving scenes, obtaining information from multiple sensor (e.g. camera, LIDAR) typically increases the robustness of 3D detectors. However, the efficient and effective fusion of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

With the rapid advancement of autonomous driving technology, there is a growing need for enhanced safety and efficiency in the automatic environmental perception of vehicles during their operation. In modern vehicle setups, cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Di Wu , Feng Yang , Benlian Xu , Pan Liao , Bo Liu

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

Safety and reliability are crucial for the public acceptance of autonomous driving. To ensure accurate and reliable environmental perception, intelligent vehicles must exhibit accuracy and robustness in various environments. Millimeter-wave…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Yue Sun , Yeqiang Qian , Chunxiang Wang , Ming Yang

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

Multi-modal 3D object detection has been an active research topic in autonomous driving. Nevertheless, it is non-trivial to explore the cross-modal feature fusion between sparse 3D points and dense 2D pixels. Recent approaches either fuse…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Xin Li , Botian Shi , Yuenan Hou , Xingjiao Wu , Tianlong Ma , Yikang Li , Liang He

Recently, camera-radar fusion-based 3D object detection methods in bird's eye view (BEV) have gained attention due to the complementary characteristics and cost-effectiveness of these sensors. Previous approaches using forward projection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 In-Jae Lee , Sihwan Hwang , Youngseok Kim , Wonjune Kim , Sanmin Kim , Dongsuk Kum

To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may require significant…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Jingda Guo , Dominic Carrillo , Sihai Tang , Qi Chen , Qing Yang , Song Fu , Xi Wang , Nannan Wang , Paparao Palacharla

In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-art single-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sheng-Yao Kuan , Jen-Hao Cheng , Hsiang-Wei Huang , Wenhao Chai , Cheng-Yen Yang , Hugo Latapie , Gaowen Liu , Bing-Fei Wu , Jenq-Neng Hwang

As one of the automotive sensors that have emerged in recent years, 4D millimeter-wave radar has a higher resolution than conventional 3D radar and provides precise elevation measurements. But its point clouds are still sparse and noisy,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hongsi Liu , Jun Liu , Guangfeng Jiang , Xin Jin