English
Related papers

Related papers: RCBEVDet++: Toward High-accuracy Radar-Camera Fusi…

200 papers

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

The integration of complementary characteristics from camera and radar data has emerged as an effective approach in 3D object detection. However, such fusion-based methods remain unexplored for place recognition, an equally important task…

Robotics · Computer Science 2024-03-25 Shaowei Fu , Yifan Duan , Yao Li , Chengzhen Meng , Yingjie Wang , Jianmin Ji , Yanyong Zhang

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xiaokai Bai , Lianqing Zheng , Si-Yuan Cao , Xiaohan Zhang , Zhe Wu , Beinan Yu , Fang Wang , Jie Bai , Hui-Liang Shen

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

In human-centered environments such as restaurants, homes, and warehouses, robots often face challenges in accurately recognizing 3D objects. These challenges stem from the complexity and variability of these environments, including diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Songsong Xiong , Hamidreza Kasaei

Camouflaged object detection (COD) presents a persistent challenge in accurately identifying objects that seamlessly blend into their surroundings. However, most existing COD models overlook the fact that visual systems operate within a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Xinran Liua , Lin Qia , Yuxuan Songa , Qi Wen

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

Camera-radar fusion offers a robust and cost-effective alternative to LiDAR-based autonomous driving systems by combining complementary sensing capabilities: cameras provide rich semantic cues but unreliable depth, while radar delivers…

In this work, we present SpaRC, a novel Sparse fusion transformer for 3D perception that integrates multi-view image semantics with Radar and Camera point features. The fusion of radar and camera modalities has emerged as an efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Philipp Wolters , Johannes Gilg , Torben Teepe , Fabian Herzog , Felix Fent , Gerhard Rigoll

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

Recently, 3D object detection has attracted significant attention and achieved continuous improvement in real road scenarios. The environmental information is collected from a single sensor or multi-sensor fusion to detect interested…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Hongwei Liu , Jian Yang , Jianfeng Zhang , Dongheng Shao , Jielong Guo , Shaobo Li , Xuan Tang , Xian Wei

Radar has shown strong potential for robust perception in autonomous driving; however, raw radar images are frequently degraded by noise and "ghost" artifacts, making object detection based solely on semantic features highly challenging. To…

Robotics · Computer Science 2025-09-23 Shuocheng Yang , Zikun Xu , Jiahao Wang , Shahid Nawaz , Jianqiang Wang , Shaobing Xu

In this work, we propose \textit{MVFuseNet}, a novel end-to-end method for joint object detection and motion forecasting from a temporal sequence of LiDAR data. Most existing methods operate in a single view by projecting data in either…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Ankit Laddha , Shivam Gautam , Stefan Palombo , Shreyash Pandey , Carlos Vallespi-Gonzalez

Camera and radar sensors have significant advantages in cost, reliability, and maintenance compared to LiDAR. Existing fusion methods often fuse the outputs of single modalities at the result-level, called the late fusion strategy. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Youngseok Kim , Sanmin Kim , Jun Won Choi , Dongsuk Kum

Utilizing the latest advances in Artificial Intelligence (AI), the computer vision community is now witnessing an unprecedented evolution in all kinds of perception tasks, particularly in object detection. Based on multiple spatially…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zhengwei Bai , Guoyuan Wu , Matthew J. Barth , Yongkang Liu , Emrah Akin Sisbot , Kentaro Oguchi

Multi-modal sensor fusion in Bird's Eye View (BEV) representation has become the leading approach for 3D object detection. However, existing methods often rely on depth estimators or transformer encoders to transform image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yongjin Lee , Hyeon-Mun Jeong , Yurim Jeon , Sanghyun Kim

Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hazem Rashed , Mariam Essam , Maha Mohamed , Ahmad El Sallab , Senthil Yogamani