English
Related papers

Related papers: SAMFusion: Sensor-Adaptive Multimodal Fusion for 3…

200 papers

Sensor fusion is crucial for an accurate and robust perception system on autonomous vehicles. Most existing datasets and perception solutions focus on fusing cameras and LiDAR. However, the collaboration between camera and radar is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhou Wang , Jen-Hao Cheng , Jui-Te Huang , Sheng-Yao Kuan , Qiqian Fu , Chiming Ni , Shengyu Hao , Gaoang Wang , Guanbin Xing , Hui Liu , Jenq-Neng Hwang

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Existing multi-modal 3D detection models usually involve customized designs depending on the sensor combinations or setups. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Xuanyao Chen , Tianyuan Zhang , Yue Wang , Yilun Wang , Hang Zhao

Adverse conditions like snow, rain, nighttime, and fog, pose challenges for autonomous driving perception systems. Existing methods have limited effectiveness in improving essential computer vision tasks, such as semantic segmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Chenghao Qian , Mahdi Rezaei , Saeed Anwar , Wenjing Li , Tanveer Hussain , Mohsen Azarmi , Wei Wang

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Shaoqing Xu , Dingfu Zhou , Jin Fang , Junbo Yin , Zhou Bin , Liangjun Zhang

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

Due to the trending need of building autonomous robotic perception system, sensor fusion has attracted a lot of attention amongst researchers and engineers to make best use of cross-modality information. However, in order to build a robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Apoorv Singh

In the field of autonomous driving, camera-based perception models are mostly trained on clear weather data. Models that focus on addressing specific weather challenges are unable to adapt to various weather changes and primarily prioritize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Aiyinsi Zuo , Zhaoliang Zheng

Reliable and precise detection of small and irregular objects, such as meteor fragments and rocks, is critical for autonomous navigation and operation in lunar surface exploration. Existing multimodal 3D perception methods designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xin Chen , Kang Luo , Yangyi Xiao , Hesheng Wang

A significant challenge in object detection is accurate identification of an object's position in image space, whereas one algorithm with one set of parameters is usually not enough, and the fusion of multiple algorithms and/or parameters…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Pan Wei , John E. Ball , Derek T. Anderson

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Precise and prompt identification of road surface conditions enables vehicles to adjust their actions, like changing speed or using specific traction control techniques, to lower the chance of accidents and potential danger to drivers and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Adnan Md Tayeb , Mst Ayesha Khatun , Mohtasin Golam , Md Facklasur Rahaman , Ali Aouto , Oroceo Paul Angelo , Minseon Lee , Dong-Seong Kim , Jae-Min Lee , Jung-Hyeon Kim

Depth estimation, essential for autonomous driving, seeks to interpret the 3D environment surrounding vehicles. The development of radar sensors, known for their cost-efficiency and robustness, has spurred interest in radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Huawei Sun , Zixu Wang , Hao Feng , Julius Ott , Lorenzo Servadei , Robert Wille

The vehicle's perception sensors radar, lidar and camera, which must work continuously and without restriction, especially with regard to automated/autonomous driving, can lose performance due to unfavourable weather conditions. This paper…

Robotics · Computer Science 2023-05-03 Fatih Sezgin , Daniel Vriesman , Dagmar Steinhauser , Robert Lugner , Thomas Brandmeier

In autonomous driving, recent research has increasingly focused on collaborative perception based on deep learning to overcome the limitations of individual perception systems. Although these methods achieve high accuracy, they rely on high…

Robotics · Computer Science 2025-07-04 Maryem Fadili , Mohamed Anis Ghaoui , Louis Lecrosnier , Steve Pechberti , Redouane Khemmar

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

Millimeter-wave radar plays a vital role in 3D object detection for autonomous driving due to its all-weather and all-lighting-condition capabilities for perception. However, radar point clouds suffer from pronounced sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zijian Gu , Jianwei Ma , Yan Huang , Honghao Wei , Zhanye Chen , Hui Zhang , Wei Hong

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz