English
Related papers

Related papers: TransFusion: Robust LiDAR-Camera Fusion for 3D Obj…

200 papers

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jyh-Jing Hwang , Henrik Kretzschmar , Joshua Manela , Sean Rafferty , Nicholas Armstrong-Crews , Tiffany Chen , Dragomir Anguelov

This paper presents Camera-LiDAR Fusion Transformer (CLFT) models for traffic object segmentation, which leverage the fusion of camera and LiDAR data using vision transformers. Building on the methodology of visual transformers that exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Toomas Tahves , Junyi Gu , Mauro Bellone , Raivo Sell

The strong demand of autonomous driving in the industry has lead to strong interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Zhenxun Yuan , Xiao Song , Lei Bai , Wengang Zhou , Zhe Wang , Wanli Ouyang

Cooperative perception allows connected vehicles and roadside infrastructure to share sensor observations, creating a fused scene representation beyond the capability of any single platform. However, most cooperative 3D object detectors use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Blessing Agyei Kyem , Joshua Kofi Asamoah , Armstrong Aboah

Despite significant progress in autonomous navigation, a critical gap remains in ensuring reliable localization in hazardous environments such as tunnels, urban disaster zones, and underground structures. Tunnels present a uniquely…

Robotics · Computer Science 2025-05-07 Lukas Schichler , Karin Festl , Selim Solmaz , Daniel Watzenig

Safety and reliability are crucial for the public acceptance of autonomous driving. To ensure accurate and reliable environmental perception, intelligent vehicles must exhibit accuracy and robustness in various environments. Millimeter-wave…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Yue Sun , Yeqiang Qian , Chunxiang Wang , Ming Yang

Modern autonomous vehicles rely heavily on mechanical LiDARs for perception. Current perception methods generally require 360{\deg} point clouds, collected sequentially as the LiDAR scans the azimuth and acquires consecutive wedge-shaped…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mazen Abdelfattah , Kaiwen Yuan , Z. Jane Wang , Rabab Ward

State-of-the-art lidar-based 3D object detection methods rely on supervised learning and large labeled datasets. However, annotating lidar data is resource-consuming, and depending only on supervised learning limits the applicability of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ekim Yurtsever , Emeç Erçelik , Mingyu Liu , Zhijie Yang , Hanzhen Zhang , Pınar Topçam , Maximilian Listl , Yılmaz Kaan Çaylı , Alois Knoll

3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest. Various 3D object detection methods have relied on fusion of different sensor…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Eduardo Arnold , Mehrdad Dianati , Robert de Temple , Saber Fallah

Aiming at highly accurate object detection for connected and automated vehicles (CAVs), this paper presents a Deep Neural Network based 3D object detection model that leverages a three-stage feature extractor by developing a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yiming Hou , Mahdi Rezaei , Richard Romano

Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Huafeng Liu , Yazhou Yao , Zeren Sun , Xiangrui Li , Ke Jia , Zhenmin Tang

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

We propose a late-to-early recurrent feature fusion scheme for 3D object detection using temporal LiDAR point clouds. Our main motivation is fusing object-aware latent embeddings into the early stages of a 3D object detector. This feature…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Tong He , Pei Sun , Zhaoqi Leng , Chenxi Liu , Dragomir Anguelov , Mingxing Tan

Multi-modal methods based on camera and LiDAR sensors have garnered significant attention in the field of 3D detection. However, many prevalent works focus on single or partial stage fusion, leading to insufficient feature extraction and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zhiwei Ning , Zhaojiang Liu , Xuanang Gao , Yifan Zuo , Jie Yang , Yuming Fang , Wei Liu

In autonomous driving, LiDAR and radar are crucial for environmental perception. LiDAR offers precise 3D spatial sensing information but struggles in adverse weather like fog. Conversely, radar signals can penetrate rain or mist due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yanlong Yang , Jianan Liu , Tao Huang , Qing-Long Han , Gang Ma , Bing Zhu

We propose Radar-Camera fusion transformer (RaCFormer) to boost the accuracy of 3D object detection by the following insight. The Radar-Camera fusion in outdoor 3D scene perception is capped by the image-to-BEV transformation--if the depth…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaomeng Chu , Jiajun Deng , Guoliang You , Yifan Duan , Houqiang Li , Yanyong Zhang

Robust 3D object detection in extreme weather and illumination conditions is a challenging task. While radars and thermal cameras are known for their resilience to these conditions, few studies have been conducted on radar-thermal fusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Qiao Yan , Yihan Wang

Multi-sensor fusion (MSF) is widely used in autonomous vehicles (AVs) for perception, particularly for 3D object detection with camera and LiDAR sensors. The purpose of fusion is to capitalize on the advantages of each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhiyuan Cheng , Hongjun Choi , James Liang , Shiwei Feng , Guanhong Tao , Dongfang Liu , Michael Zuzak , Xiangyu Zhang