English
Related papers

Related papers: 3D-CVF: Generating Joint Camera and LiDAR Features…

200 papers

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

In autonomous driving, 3D object detection is essential for accurate perception and reliable decision-making. However, object motion and ego-motion often induce cross-frame spatiotemporal inconsistencies in BEV-based detectors, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenxuan Li , Qin Zou , Shoubing Chen , Chi Chen , Yingyi Yang , Shoubing Chen , Qingxiang Meng

Camera-radar fusion offers a robust and low-cost alternative to Camera-lidar fusion for the 3D object detection task in real-time under adverse weather and lighting conditions. However, currently, in the literature, it is possible to find…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Ruan Bispo , Dane Mitrev , Letizia Mariotti , Clément Botty , Denver Humphrey , Anthony Scanlan , Ciarán Eising

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

We present a simple yet effective fully convolutional one-stage 3D object detector for LiDAR point clouds of autonomous driving scenes, termed FCOS-LiDAR. Unlike the dominant methods that use the bird-eye view (BEV), our proposed detector…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Zhi Tian , Xiangxiang Chu , Xiaoming Wang , Xiaolin Wei , Chunhua Shen

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

Infrared-visible image fusion aims to integrate infrared and visible information into a single fused image. Existing 2D fusion methods focus on fusing images from fixed camera viewpoints, neglecting a comprehensive understanding of complex…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Chao Yang , Deshui Miao , Chao Tian , Guoqing Zhu , Yameng Gu , Zhenyu He

Accurate point-wise velocity estimation in 3D is crucial for robot interaction with non-rigid dynamic agents, enabling robust performance in path planning, collision avoidance, and object manipulation in dynamic environments. To this end,…

Robotics · Computer Science 2026-04-13 Landson Guo , Andres M. Diaz Aguilar , William Talbot , Turcan Tuna , Marco Hutter , Cesar Cadena

Vehicle-to-Infrastructure (V2I) collaborative perception leverages data collected by infrastructure's sensors to enhance vehicle perceptual capabilities. LiDAR, as a commonly used sensor in cooperative perception, is widely equipped in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Xinxin Feng , Haoran Sun , Haifeng Zheng

In this work, we present SpaRC, a novel Sparse fusion transformer for 3D perception that integrates multi-view image semantics with Radar and Camera point features. The fusion of radar and camera modalities has emerged as an efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Philipp Wolters , Johannes Gilg , Torben Teepe , Fabian Herzog , Felix Fent , Gerhard Rigoll

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong

Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yubo Cui , Zheng Fang , Jiayao Shan , Zuoxu Gu , Sifan Zhou

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

LiDAR sensors can be used to obtain a wide range of measurement signals other than a simple 3D point cloud, and those signals can be leveraged to improve perception tasks like 3D object detection. A single laser pulse can be partially…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yunze Man , Xinshuo Weng , Prasanna Kumar Sivakuma , Matthew O'Toole , Kris Kitani

Structure from Motion (SfM) often fails to estimate accurate poses in environments that lack suitable visual features. In such cases, the quality of the final 3D mesh, which is contingent on the accuracy of those estimates, is reduced. One…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Victor Amblard , Timothy P. Osedach , Arnaud Croux , Andrew Speck , John J. Leonard

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration.…

Robotics · Computer Science 2023-11-09 Dan Shen , Zhengming Zhang , Renran Tian , Yaobin Chen , Rini Sherony

LiDAR-based 3D object detection presents significant challenges due to the inherent sparsity of LiDAR points. A common solution involves long-term temporal LiDAR data to densify the inputs. However, efficiently leveraging spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chaoqun Wang , Xiaobin Hong , Wenzhong Li , Ruimao Zhang