English
Related papers

Related papers: BEVMOSNet: Multimodal Fusion for BEV Moving Object…

200 papers

Road intersection monitoring and control research often utilize bird's eye view (BEV) simulators. In real traffic settings, achieving a BEV akin to that in a simulator necessitates the deployment of drones or specific sensor mounting, which…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Rukesh Prajapati , Amr S. El-Wakeel

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aware manner. To this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kamil Kowol , Matthias Rottmann , Stefan Bracke , Hanno Gottschalk

Reliable dynamic object detection in cluttered environments remains a critical challenge for autonomous navigation. Purely geometric LiDAR pipelines that rely on clustering and heuristic filtering can miss dynamic obstacles when they move…

Robotics · Computer Science 2026-03-18 Juan Rached , Yixuan Jia , Kota Kondo , Jonathan P. How

Accurate environment perception is essential for automated driving. When using monocular cameras, the distance estimation of elements in the environment poses a major challenge. Distances can be more easily estimated when the camera…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Lennart Reiher , Bastian Lampe , Lutz Eckstein

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Accurate 3D object detection in autonomous driving relies on Bird's Eye View (BEV) perception and effective temporal fusion. However, existing fusion strategies based on convolutional layers or deformable self-attention struggle to model…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zihan You , Ni Wang , Hao Wang , Qichao Zhao , Jinxiang Wang

Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chunyong Hu , Hang Zheng , Kun Li , Jianyun Xu , Weibo Mao , Maochun Luo , Lingxuan Wang , Mingxia Chen , Qihao Peng , Kaixuan Liu , Yiru Zhao , Peihan Hao , Minzhe Liu , Kaicheng Yu

3D object detection is essential for autonomous driving. As an emerging sensor, 4D imaging radar offers advantages as low cost, long-range detection, and accurate velocity measurement, making it highly suitable for object detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Reliable autonomous driving systems require accurate detection of traffic participants. To this end, multi-modal fusion has emerged as an effective strategy. In particular, 4D radar and LiDAR fusion methods based on multi-frame radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Xiangyuan Peng , Yu Wang , Miao Tang , Bierzynski Kay , Lorenzo Servadei , Robert Wille

Accurate multi-view 3D object detection is essential for applications such as autonomous driving. Researchers have consistently aimed to leverage LiDAR's precise spatial information to enhance camera-based detectors through methods like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shaoqing Xu , Fang Li , Peixiang Huang , Ziying Song , Zhi-Xin Yang

Autonomous driving requires an accurate and fast 3D perception system that includes 3D object detection, tracking, and segmentation. Although recent low-cost camera-based approaches have shown promising results, they are susceptible to poor…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Youngseok Kim , Juyeb Shin , Sanmin Kim , In-Jae Lee , Jun Won Choi , Dongsuk Kum

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

Accurate object detection and prediction are critical to ensure the safety and efficiency of self-driving architectures. Predicting object trajectories and occupancy enables autonomous vehicles to anticipate movements and make decisions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Luis M. Bergasa , Santiago Montiel-Marín , Rafael Barea , Fabio Sánchez-García , Ángel Llamazares

Bird's-eye-view (BEV) representations are the dominant paradigm for 3D perception in autonomous driving, providing a unified spatial canvas where detection and segmentation features are geometrically registered to the same physical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ahmet İnanç , Özgür Erkent

Determining accurate bird's eye view (BEV) positions of objects and tracks in a scene is vital for various perception tasks including object interactions mapping, scenario extraction etc., however, the level of supervision required to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Paridhi Singh , Gaurav Singh , Arun Kumar

Safe autonomous agents and mobile robots need fast real time 3D perception, especially for vulnerable road users (VRUs) such as pedestrians. We introduce a new bird's eye view (BEV) encoding, which maps the full 3D LiDAR point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mohammad Khoshkdahan , Alexey Vinel

We propose a cross attention transformer based method for multimodal sensor fusion to build a birds eye view of a vessels surroundings supporting safer autonomous marine navigation. The model deeply fuses multiview RGB and long wave…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dimitrios Dagdilelis , Panagiotis Grigoriadis , Roberto Galeazzi

Recent vision-only perception models for autonomous driving achieved promising results by encoding multi-view image features into Bird's-Eye-View (BEV) space. A critical step and the main bottleneck of these methods is transforming image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiayu Yang , Enze Xie , Miaomiao Liu , Jose M. Alvarez

Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition…