English
Related papers

Related papers: Collaborative Perceiver: Elevating Vision-based 3D…

200 papers

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

Roadside camera-driven 3D object detection is a crucial task in intelligent transportation systems, which extends the perception range beyond the limitations of vision-centric vehicles and enhances road safety. While previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Hao Shi , Chengshan Pang , Jiaming Zhang , Kailun Yang , Yuhao Wu , Huajian Ni , Yining Lin , Rainer Stiefelhagen , Kaiwei Wang

To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may require significant…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Jingda Guo , Dominic Carrillo , Sihai Tang , Qi Chen , Qing Yang , Song Fu , Xi Wang , Nannan Wang , Paparao Palacharla

Multi-modal sensor fusion in Bird's Eye View (BEV) representation has become the leading approach for 3D object detection. However, existing methods often rely on depth estimators or transformer encoders to transform image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yongjin Lee , Hyeon-Mun Jeong , Yurim Jeon , Sanghyun Kim

3D object detection in driving scenarios faces the challenge of complex road environments, which can lead to the loss or incompleteness of key features, thereby affecting perception performance. To address this issue, we propose an advanced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Wenxuan Li , Qin Zou , Chi Chen , Bo Du , Long Chen , Jian Zhou , Hongkai Yu

Autonomous vehicles may make wrong decisions due to inaccurate detection and recognition. Therefore, an intelligent vehicle can combine its own data with that of other vehicles to enhance perceptive ability, and thus improve detection…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Qi Chen , Sihai Tang , Qing Yang , Song Fu

Cooperative perception enhances the individual perception capabilities of autonomous vehicles (AVs) by providing a comprehensive view of the environment. However, balancing perception performance and transmission costs remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Zhe Wang , Shaocong Xu , Xucai Zhuang , Tongda Xu , Yan Wang , Jingjing Liu , Yilun Chen , Ya-Qin Zhang

Cooperative perception allows connected vehicles and roadside infrastructure to share sensor observations, creating a fused scene representation beyond the capability of any single platform. However, most cooperative 3D object detectors use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Blessing Agyei Kyem , Joshua Kofi Asamoah , Armstrong Aboah

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Camera-based bird-eye-view (BEV) perception paradigm has made significant progress in the autonomous driving field. Under such a paradigm, accurate BEV representation construction relies on reliable depth estimation for multi-camera images.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yang Jiao , Zequn Jie , Shaoxiang Chen , Lechao Cheng , Jingjing Chen , Lin Ma , Yu-Gang Jiang

3D occupancy infers fine-grained 3D geometry and semantics which is critical for autonomous driving. Most existing approaches carry high compute costs, requiring dense 3D feature volume and cross-attention to effectively aggregate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yunxiao Shi , Hong Cai , Jisoo Jeong , Yinhao Zhu , Shizhong Han , Amin Ansari , Fatih Porikli

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

Surrounding perceptions are quintessential for safe driving for connected and autonomous vehicles (CAVs), where the Bird's Eye View has been employed to accurately capture spatial relationships among vehicles. However, severe inherent…

Networking and Internet Architecture · Computer Science 2024-08-22 Zhengru Fang , Senkang Hu , Haonan An , Yuang Zhang , Jingjing Wang , Hangcheng Cao , Xianhao Chen , Yuguang Fang

Existing data collection methods for traffic operations and control usually rely on infrastructure-based loop detectors or probe vehicle trajectories. Connected and automated vehicles (CAVs) not only can report data about themselves but…

Robotics · Computer Science 2022-08-05 Hanlin Chen , Brian Liu , Xumiao Zhang , Feng Qian , Z. Morley Mao , Yiheng Feng

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Zhiqi Li , Wenhai Wang , Hongyang Li , Enze Xie , Chonghao Sima , Tong Lu , Qiao Yu , Jifeng Dai

Modern methods for vision-centric autonomous driving perception widely adopt the bird's-eye-view (BEV) representation to describe a 3D scene. Despite its better efficiency than voxel representation, it has difficulty describing the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yuanhui Huang , Wenzhao Zheng , Yunpeng Zhang , Jie Zhou , Jiwen Lu

Sensor-based perception on vehicles are becoming prevalent and important to enhance the road safety. Autonomous driving systems use cameras, LiDAR, and radar to detect surrounding objects, while human-driven vehicles use them to assist the…

Artificial Intelligence · Computer Science 2020-04-24 Shunsuke Aoki , Takamasa Higuchi , Onur Altintas

Connected Autonomous Vehicles (CAVs) benefit from Vehicle-to-Everything (V2X) communication, which enables the exchange of sensor data to achieve Collaborative Perception (CP). To reduce cumulative errors in perception modules and mitigate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Lei Wan , Hannan Ejaz Keen , Alexey Vinel

3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zeyu Wang , Dingwen Li , Chenxu Luo , Cihang Xie , Xiaodong Yang