English
Related papers

Related papers: RoScenes: A Large-scale Multi-view 3D Dataset for …

200 papers

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

While recent low-cost radar-camera approaches have shown promising results in multi-modal 3D object detection, both sensors face challenges from environmental and intrinsic disturbances. Poor lighting or adverse weather conditions degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Jingtong Yue , Zhiwei Lin , Xin Lin , Xiaoyu Zhou , Xiangtai Li , Lu Qi , Yongtao Wang , Ming-Hsuan Yang

Detecting diverse objects within complex indoor 3D point clouds presents significant challenges for robotic perception, particularly with varied object shapes, clutter, and the co-existence of static and dynamic elements where traditional…

Robotics · Computer Science 2025-07-24 Haichuan Li , Changda Tian , Panos Trahanias , Tomi Westerlund

The application of vision-based multi-view environmental perception system has been increasingly recognized in autonomous driving technology, especially the BEV-based models. Current state-of-the-art solutions primarily encode image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Di Wu , Feng Yang , Benlian Xu , Pan Liao , Wenhui Zhao , Dingwen Zhang

Accurate 3D trajectory data is crucial for advancing autonomous driving. Yet, traditional datasets are usually captured by fixed sensors mounted on a car and are susceptible to occlusion. Additionally, such an approach can precisely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Oussema Dhaouadi , Johannes Meier , Luca Wahl , Jacques Kaiser , Luca Scalerandi , Nick Wandelburg , Zhuolun Zhou , Nijanthan Berinpanathan , Holger Banzhaf , Daniel Cremers

We introduce Argoverse 2 (AV2) - a collection of three datasets for perception and forecasting research in the self-driving domain. The annotated Sensor Dataset contains 1,000 sequences of multimodal data, encompassing high-resolution…

In this paper, we introduce a novel benchmark designed to propel the advancement of general-purpose, large-scale 3D vision models for remote sensing imagery. While several datasets have been proposed within the realm of remote sensing, many…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jiayu Wang , Ruizhi Wang , Jie Song , Haofei Zhang , Mingli Song , Zunlei Feng , Li Sun

Although multi-view 3D object detection based on the Bird's-Eye-View (BEV) paradigm has garnered widespread attention as an economical and deployment-friendly perception solution for autonomous driving, there is still a performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zheng Jiang , Jinqing Zhang , Yanan Zhang , Qingjie Liu , Zhenghui Hu , Baohui Wang , Yunhong Wang

3D lane detection which plays a crucial role in vehicle routing, has recently been a rapidly developing topic in autonomous driving. Previous works struggle with practicality due to their complicated spatial transformations and inflexible…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ruihao Wang , Jian Qin , Kaiying Li , Yaochen Li , Dong Cao , Jintao Xu

Occlusion presents a significant challenge for safety-critical applications such as autonomous driving. Collaborative perception has recently attracted a large research interest thanks to the ability to enhance the perception of autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Minh-Quan Dao , Holger Caesar , Julie Stephany Berrio , Mao Shan , Stewart Worrall , Vincent Frémont , Ezio Malis

Bird's-eye View (BeV) representations have emerged as the de-facto shared space in driving applications, offering a unified space for sensor data fusion and supporting various downstream tasks. However, conventional models use grids with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Loick Chambon , Eloi Zablocki , Mickael Chen , Florent Bartoccioni , Patrick Perez , Matthieu Cord

3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird's-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zijian Zhu , Yichi Zhang , Hai Chen , Yinpeng Dong , Shu Zhao , Wenbo Ding , Jiachen Zhong , Shibao Zheng

Vehicle localization using roadside LiDARs can provide centimeter-level accuracy for cloud-controlled vehicles while simultaneously serving multiple vehicles, enhanc-ing safety and efficiency. While most existing studies rely on repetitive…

Robotics · Computer Science 2025-09-22 Runxin Zhao , Chunxiang Wang , Hanyang Zhuang , Ming Yang

Understanding road geometry is a critical component of the autonomous vehicle (AV) stack. While high-definition (HD) maps can readily provide such information, they suffer from high labeling and maintenance costs. Accordingly, many recent…

Robotics · Computer Science 2024-07-10 Xunjiang Gu , Guanyu Song , Igor Gilitschenski , Marco Pavone , Boris Ivanovic

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

A recent sensor fusion in a Bird's Eye View (BEV) space has shown its utility in various tasks such as 3D detection, map segmentation, etc. However, the approach struggles with inaccurate camera BEV estimation, and a perception of distant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Minsu Kim , Giseop Kim , Kyong Hwan Jin , Sunwook Choi

Accurate motion understanding of the dynamic objects within the scene in bird's-eye-view (BEV) is critical to ensure a reliable obstacle avoidance system and smooth path planning for autonomous vehicles. However, this task has received…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hiep Truong Cong , Ajay Kumar Sigatapu , Arindam Das , Yashwanth Sharma , Venkatesh Satagopan , Ganesh Sistu , Ciaran Eising

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

Traffic scene perception in computer vision is a critically important task to achieve intelligent cities. To date, most existing datasets focus on autonomous driving scenes. We observe that the models trained on those driving datasets often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Peng-Tao Jiang , Yuqi Yang , Yang Cao , Qibin Hou , Ming-Ming Cheng , Chunhua Shen