English
Related papers

Related papers: Efficient and Robust 2D-to-BEV Representation Lear…

200 papers

Modern methods for vision-centric autonomous driving perception widely adopt the bird's-eye-view (BEV) representation to describe a 3D scene. Despite its better efficiency than voxel representation, it has difficulty describing the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yuanhui Huang , Wenzhao Zheng , Yunpeng Zhang , Jie Zhou , Jiwen Lu

3D object detection is vital for many robotics applications. For tasks where a 2D perspective range image exists, we propose to learn a 3D representation directly from this range image view. To this end, we designed a 2D convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Yuning Chai , Pei Sun , Jiquan Ngiam , Weiyue Wang , Benjamin Caine , Vijay Vasudevan , Xiao Zhang , Dragomir Anguelov

Most existing works solving Room-to-Room VLN problem only utilize RGB images and do not consider local context around candidate views, which lack sufficient visual cues about surrounding environment. Moreover, natural language contains…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyang Huo , Qiang Sun , Boyan Jiang , Haitao Lin , Yanwei Fu

Bird's-Eye View (BEV) features are popular intermediate scene representations shared by the 3D backbone and the detector head in LiDAR-based object detectors. However, little research has been done to investigate how to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Haitao Yang , Zaiwei Zhang , Xiangru Huang , Min Bai , Chen Song , Bo Sun , Li Erran Li , Qixing Huang

Self-supervised learning has made substantial strides in image processing, while visual pre-training for autonomous driving is still in its infancy. Existing methods often focus on learning geometric scene information while neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Shaoqing Xu , Fang Li , Shengyin Jiang , Ziying Song , Li Liu , Zhi-xin Yang

Current video coding standards, including H.264/AVC, HEVC, and VVC, employ discrete cosine transform (DCT), discrete sine transform (DST), and secondary to Karhunen-Loeve transforms (KLTs) decorrelate the intra-prediction residuals.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Wen-Yang Lu , Eduardo Pavez , Antonio Ortega , Xin Zhao , Shan Liu

Cross-view geo-localization for Unmanned Aerial Vehicles (UAVs) operating in GNSS-denied environments remains challenging due to the severe geometric discrepancy between oblique UAV imagery and orthogonal satellite maps. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Haoyuan Li , Wen Yang , Fang Xu , Hong Tan , Haijian Zhang , Shengyang Li , Gui-Song Xia

Feed-forward surround-view autonomous driving scene reconstruction offers fast, generalizable inference ability, which faces the core challenge of ensuring generalization while elevating novel view quality. Due to the surround-view with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Junhong Lin , Kangli Wang , Shunzhou Wang , Songlin Fan , Ge Li , Wei Gao

Semantic segmentation in bird's eye view (BEV) is an important task for autonomous driving. Though this task has attracted a large amount of research efforts, it is still challenging to flexibly cope with arbitrary (single or multiple)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Lang Peng , Zhirong Chen , Zhangjie Fu , Pengpeng Liang , Erkang Cheng

Bird's Eye View (BEV) map prediction is essential for downstream autonomous driving tasks like trajectory prediction. In the past, this was accomplished through the use of a sophisticated sensor configuration that captured a surround view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Daniel Busch , Ido Freeman , Richard Meyes , Tobias Meisen

Road intersection monitoring and control research often utilize bird's eye view (BEV) simulators. In real traffic settings, achieving a BEV akin to that in a simulator necessitates the deployment of drones or specific sensor mounting, which…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Rukesh Prajapati , Amr S. El-Wakeel

Safe autonomous agents and mobile robots need fast real time 3D perception, especially for vulnerable road users (VRUs) such as pedestrians. We introduce a new bird's eye view (BEV) encoding, which maps the full 3D LiDAR point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mohammad Khoshkdahan , Alexey Vinel

Cross-view image matching for geo-localisation is a challenging problem due to the significant visual difference between aerial and ground-level viewpoints. The method provides localisation capabilities from geo-referenced images,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Tavis Shore , Simon Hadfield , Oscar Mendez

Being able to generate realistic trajectory options is at the core of increasing the degree of automation of road vehicles. While model-driven, rule-based, and classical learning-based methods are widely used to tackle these tasks at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Annajoyce Mariani , Kira Maag , Hanno Gottschalk

Recent advancements in diffusion models have significantly enhanced the data synthesis with 2D control. Yet, precise 3D control in street view generation, crucial for 3D perception tasks, remains elusive. Specifically, utilizing Bird's-Eye…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Ruiyuan Gao , Kai Chen , Enze Xie , Lanqing Hong , Zhenguo Li , Dit-Yan Yeung , Qiang Xu

Extracting a Bird's Eye View (BEV) representation from multiple camera images offers a cost-effective, scalable alternative to LIDAR-based solutions in autonomous driving. However, the performance of the existing BEV methods drops…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Merve Rabia Barın , Görkay Aydemir , Fatma Güney

Integrating LiDAR and camera information into Bird's-Eye-View (BEV) representation has emerged as a crucial aspect of 3D object detection in autonomous driving. However, existing methods are susceptible to the inaccurate calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziying Song , Lei Yang , Shaoqing Xu , Lin Liu , Dongyang Xu , Caiyan Jia , Feiyang Jia , Li Wang

Bird's-eye view (BEV) maps are an important geometrically structured representation widely used in robotics, in particular self-driving vehicles and terrestrial robots. Existing algorithms either require depth information for the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Gianluca Monaci , Leonid Antsfeld , Boris Chidlovskii , Christian Wolf

With the prevalence of LiDAR sensors in autonomous driving, 3D object tracking has received increasing attention. In a point cloud sequence, 3D object tracking aims to predict the location and orientation of an object in consecutive frames…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhipeng Luo , Changqing Zhou , Liang Pan , Gongjie Zhang , Tianrui Liu , Yueru Luo , Haiyu Zhao , Ziwei Liu , Shijian Lu

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu