English
Related papers

Related papers: Talk2BEV: Language-enhanced Bird's-eye View Maps f…

200 papers

Bird's eye view (BEV) semantic segmentation plays a crucial role in spatial sensing for autonomous driving. Although recent literature has made significant progress on BEV map understanding, they are all based on single-agent camera-based…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Runsheng Xu , Zhengzhong Tu , Hao Xiang , Wei Shao , Bolei Zhou , Jiaqi Ma

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite extensive research…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xinlong Cheng , Lei Li

The rapid development of the autonomous driving industry has led to a significant accumulation of autonomous driving data. Consequently, there comes a growing demand for retrieving data to provide specialized optimization. However, directly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Tao Tang , Dafeng Wei , Zhengyu Jia , Tian Gao , Changwei Cai , Chengkai Hou , Peng Jia , Kun Zhan , Haiyang Sun , Jingchen Fan , Yixing Zhao , Fu Liu , Xiaodan Liang , Xianpeng Lang , Yang Wang

Visual bird's eye view (BEV) perception, due to its excellent perceptual capabilities, is progressively replacing costly LiDAR-based perception systems, especially in the realm of urban intelligent driving. However, this type of perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lei He , Qiaoyi Wang , Honglin Sun , Qing Xu , Bolin Gao , Shengbo Eben Li , Jianqiang Wang , Keqiang Li

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Bird's Eye View (BEV) representations are tremendously useful for perception-related automated driving tasks. However, generating BEVs from surround-view fisheye camera images is challenging due to the strong distortions introduced by such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ekta U. Samani , Feng Tao , Harshavardhan R. Dasari , Sihao Ding , Ashis G. Banerjee

Bird's-Eye-View (BEV) is critical to connected and automated vehicles (CAVs) as it can provide unified and precise representation of vehicular surroundings. However, quality of the raw sensing data may degrade in occluded or distant…

Networking and Internet Architecture · Computer Science 2025-12-23 Jiawei Hou , Peng Yang , Xiangxiang Dai , Mingliu Liu , Conghao Zhou

Accurate and robust multimodal multi-task perception is crucial for modern autonomous driving systems. However, current multimodal perception research follows independent paradigms designed for specific perception tasks, leading to a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Xukun Zhang , Dingkang Yang , Mingyang Sun , Mingcheng Li , Shunli Wang , Lihua Zhang

Learning powerful representations in bird's-eye-view (BEV) for perception tasks is trending and drawing extensive attention both from industry and academia. Conventional approaches for most autonomous driving algorithms perform detection,…

Vision-Language Navigation (VLN) requires agents to follow natural language instructions in partially observed 3D environments, motivating map representations that aggregate spatial context beyond local perception. However, most existing…

Bird's Eye View (BEV) semantic maps have recently garnered a lot of attention as a useful representation of the environment to tackle assisted and autonomous driving tasks. However, most of the existing work focuses on the fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Henrique Piñeiro Monteagudo , Leonardo Taccari , Aurel Pjetri , Francesco Sambo , Samuele Salti

Bird's-eye-view (BEV) semantic segmentation is becoming crucial in autonomous driving systems. It realizes ego-vehicle surrounding environment perception by projecting 2D multi-view images into 3D world space. Recently, BEV segmentation has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jian Sun , Yuqi Dai , Chi-Man Vong , Qing Xu , Shengbo Eben Li , Jianqiang Wang , Lei He , Keqiang Li

Bird's-eye-view (BEV) perception has emerged as a cornerstone of autonomous driving systems, providing a structured, ego-centric representation critical for downstream planning and control. However, real-world deployment faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Lifeng Zhuo , Kefan Jin , Zhe Liu , Hesheng Wang

Accurately perceiving instances and predicting their future motion are key tasks for autonomous vehicles, enabling them to navigate safely in complex urban traffic. While bird's-eye view (BEV) representations are commonplace in perception…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Peizheng Li , Shuxiao Ding , Xieyuanli Chen , Niklas Hanselmann , Marius Cordts , Juergen Gall

Autonomous driving has the potential to set the stage for more efficient future mobility, requiring the research domain to establish trust through safe, reliable and transparent driving. Large Language Models (LLMs) possess reasoning…

Robotics · Computer Science 2025-03-06 Katharina Winter , Mark Azer , Fabian B. Flohr

Autonomous vehicle perception systems have traditionally relied on costly LiDAR sensors to generate precise environmental representations. In this paper, we propose a camera-only perception framework that produces Bird's Eye View (BEV) maps…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Anupkumar Bochare

End-to-end autonomous driving systems are increasingly integrating Vision-Language Model (VLM) architectures, incorporating text reasoning or visual reasoning to enhance the robustness and accuracy of driving decisions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lingjun Zhang , Changjie Wu , Linzhe Shi , Jiangyang Li , Jiaxin Liu , Lei Yang , Hang Zhang , Mu Xu , Hong Wang

Bird's-Eye View (BEV) Perception has received increasing attention in recent years as it provides a concise and unified spatial representation across views and benefits a diverse set of downstream driving applications. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Alexander Swerdlow , Runsheng Xu , Bolei Zhou

3D perception is a critical problem in autonomous driving. Recently, the Bird-Eye-View (BEV) approach has attracted extensive attention, due to low-cost deployment and desirable vision detection capacity. However, the existing models ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Siran Chen , Yue Ma , Yu Qiao , Yali Wang