English
Related papers

Related papers: BEV-MODNet: Monocular Camera based Bird's Eye View…

200 papers

In autonomous driving, multi-modal perception tasks like 3D object detection typically rely on well-synchronized sensors, both at training and inference. However, despite the use of hardware- or software-based synchronization algorithms,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shiming Wang , Holger Caesar , Liangliang Nan , Julian F. P. Kooij

We propose a novel multi-task learning system that combines appearance and motion cues for a better semantic reasoning of the environment. A unified architecture for joint vehicle detection and motion segmentation is introduced. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Mennatullah Siam , Heba Mahgoub , Mohamed Zahran , Senthil Yogamani , Martin Jagersand , Ahmad El-Sallab

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

Most automated driving systems comprise a diverse sensor set, including several cameras, Radars, and LiDARs, ensuring a complete 360\deg coverage in near and far regions. Unlike Radar and LiDAR, which measure directly in 3D, cameras capture…

World models have attracted increasing attention in autonomous driving for their ability to forecast potential future scenarios. In this paper, we propose BEVWorld, a novel framework that transforms multimodal sensor inputs into a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Yumeng Zhang , Shi Gong , Kaixin Xiong , Xiaoqing Ye , Xiaofan Li , Xiao Tan , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

This paper aims to design a 3D object detection model from 2D images taken by monocular cameras by combining the estimated bird's-eye view elevation map and the deep representation of object features. The proposed model has a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Ali Babolhavaeji , Mohammad Fanaei

Goal-driven mobile robot navigation in map-less environments requires effective state representations for reliable decision-making. Inspired by the favorable properties of Bird's-Eye View (BEV) in point clouds for visual perception, this…

Robotics · Computer Science 2024-09-04 Jiahao Jiang , Yuxiang Yang , Yingqi Deng , Chenlong Ma , Jing Zhang

Bird's-Eye-View (BEV) perception has become a foundational paradigm in autonomous driving, enabling unified spatial representations that support robust multi-sensor fusion and multi-agent collaboration. As autonomous vehicles transition…

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez

Recent works in object detection in LiDAR point clouds mostly focus on predicting bounding boxes around objects. This prediction is commonly achieved using anchor-based or anchor-free detectors that predict bounding boxes, requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 William Guimont-Martin , Jean-Michel Fortin , François Pomerleau , Philippe Giguère

In the field of autonomous driving, accurate and comprehensive perception of the 3D environment is crucial. Bird's Eye View (BEV) based methods have emerged as a promising solution for 3D object detection using multi-view images as input.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Qiu Zhou , Jinming Cao , Hanchao Leng , Yifang Yin , Yu Kun , Roger Zimmermann

3D object detection from LiDAR data for autonomous driving has been making remarkable strides in recent years. Among the state-of-the-art methodologies, encoding point clouds into a bird's eye view (BEV) has been demonstrated to be both…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yantao Lu , Xuetao Hao , Yilan Li , Weiheng Chai , Shiqi Sun , Senem Velipasalar

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

Visual bird's eye view (BEV) perception, due to its excellent perceptual capabilities, is progressively replacing costly LiDAR-based perception systems, especially in the realm of urban intelligent driving. However, this type of perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lei He , Qiaoyi Wang , Honglin Sun , Qing Xu , Bolin Gao , Shengbo Eben Li , Jianqiang Wang , Keqiang Li

Autonomous driving perceives its surroundings for decision making, which is one of the most complex scenarios in visual perception. The success of paradigm innovation in solving the 2D object detection task inspires us to seek an elegant,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Junjie Huang , Guan Huang , Zheng Zhu , Yun Ye , Dalong Du

Accurate and reliable spatial and motion information plays a pivotal role in autonomous driving systems. However, object-level perception models struggle with handling open scenario categories and lack precise intrinsic geometry. On the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Kangan Qian , Jinyu Miao , Ziang Luo , Zheng Fu , and Jinchen Li , Yining Shi , Yunlong Wang , Kun Jiang , Mengmeng Yang , Diange Yang

Multi-modal sensor fusion in Bird's Eye View (BEV) representation has become the leading approach for 3D object detection. However, existing methods often rely on depth estimators or transformer encoders to transform image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yongjin Lee , Hyeon-Mun Jeong , Yurim Jeon , Sanghyun Kim

Bird's-Eye-View (BEV) is critical to connected and automated vehicles (CAVs) as it can provide unified and precise representation of vehicular surroundings. However, quality of the raw sensing data may degrade in occluded or distant…

Networking and Internet Architecture · Computer Science 2025-12-23 Jiawei Hou , Peng Yang , Xiangxiang Dai , Mingliu Liu , Conghao Zhou

Autonomous navigation requires scene understanding of the action-space to move or anticipate events. For planner agents moving on the ground plane, such as autonomous vehicles, this translates to scene understanding in the bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Yigit Baran Can , Alexander Liniger , Ozan Unal , Danda Paudel , Luc Van Gool