English
Related papers

Related papers: Epipolar Attention Field Transformers for Bird's E…

200 papers

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

The bird's-eye-view (BEV) representation allows robust learning of multiple tasks for autonomous driving including road layout estimation and 3D object detection. However, contemporary methods for unified road layout estimation and 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Curie Kim , Ue-Hwan Kim

Many tasks performed by autonomous vehicles such as road marking detection, object tracking, and path planning are simpler in bird's-eye view. Hence, Inverse Perspective Mapping (IPM) is often applied to remove the perspective effect from a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Tom Bruls , Horia Porav , Lars Kunze , Paul Newman

Camera-based bird-eye-view (BEV) perception paradigm has made significant progress in the autonomous driving field. Under such a paradigm, accurate BEV representation construction relies on reliable depth estimation for multi-camera images.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yang Jiao , Zequn Jie , Shaoxiang Chen , Lechao Cheng , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Bird's eye view (BEV)-based 3D perception plays a crucial role in autonomous driving applications. The rise of large language models has spurred interest in BEV-based captioning to understand object behavior in the surrounding environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yunsheng Ma , Burhaneddin Yaman , Xin Ye , Jingru Luo , Feng Tao , Abhirup Mallik , Ziran Wang , Liu Ren

We tackle a new problem of multi-view camera and subject registration in the bird's eye view (BEV) without pre-given camera calibration. This is a very challenging problem since its only input is several RGB images from different…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zekun Qian , Ruize Han , Wei Feng , Feifan Wang , Song Wang

Bird's-Eye View (BEV) Perception has received increasing attention in recent years as it provides a concise and unified spatial representation across views and benefits a diverse set of downstream driving applications. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Alexander Swerdlow , Runsheng Xu , Bolei Zhou

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

In this paper, we propose a new image-based visual place recognition (VPR) framework by exploiting the structural cues in bird's-eye view (BEV) from a single monocular camera. The motivation arises from two key observations about place…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Fudong Ge , Yiwei Zhang , Shuhan Shen , Yue Wang , Weiming Hu , Jin Gao

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

3D object detection plays a pivotal role in autonomous driving and robotics, demanding precise interpretation of Bird's Eye View (BEV) images. The dynamic nature of real-world environments necessitates the use of dynamic query mechanisms in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jiawei Yao , Yingxin Lai , Hongrui Kou , Tong Wu , Ruixi Liu

Recently, referring image segmentation has aroused widespread interest. Previous methods perform the multi-modal fusion between language and vision at the decoding side of the network. And, linguistic feature interacts with visual feature…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Guang Feng , Zhiwei Hu , Lihe Zhang , Huchuan Lu

Surrounding perceptions are quintessential for safe driving for connected and autonomous vehicles (CAVs), where the Bird's Eye View has been employed to accurately capture spatial relationships among vehicles. However, severe inherent…

Networking and Internet Architecture · Computer Science 2024-08-22 Zhengru Fang , Senkang Hu , Haonan An , Yuang Zhang , Jingjing Wang , Hangcheng Cao , Xianhao Chen , Yuguang Fang

Although multiview fusion has demonstrated potential in LiDAR segmentation, its dependence on computationally intensive point-based interactions, arising from the lack of fixed correspondences between views such as range view and Bird's-Eye…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shoumeng Qiu , Xinrun Li , XiangYang Xue , Jian Pu

In recent years, vision-centric Bird's Eye View (BEV) perception has garnered significant interest from both industry and academia due to its inherent advantages, such as providing an intuitive representation of the world and being…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Yuexin Ma , Tai Wang , Xuyang Bai , Huitong Yang , Yuenan Hou , Yaming Wang , Yu Qiao , Ruigang Yang , Dinesh Manocha , Xinge Zhu

Camera-only Bird's Eye View (BEV) has demonstrated great potential in environment perception in a 3D space. However, most existing studies were conducted under a supervised setup which cannot scale well while handling various new data.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Kai Jiang , Jiaxing Huang , Weiying Xie , Yunsong Li , Ling Shao , Shijian Lu

Saliency Prediction aims to predict the attention distribution of human eyes given an RGB image. Most of the recent state-of-the-art methods are based on deep image feature representations from traditional CNNs. However, the traditional…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Shuo Zhang

Cross-modal Unsupervised Domain Adaptation (UDA) aims to exploit the complementarity of 2D-3D data to overcome the lack of annotation in a new domain. However, UDA methods rely on access to the target domain during training, meaning the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Miaoyu Li , Yachao Zhang , Xu MA , Yanyun Qu , Yun Fu

Referring image segmentation is a fundamental vision-language task that aims to segment out an object referred to by a natural language expression from an image. One of the key challenges behind this task is leveraging the referring…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zhao Yang , Jiaqi Wang , Yansong Tang , Kai Chen , Hengshuang Zhao , Philip H. S. Torr

Depth estimation is a cornerstone of perception in autonomous driving and robotic systems. The considerable cost and relatively sparse data acquisition of LiDAR systems have led to the exploration of cost-effective alternatives, notably,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yucheng Mao , Ruowen Zhao , Tianbao Zhang , Hang Zhao