English
Related papers

Related papers: Learning to Map Vehicles into Bird's Eye View

200 papers

One essential step to realize modern driver assistance technology is the accurate knowledge about the location of static objects in the environment. In this work, we use artificial neural networks to predict the occupation state of a whole…

Robotics · Computer Science 2019-04-01 Daniel Bauer , Lars Kuhnert , Lutz Eckstein

Object detection in aerial images is an important task in environmental, economic, and infrastructure-related tasks. One of the most prominent applications is the detection of vehicles, for which deep learning approaches are increasingly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Immanuel Weber , Jens Bongartz , Ribana Roscher

The technology for autonomous vehicles is close to replacing human drivers by artificial systems endowed with high-level decision-making capabilities. In this regard, systems must learn about the usual vehicle's behavior to predict imminent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , andCarlo Regazzoni

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

Convolutions on monocular dash cam videos capture spatial invariances in the image plane but do not explicitly reason about distances and depth. We propose a simple transformation of observations into a bird's eye view, also known as plan…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Dequan Wang , Coline Devin , Qi-Zhi Cai , Philipp Krähenbühl , Trevor Darrell

The ability to reliably perceive the environmental states, particularly the existence of objects and their motion behavior, is crucial for autonomous driving. In this work, we propose an efficient deep model, called MotionNet, to jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Pengxiang Wu , Siheng Chen , Dimitris Metaxas

Recent advances in autonomous driving systems have shifted towards reducing reliance on high-definition maps (HDMaps) due to the huge costs of annotation and maintenance. Instead, researchers are focusing on online vectorized HDMap…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Sen Yang , Minyue Jiang , Ziwei Fan , Xiaolu Xie , Xiao Tan , Yingying Li , Errui Ding , Liang Wang , Jingdong Wang

Maps are a key component in image-based camera localization and visual SLAM systems: they are used to establish geometric constraints between images, correct drift in relative pose estimation, and relocalize cameras after lost tracking. The…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Samarth Brahmbhatt , Jinwei Gu , Kihwan Kim , James Hays , Jan Kautz

Rich semantic information extraction plays a vital role on next-generation intelligent vehicles. Currently there is great amount of research focusing on fundamental applications such as 6D pose detection, road scene semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Yafu Tian , Alexander Carballo , Ruifeng Li , Kazuya Takeda

This paper investigates how end-to-end driving models can be improved to drive more accurately and human-like. To tackle the first issue we exploit semantic and visual maps from HERE Technologies and augment the existing Drive360 dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Simon Hecker , Dengxin Dai , Alexander Liniger , Luc Van Gool

A detailed environment perception is a crucial component of automated vehicles. However, to deal with the amount of perceived information, we also require segmentation strategies. Based on a grid map environment representation, well-suited…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Sascha Wirges , Tom Fischer , Jesus Balado Frias , Christoph Stiller

Bird's-eye-view (BEV) is a powerful and widely adopted representation for road scenes that captures surrounding objects and their spatial locations, along with overall context in the scene. In this work, we focus on bird's eye semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Mong H. Ng , Kaahan Radia , Jianfei Chen , Dequan Wang , Ionel Gog , Joseph E. Gonzalez

Semantic segmentation is key in autonomous driving. Using deep visual learning architectures is not trivial in this context, because of the challenges in creating suitable large scale annotated datasets. This issue has been traditionally…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Emanuele Alberti , Antonio Tavera , Carlo Masone , Barbara Caputo

Semantic 2D maps are commonly used by humans and machines for navigation purposes, whether it's walking or driving. However, these maps have limitations: they lack detail, often contain inaccuracies, and are difficult to create and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Paul-Edouard Sarlin , Eduard Trulls , Marc Pollefeys , Jan Hosang , Simon Lynen

Simulating camera sensors is a crucial task in autonomous driving. Although neural radiance fields are exceptional at synthesizing photorealistic views in driving simulations, they still fail to generate extrapolated views. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Chenming Wu , Jiadai Sun , Zhelun Shen , Liangjun Zhang

Bird's Eye View (BEV) map prediction is essential for downstream autonomous driving tasks like trajectory prediction. In the past, this was accomplished through the use of a sophisticated sensor configuration that captured a surround view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Daniel Busch , Ido Freeman , Richard Meyes , Tobias Meisen

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Understanding the scene around the ego-vehicle is key to assisted and autonomous driving. Nowadays, this is mostly conducted using cameras and laser scanners, despite their reduced performances in adverse weather conditions. Automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Arthur Ouaknine , Alasdair Newson , Patrick Pérez , Florence Tupin , Julien Rebut

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite extensive research…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xinlong Cheng , Lei Li

By exploiting complementary sensor information, radar and camera fusion systems have the potential to provide a highly robust and reliable perception system for advanced driver assistance systems and automated driving functions. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Stäcker , Philipp Heidenreich , Jason Rambach , Didier Stricker