English
Related papers

Related papers: Open 3D World in Autonomous Driving

200 papers

Human vision is capable of transforming two-dimensional observations into an egocentric three-dimensional scene understanding, which underpins the ability to translate complex scenes and exhibit adaptive behaviors. This capability, however,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Pei Liu , Hongliang Lu , Haichao Liu , Haipeng Liu , Xin Liu , Ruoyu Yao , Shengbo Eben Li , Jun Ma

Perception for automated driving is largely based on onboard environmental sensors, such as cameras and radar, which are cost-effective but limited by line-of-sight and field-of-view constraints. These inherent limitations may cause onboard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Lukas Ostendorf , Lennart Reiher , Onn Haran , Lutz Eckstein

Autonomous driving, in recent years, has been receiving increasing attention for its potential to relieve drivers' burdens and improve the safety of driving. In modern autonomous driving pipelines, the perception system is an indispensable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jiageng Mao , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

3D LiDAR scanners are playing an increasingly important role in autonomous driving as they can generate depth information of the environment. However, creating large 3D LiDAR point cloud datasets with point-level labels requires a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Xiangyu Yue , Bichen Wu , Sanjit A. Seshia , Kurt Keutzer , Alberto L. Sangiovanni-Vincentelli

Autonomous vehicles may make wrong decisions due to inaccurate detection and recognition. Therefore, an intelligent vehicle can combine its own data with that of other vehicles to enhance perceptive ability, and thus improve detection…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Qi Chen , Sihai Tang , Qing Yang , Song Fu

Advanced Driver-Assistance Systems (ADAS) have successfully integrated learning-based techniques into vehicle perception and decision-making. However, their application in 3D lane detection for effective driving environment perception is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Runkai Zhao , Yuwen Heng , Heng Wang , Yuanda Gao , Shilei Liu , Changhao Yao , Jiawen Chen , Weidong Cai

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

In the field of autonomous driving, accurate and comprehensive perception of the 3D environment is crucial. Bird's Eye View (BEV) based methods have emerged as a promising solution for 3D object detection using multi-view images as input.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Qiu Zhou , Jinming Cao , Hanchao Leng , Yifang Yin , Yu Kun , Roger Zimmermann

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

In autonomous driving, perception systems are piv otal as they interpret sensory data to understand the envi ronment, which is essential for decision-making and planning. Ensuring the safety of these perception systems is fundamental for…

Robotics · Computer Science 2024-11-19 Urvishkumar Bharti , Vikram Shahapur

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

The goal of open-vocabulary detection is to identify novel objects based on arbitrary textual descriptions. In this paper, we address open-vocabulary 3D point-cloud detection by a dividing-and-conquering strategy, which involves: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yuheng Lu , Chenfeng Xu , Xiaobao Wei , Xiaodong Xie , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang

In the realm of modern autonomous driving, the perception system is indispensable for accurately assessing the state of the surrounding environment, thereby enabling informed prediction and planning. The key step to this system is related…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Ziying Song , Lin Liu , Feiyang Jia , Yadan Luo , Guoxin Zhang , Lei Yang , Li Wang , Caiyan Jia

End-to-end autonomous driving systems are increasingly integrating Vision-Language Model (VLM) architectures, incorporating text reasoning or visual reasoning to enhance the robustness and accuracy of driving decisions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lingjun Zhang , Changjie Wu , Linzhe Shi , Jiangyang Li , Jiaxin Liu , Lei Yang , Hang Zhang , Mu Xu , Hong Wang

Collaborative perception in automated vehicles leverages the exchange of information between agents, aiming to elevate perception results. Previous camera-based collaborative 3D perception methods typically employ 3D bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rui Song , Chenwei Liang , Hu Cao , Zhiran Yan , Walter Zimmer , Markus Gross , Andreas Festag , Alois Knoll

Closed-set 3D perception models trained on only a pre-defined set of object categories can be inadequate for safety critical applications such as autonomous driving where new object types can be encountered after deployment. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Mahyar Najibi , Jingwei Ji , Yin Zhou , Charles R. Qi , Xinchen Yan , Scott Ettinger , Dragomir Anguelov

Open-Vocabulary Segmentation (OVS) methods offer promising capabilities in detecting unseen object categories, but the category must be known and needs to be provided by a human, either via a text prompt or pre-labeled datasets, thus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Weijie Wei , Osman Ülger , Fatemeh Karimi Nejadasl , Theo Gevers , Martin R. Oswald

With the rapid advancement of hardware and software technologies, research in autonomous driving has seen significant growth. The prevailing framework for multi-sensor autonomous driving encompasses sensor installation, perception, path…

Robotics · Computer Science 2024-03-07 Chuanyu Luo , Nuo Cheng , Ren Zhong , Haipeng Jiang , Wenyu Chen , Aoli Wang , Pu Li

Existing LiDAR-based 3D object detection methods for autonomous driving scenarios mainly adopt the training-from-scratch paradigm. Unfortunately, this paradigm heavily relies on large-scale labeled data, whose collection can be expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Zhiwei Lin , Yongtao Wang , Shengxiang Qi , Nan Dong , Ming-Hsuan Yang

Autonomous driving has achieved rapid development over the last few decades, including the machine perception as an important issue of it. Although object detection based on conventional cameras has achieved remarkable results in 2D/3D,…

Robotics · Computer Science 2021-07-20 Rui Yang , Zhi Yan , Tao Yang , Yassine Ruichek