English
Related papers

Related papers: DeepIPC: Deeply Integrated Perception and Control …

200 papers

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

The last decade witnessed increasingly rapid progress in self-driving vehicle technology, mainly backed up by advances in the area of deep learning and artificial intelligence. The objective of this paper is to survey the current…

Machine Learning · Computer Science 2020-03-26 Sorin Grigorescu , Bogdan Trasnea , Tiberiu Cocias , Gigel Macesanu

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Bird's-Eye-View (BEV) is critical to connected and automated vehicles (CAVs) as it can provide unified and precise representation of vehicular surroundings. However, quality of the raw sensing data may degrade in occluded or distant…

Networking and Internet Architecture · Computer Science 2025-12-23 Jiawei Hou , Peng Yang , Xiangxiang Dai , Mingliu Liu , Conghao Zhou

Autonomous driving systems face significant challenges in perceiving complex environments and making real-time decisions. Traditional modular approaches, while offering interpretability, suffer from error propagation and coordination…

Artificial Intelligence · Computer Science 2025-08-11 Siyi Lu , Run Liu , Dongsheng Yang , Lei He

In this paper, we present a framework to control a self-driving car by fusing raw information from RGB images and depth maps. A deep neural network architecture is used for mapping the vision and depth information, respectively, to steering…

Machine Learning · Computer Science 2019-02-13 Qadeer Khan , Torsten Schön , Patrick Wenzel

Safety is critical for autonomous driving, and one aspect of improving safety is to accurately capture the uncertainties of the perception system, especially knowing the unknown. Different from only providing deterministic or probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yunshuang Yuan , Hao Cheng , Michael Ying Yang , Monika Sester

Cooperative perception enabled by Vehicle-to-Everything communication has shown great promise in enhancing situational awareness for autonomous vehicles and other mobile robotic platforms. Despite recent advances in perception backbones and…

Robotics · Computer Science 2025-09-30 Lantao Li , Kang Yang , Rui Song , Chen Sun

End-to-end autonomous driving systems are increasingly integrating Vision-Language Model (VLM) architectures, incorporating text reasoning or visual reasoning to enhance the robustness and accuracy of driving decisions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lingjun Zhang , Changjie Wu , Linzhe Shi , Jiangyang Li , Jiaxin Liu , Lei Yang , Hang Zhang , Mu Xu , Hong Wang

The simplicity of the visual servoing approach makes it an attractive option for tasks dealing with vision-based control of robots in many real-world applications. However, attaining precise alignment for unseen environments pose a…

Extensive evaluation of perception systems is crucial for ensuring the safety of intelligent vehicles in complex driving scenarios. Conventional performance metrics such as precision, recall and the F1-score assess the overall detection…

Robotics · Computer Science 2025-12-18 Jörg Gamerdinger , Sven Teufel , Stephan Amann , Lukas Marc Listl , Oliver Bringmann

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs,…

Trajectory prediction is, naturally, a key task for vehicle autonomy. While the number of traffic rules is limited, the combinations and uncertainties associated with each agent's behaviour in real-world scenarios are nearly impossible to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Sushil Sharma , Arindam Das , Ganesh Sistu , Mark Halton , Ciarán Eising

Based on the direct perception paradigm of autonomous driving, we investigate and modify the CNNs (convolutional neural networks) AlexNet and GoogLeNet that map an input image to few perception indicators (heading angle, distances to…

Machine Learning · Computer Science 2019-11-13 Der-Hau Lee , Kuan-Lin Chen , Kuan-Han Liou , Chang-Lun Liu , Jinn-Liang Liu

The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenchao Sun , Xuewu Lin , Yining Shi , Chuang Zhang , Haoran Wu , Sifa Zheng

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

Robotics · Computer Science 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

Autonomous driving perceives surroundings with line-of-sight sensors that are compromised under environmental uncertainties. To achieve real time global information in high definition map, we investigate to share perception information…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-12 Qiang Liu , Tao Han , Jiang , Xie , BaekGyu Kim

3D occupancy perception technology aims to observe and understand dense 3D environments for autonomous vehicles. Owing to its comprehensive perception capability, this technology is emerging as a trend in autonomous driving perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Huaiyuan Xu , Junliang Chen , Shiyu Meng , Yi Wang , Lap-Pui Chau

End-to-end motion planning is promising for simplifying complex autonomous driving pipelines. However, challenges such as scene understanding and effective prediction for decision-making continue to present substantial obstacles to its…

Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Shaoyuan Xie , Lingdong Kong , Wenwei Zhang , Jiawei Ren , Liang Pan , Kai Chen , Ziwei Liu