English
Related papers

Related papers: PRIX: Learning to Plan from Raw Pixels for End-to-…

200 papers

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Autonomous driving requires a comprehensive understanding of the surrounding environment for reliable trajectory planning. Previous works rely on dense rasterized scene representation (e.g., agent occupancy and semantic map) to perform…

Current approaches of Reinforcement Learning (RL) applied in urban Autonomous Driving (AD) focus on decoupling the perception training from the driving policy training. The main reason is to avoid training a convolution encoder alongside a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Daniel Coelho , Miguel Oliveira , Vitor Santos

Autonomous driving without high-definition (HD) maps demands a higher level of active scene understanding. In this competition, the organizers provided the multi-perspective camera images and standard-definition (SD) maps to explore the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Zhongyu Yang , Mai Liu , Jinluo Xie , Yueming Zhang , Chen Shen , Wei Shao , Jichao Jiao , Tengfei Xing , Runbo Hu , Pengfei Xu

We propose CARE (Collision Avoidance via Repulsive Estimation) to improve the robustness of learning-based visual navigation methods. Recently, visual navigation models, particularly foundation models, have demonstrated promising…

Robotics · Computer Science 2025-08-11 Joonkyung Kim , Joonyeol Sim , Woojun Kim , Katia Sycara , Changjoo Nam

In recent years, end-to-end autonomous driving has attracted increasing attention for its ability to jointly model perception, prediction, and planning within a unified framework. However, most existing approaches underutilize the online…

Robotics · Computer Science 2025-09-18 Huilin Yin , Yiming Kan , Daniel Watzenig

For human drivers, having rear and side-view mirrors is vital for safe driving. They deliver a more complete view of what is happening around the car. Human drivers also heavily exploit their mental map for navigation. Nonetheless, several…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Simon Hecker , Dengxin Dai , Luc Van Gool

End-to-end autonomous driving planners typically generate trajectories from current observations alone. However, real-world driving is highly dynamic, and such reactive planning cannot anticipate future scene evolution, often leading to…

Robotics · Computer Science 2026-04-29 Chuyao Fu , Shengzhe Gan , Zhuoli Ouyang , Yuhan Rui , Xiaowei Chi , Sirui Han , Jiankun Wang , Hong Zhang

In autonomous driving, end-to-end planners learn scene representations from raw sensor data and utilize them to generate a motion plan or control actions. However, exclusive reliance on the current scene for motion planning may result in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Hongbin Lin , Yiming Yang , Yifan Zhang , Chaoda Zheng , Jie Feng , Sheng Wang , Zhennan Wang , Shijia Chen , Boyang Wang , Yu Zhang , Xianming Liu , Shuguang Cui , Zhen Li

Cooperatively utilizing both ego-vehicle and infrastructure sensor data via V2X communication has emerged as a promising approach for advanced autonomous driving. However, current research mainly focuses on improving individual modules,…

Robotics · Computer Science 2024-12-25 Haibao Yu , Wenxian Yang , Jiaru Zhong , Zhenwei Yang , Siqi Fan , Ping Luo , Zaiqing Nie

Autonomous vehicles rely extensively on perception systems to navigate and interpret their surroundings. Despite significant advancements in these systems recently, challenges persist under conditions like occlusion, extreme lighting, or in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianyuan Yuan , Yucheng Mao , Jiawei Yang , Yicheng Liu , Yue Wang , Hang Zhao

Deep learning has been used to demonstrate end-to-end neural network learning for autonomous vehicle control from raw sensory input. While LiDAR sensors provide reliably accurate information, existing end-to-end driving solutions are mainly…

Robotics · Computer Science 2021-05-21 Zhijian Liu , Alexander Amini , Sibo Zhu , Sertac Karaman , Song Han , Daniela Rus

The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenchao Sun , Xuewu Lin , Yining Shi , Chuang Zhang , Haoran Wu , Sifa Zheng

End-to-end autonomous driving models generate future trajectories from multi-view inputs, improving system integration but introducing opaque decisions and hard-to-localize risks. Existing methods either rely on auxiliary monitoring models…

Machine Learning · Computer Science 2026-05-08 Le Yang , Ruoyu Chen , Haijun Liu , Jiawei Liang , ShangQuan Sun , Xiaochun Cao

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

We train embodied neural networks to plan and navigate unseen complex 3D environments, emphasising real-world deployment. Rather than requiring prior knowledge of the agent or environment, the planner learns to model the state transitions…

Robotics · Computer Science 2022-06-03 Shu Ishida , João F. Henriques

Predicting the future trajectories of on-road vehicles is critical for autonomous driving. In this paper, we introduce a novel prediction framework called PRIME, which stands for Prediction with Model-based Planning. Unlike recent…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Haoran Song , Di Luan , Wenchao Ding , Michael Yu Wang , Qifeng Chen

The ability to form complex plans based on raw visual input is a litmus test for current capabilities of artificial intelligence, as it requires a seamless combination of visual processing and abstract algorithmic execution, two…

Machine Learning · Computer Science 2022-03-21 Marco Bagatella , Mirek Olšák , Michal Rolínek , Georg Martius

The emerging vehicular connected applications, such as cooperative automated driving and intersection collision warning, show great potentials to improve the driving safety, where vehicles can share the data collected by a variety of…

Networking and Internet Architecture · Computer Science 2022-12-27 Haoxin Wang , Jiang Xie , Muhana Magboul Ali Muslam

Advanced sensors are a key to enable self-driving cars technology. Laser scanner sensors (LiDAR, Light Detection And Ranging) became a fundamental choice due to its long-range and robustness to low light driving conditions. The problem of…

Image and Video Processing · Electrical Eng. & Systems 2019-07-19 Khaled Elmadawi , Moemen Abdelrazek , Mohamed Elsobky , Hesham M. Eraqi , Mohamed Zahran