English
Related papers

Related papers: Perception in Plan: Coupled Perception and Plannin…

200 papers

Ensuring safe, comfortable, and efficient planning is crucial for autonomous driving systems. While end-to-end models trained on large datasets perform well in standard driving scenarios, they struggle with complex low-frequency events.…

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the…

Artificial Intelligence · Computer Science 2021-03-03 Ardi Tampuu , Maksym Semikin , Naveed Muhammad , Dmytro Fishman , Tambet Matiisen

Just as humans can become disoriented in featureless deserts or thick fogs, not all environments are conducive to the Localization Accuracy and Stability (LAS) of autonomous robots. This paper introduces an efficient framework designed to…

Robotics · Computer Science 2024-08-06 Kaixin Chai , Long Xu , Qianhao Wang , Chao Xu , Peng Yin , Fei Gao

An intelligent agent operating in the real-world must balance achieving its goal with maintaining the safety and comfort of not only itself, but also other participants within the surrounding scene. This requires jointly reasoning about the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Jerry Liu , Wenyuan Zeng , Raquel Urtasun , Ersin Yumer

Designing a driving policy for autonomous vehicles is a difficult task. Recent studies suggested an end-toend (E2E) training of a policy to predict car actuators directly from raw sensory inputs. It is appealing due to the ease of labeled…

Robotics · Computer Science 2019-01-07 Yonatan Glassner , Liran Gispan , Ariel Ayash , Tal Furman Shohet

End-to-end autonomous driving systems directly generate driving policies from raw sensor inputs. While these systems can extract effective environmental features for planning, relying on auxiliary perception tasks, developing perception…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingtai Gui , Jianbo Zhao , Wencheng Han , Jikai Wang , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

End-to-end autonomous driving (E2E-AD) has rapidly emerged as a promising approach toward achieving full autonomy. However, existing E2E-AD systems typically adopt a traditional multi-task framework, addressing perception, prediction, and…

Robotics · Computer Science 2025-07-21 Tao Wang , Cong Zhang , Xingguang Qu , Kun Li , Weiwei Liu , Chang Huang

End-to-end paradigm has emerged as a promising approach to autonomous driving. However, existing single-agent end-to-end pipelines are often constrained by occlusion and limited perception range, resulting in hazardous driving. Furthermore,…

Robotics · Computer Science 2025-11-21 Mingyue Lei , Zewei Zhou , Hongchen Li , Jiaqi Ma , Jia Hu

We tackle the problem of joint perception and motion forecasting in the context of self-driving vehicles. Towards this goal we propose PnPNet, an end-to-end model that takes as input sequential sensor data, and outputs at each time step…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Ming Liang , Bin Yang , Wenyuan Zeng , Yun Chen , Rui Hu , Sergio Casas , Raquel Urtasun

The comprehensiveness of vehicle-to-everything (V2X) recognition enriches and holistically shapes the global Birds-Eye-View (BEV) perception, incorporating rich semantics and integrating driving scene information, thereby serving features…

Robotics · Computer Science 2024-04-23 Fukang Li , Wenlin Ou , Kunpeng Gao , Yuwen Pang , Yifei Li , Henry Fan

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

End-to-end learning from sensory data has shown promising results in autonomous driving. While employing many sensors enhances world perception and should lead to more robust and reliable behavior of autonomous vehicles, it is challenging…

Robotics · Computer Science 2020-09-21 Shihong Fang , Anna Choromanska

With the recent advancement of deep learning technology, data-driven approaches for autonomous car prediction and planning have achieved extraordinary performance. Nevertheless, most of these approaches follow a non-interactive prediction…

Robotics · Computer Science 2021-04-20 Hengli Wang , Peide Cai , Rui Fan , Yuxiang Sun , Ming Liu

Collaborative perception enhances the reliability and spatial coverage of autonomous vehicles by sharing complementary information across vehicles, offering a promising solution to long-tail scenarios that challenge single-vehicle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuheng Wu , Xiangbo Gao , Quang Tau , Zhengzhong Tu , Dongman Lee

Foundation models are revolutionizing autonomous driving perception, transitioning the field from narrow, task-specific deep learning models to versatile, general-purpose architectures trained on vast, diverse datasets. This survey examines…

Robotics · Computer Science 2025-09-11 Rajendramayavan Sathyam , Yueqi Li

End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging benchmarks. However, modern generative E2E planners still suffer from a substantial number of…

Robotics · Computer Science 2026-05-19 Shounak Sural , Raj Rajkumar

Recent advances in autonomous driving systems have shifted towards reducing reliance on high-definition maps (HDMaps) due to the huge costs of annotation and maintenance. Instead, researchers are focusing on online vectorized HDMap…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Sen Yang , Minyue Jiang , Ziwei Fan , Xiaolu Xie , Xiao Tan , Yingying Li , Errui Ding , Liang Wang , Jingdong Wang

Intelligent vehicles (IVs) have gained worldwide attention due to their increased convenience, safety advantages, and potential commercial value. Despite predictions of commercial deployment by 2025, implementation remains limited to…

Robotics · Computer Science 2023-05-11 Siyu Teng , Xuemin Hu , Peng Deng , Bai Li , Yuchen Li , Dongsheng Yang , Yunfeng Ai , Lingxi Li , Zhe Xuanyuan , Fenghua Zhu , Long Chen

Collaborative perception is essential to address occlusion and sensor failure issues in autonomous driving. In recent years, theoretical and experimental investigations of novel works for collaborative perception have increased…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yushan Han , Hui Zhang , Huifang Li , Yi Jin , Congyan Lang , Yidong Li