English
Related papers

Related papers: Perception in Plan: Coupled Perception and Plannin…

200 papers

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving. However, leveraging such data from multiple sensors to jointly optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tengju Ye , Wei Jing , Chunyong Hu , Shikun Huang , Lingping Gao , Fangzhen Li , Jingke Wang , Ke Guo , Wencong Xiao , Weibo Mao , Hang Zheng , Kun Li , Junbo Chen , Kaicheng Yu

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoints, a common…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hoonhee Cho , Jae-Young Kang , Giwon Lee , Hyemin Yang , Heejun Park , Seokwoo Jung , Kuk-Jin Yoon

Autonomous driving heavily relies on accurate and robust spatial perception. Many failures arise from inaccuracies and instability, especially in long-tail scenarios and complex interactions. However, current vision-language models are weak…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jianhua Han , Meng Tian , Jiangtong Zhu , Fan He , Huixin Zhang , Sitong Guo , Dechang Zhu , Hao Tang , Pei Xu , Yuze Guo , Minzhe Niu , Haojie Zhu , Qichao Dong , Xuechao Yan , Siyuan Dong , Lu Hou , Qingqiu Huang , Xiaosong Jia , Hang Xu

Learning from demonstration for motion planning is an ongoing research topic. In this paper we present a model that is able to learn the complex mapping from raw 2D-laser range findings and a target position to the required steering…

Robotics · Computer Science 2018-11-07 Mark Pfeiffer , Michael Schaeuble , Juan Nieto , Roland Siegwart , Cesar Cadena

End-to-end autonomous driving models generate future trajectories from multi-view inputs, improving system integration but introducing opaque decisions and hard-to-localize risks. Existing methods either rely on auxiliary monitoring models…

Machine Learning · Computer Science 2026-05-08 Le Yang , Ruoyu Chen , Haijun Liu , Jiawei Liang , ShangQuan Sun , Xiaochun Cao

Modular design of planning-oriented autonomous driving has markedly advanced end-to-end systems. However, existing architectures remain constrained by an over-reliance on ego status, hindering generalization and robust scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jiacheng Tang , Mingyue Feng , Jiachao Liu , Yaonong Wang , Jian Pu

In Vision-and-Language Navigation (VLN), an agent is required to plan a path to the target specified by the language instruction, using its visual observations. Consequently, prevailing VLN methods primarily focus on building powerful…

Robotics · Computer Science 2026-03-19 Tianfu Li , Wenbo Chen , Haoxuan Xu , Xinhu Zheng , Haoang Li

Although end-to-end autonomous driving (E2E-AD) technologies have made significant progress in recent years, there remains an unsatisfactory performance on closed-loop evaluation. The potential of leveraging planning in query design and…

Robotics · Computer Science 2025-03-12 Yingqi Tang , Zhuoran Xu , Zhaotie Meng , Erkang Cheng

Autonomous driving is an emerging technology that has advanced rapidly over the last decade. Modern transportation is expected to benefit greatly from a wise decision-making framework of autonomous vehicles, including the improvement of…

Artificial Intelligence · Computer Science 2023-12-20 Yuyang Xia , Shuncheng Liu , Quanlin Yu , Liwei Deng , You Zhang , Han Su , Kai Zheng

In autonomous driving, perception systems are piv otal as they interpret sensory data to understand the envi ronment, which is essential for decision-making and planning. Ensuring the safety of these perception systems is fundamental for…

Robotics · Computer Science 2024-11-19 Urvishkumar Bharti , Vikram Shahapur

Current end-to-end autonomous driving methods typically learn only from expert planning data collected from a single ego vehicle, severely limiting the diversity of learnable driving policies and scenarios. However, a critical yet…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Lin Liu , Caiyan Jia , Ziying Song , Hongyu Pan , Bencheng Liao , Wenchao Sun , Yongchang Zhang , Lei Yang , Yandan Luo

While Unmanned Aerial Vehicles (UAVs) have gained significant traction across various fields, path planning in 3D environments remains a critical challenge, particularly under size, weight, and power (SWAP) constraints. Traditional modular…

Robotics · Computer Science 2026-03-05 Yufei Jiang , Yuanzhu Zhan , Harsh Vardhan Gupta , Chinmay Borde , Junyi Geng

Recently, deep-learning based approaches have achieved impressive performance for autonomous driving. However, end-to-end vision-based methods typically have limited interpretability, making the behaviors of the deep networks difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hengli Wang , Peide Cai , Yuxiang Sun , Lujia Wang , Ming Liu

The emergence of general human knowledge and impressive logical reasoning capacity in rapidly progressed vision-language models (VLMs) have driven increasing interest in applying VLMs to high-level autonomous driving tasks, such as scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Songyan Zhang , Wenhui Huang , Zihui Gao , Hao Chen , Chen Lv

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

End-to-end Network has become increasingly important in multi-tasking. One prominent example of this is the growing significance of a driving perception system in autonomous driving. This paper systematically studies an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Dat Vu , Bao Ngo , Hung Phan

While autonomous driving technology has made remarkable strides, data-driven approaches still struggle with complex scenarios due to their limited reasoning capabilities. Meanwhile, knowledge-driven autonomous driving systems have evolved…

Artificial Intelligence · Computer Science 2025-01-15 Yukai Ma , Tiantian Wei , Naiting Zhong , Jianbiao Mei , Tao Hu , Licheng Wen , Xuemeng Yang , Botian Shi , Yong Liu

V2X cooperation, through the integration of sensor data from both vehicles and infrastructure, is considered a pivotal approach to advancing autonomous driving technology. Current research primarily focuses on enhancing perception accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Zhiwei Li , Bozhen Zhang , Lei Yang , Tianyu Shen , Nuo Xu , Ruosen Hao , Weiting Li , Tao Yan , Huaping Liu

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily…

Artificial Intelligence · Computer Science 2026-05-12 Bin Sun , Boao Zhang , Jiayi Lu , Xinjie Feng , Jiachen Shang , Rui Cao , Mengchao Zheng , Chuanye Wang , Shichun Yang , Yaoguang Cao , Ziying Song