English
Related papers

Related papers: Perception in Plan: Coupled Perception and Plannin…

200 papers

Autonomous navigation by drones using onboard sensors combined with machine learning and computer vision algorithms is impacting a number of domains, including agriculture, logistics, and disaster management. In this paper, we examine the…

Robotics · Computer Science 2025-06-19 Suman Raj , Swapnil Padhi , Ruchi Bhoot , Prince Modi , Yogesh Simmhan

In this paper, we propose an end-to-end self-driving network featuring a sparse attention module that learns to automatically attend to important regions of the input. The attention module specifically targets motion planning, whereas prior…

Robotics · Computer Science 2021-03-29 Bob Wei , Mengye Ren , Wenyuan Zeng , Ming Liang , Bin Yang , Raquel Urtasun

We present a novel autonomous driving framework, DualAD, designed to imitate human reasoning during driving. DualAD comprises two layers: a rule-based motion planner at the bottom layer that handles routine driving tasks requiring minimal…

Robotics · Computer Science 2024-12-05 Dingrui Wang , Marc Kaufeld , Johannes Betz

Motion planning is a critical component of autonomous vehicle decision-making systems, directly determining trajectory safety and driving efficiency. While deep learning approaches have advanced planning capabilities, existing methods…

Artificial Intelligence · Computer Science 2025-10-29 Xin Yang , Yuhang Zhang , Wei Li , Xin Lin , Wenbin Zou , Chen Xu

End-to-end autonomous driving has made impressive progress in recent years. Existing methods usually adopt the decoupled encoder-decoder paradigm, where the encoder extracts hidden features from raw sensor data, and the decoder outputs the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaosong Jia , Penghao Wu , Li Chen , Jiangwei Xie , Conghui He , Junchi Yan , Hongyang Li

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ruiyang Hao , Bowen Jing , Haibao Yu , Zaiqing Nie

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He

Trajectory planning in robotics aims to generate collision-free pose sequences that can be reliably executed. Recently, vision-to-planning systems have gained increasing attention for their efficiency and ability to interpret and adapt to…

Robotics · Computer Science 2025-11-04 Qihang Li , Zhuoqun Chen , Haoze Zheng , Haonan He , Zitong Zhan , Shaoshu Su , Junyi Geng , Chen Wang

Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However,…

Robotics · Computer Science 2020-07-08 Jianyu Chen , Shengbo Eben Li , Masayoshi Tomizuka

Transformer-based models are becoming a central paradigm in autonomous driving because they can capture long-range spatial dependencies, multi-agent interactions, and multimodal context across perception, prediction, and planning. At the…

Machine Learning · Computer Science 2026-05-13 Juan Zhong , Yuhang Shi , Zukang Xu , Xi Chen

Vehicle-to-everything (V2X) autonomous driving opens up a promising direction for developing a new generation of intelligent transportation systems. Collaborative perception (CP) as an essential component to achieve V2X can overcome the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Si Liu , Chen Gao , Yuan Chen , Xingyu Peng , Xianghao Kong , Kun Wang , Runsheng Xu , Wentao Jiang , Hao Xiang , Jiaqi Ma , Miao Wang

End-to-end autonomous driving models are typically trained on multi-city datasets using supervised ImageNet-pretrained backbones, yet their ability to generalize to unseen cities remains largely unexamined. When training and evaluation data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fatemeh Naeinian , Ali Hamza , Haoran Zhu , Anna Choromanska

In the context of urban autonomous driving, imitation learning-based methods have shown remarkable effectiveness, with a typical practice to minimize the discrepancy between expert driving logs and predictive decision sequences. As expert…

Robotics · Computer Science 2025-12-29 Ren Xin , Jie Cheng , Hongji Liu , Jun Ma

Agile quadrotor flight pushes the limits of control, actuation, and onboard perception. While time-optimal trajectory planning has been extensively studied, existing approaches typically neglect the tight coupling between vehicle dynamics,…

Robotics · Computer Science 2026-03-05 Chao Qin , Jiaxu Xing , Rudolf Reiter , Angel Romero , Yifan Lin , Hugh H. -T. Liu , Davide Scaramuzza

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

Tactical decision making and strategic motion planning for autonomous highway driving are challenging due to the complication of predicting other road users' behaviors, diversity of environments, and complexity of the traffic interactions.…

Robotics · Computer Science 2020-11-30 Majid Moghadam , Ali Alizadeh , Engin Tekin , Gabriel Hugh Elkaim

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

End-to-end autonomous driving faces persistent challenges in both generating diverse, rule-compliant trajectories and robustly selecting the optimal path from these options via learned, multi-faceted evaluation. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Bin Wang , Pingjun Li , Jinkun Liu , Jun Cheng , Hailong Lei , Yinze Rong , Huan-ang Gao , Kangliang Chen , Xing Pan , Weihao Gu

The utilization of Large Language Models (LLMs) within the realm of reinforcement learning, particularly as planners, has garnered a significant degree of attention in recent scholarly literature. However, a substantial proportion of…

Robotics · Computer Science 2024-07-30 Yiqun Duan , Qiang Zhang , Renjing Xu

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception,…

Robotics · Computer Science 2023-12-12 Hemanth Manjunatha , Panagiotis Tsiotras