English
Related papers

Related papers: DME-Driver: Integrating Human Decision Logic and 3…

200 papers

Decision-making and motion planning constitute critical components for ensuring the safety and efficiency of autonomous vehicles (AVs). Existing methodologies typically adopt two paradigms: decision then planning or generation then scoring.…

Robotics · Computer Science 2025-04-01 Ruoyu Yao , Yubin Wang , Haichao Liu , Rui Yang , Zengqi Peng , Lei Zhu , Jun Ma

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

Visual-language reasoning, driving knowledge, and value alignment are essential for advanced autonomous driving systems. However, existing approaches largely rely on data-driven learning, making it difficult to capture the complex logic…

Robotics · Computer Science 2026-03-13 Zhongyu Xia , Wenhao Chen , Yongtao Wang , Ming-Hsuan Yang

In this paper, a human-like driving framework is designed for autonomous vehicles (AVs), which aims to make AVs better integrate into the transportation ecology of human driving and eliminate the misunderstanding and incompatibility of…

Robotics · Computer Science 2022-01-14 Peng Hang , Yiran Zhang , Chen Lv

We present a work-in-progress approach to improving driver attentiveness in cars provided with automated driving systems. The approach is based on a control loop that monitors the driver's biometrics (eye movement, heart rate, etc.) and the…

Robotics · Computer Science 2025-03-21 Radu Calinescu , Naif Alasmari , Mario Gleirscher

Autonomous driving heavily relies on accurate and robust spatial perception. Many failures arise from inaccuracies and instability, especially in long-tail scenarios and complex interactions. However, current vision-language models are weak…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jianhua Han , Meng Tian , Jiangtong Zhu , Fan He , Huixin Zhang , Sitong Guo , Dechang Zhu , Hao Tang , Pei Xu , Yuze Guo , Minzhe Niu , Haojie Zhu , Qichao Dong , Xuechao Yan , Siyuan Dong , Lu Hou , Qingqiu Huang , Xiaosong Jia , Hang Xu

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Vision-centric autonomous driving has recently raised wide attention due to its lower cost. Pre-training is essential for extracting a universal representation. However, current vision-centric pre-training typically relies on either 2D or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Chen Min , Dawei Zhao , Liang Xiao , Jian Zhao , Xinli Xu , Zheng Zhu , Lei Jin , Jianshu Li , Yulan Guo , Junliang Xing , Liping Jing , Yiming Nie , Bin Dai

Current perception models in autonomous driving have become notorious for greatly relying on a mass of annotated data to cover unseen cases and address the long-tail problem. On the other hand, learning from unlabeled large-scale collected…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Jiageng Mao , Minzhe Niu , Chenhan Jiang , Hanxue Liang , Jingheng Chen , Xiaodan Liang , Yamin Li , Chaoqiang Ye , Wei Zhang , Zhenguo Li , Jie Yu , Hang Xu , Chunjing Xu

Data-driven approaches for autonomous driving (AD) have been widely adopted in the past decade but are confronted with dataset bias and uninterpretability. Inspired by the knowledge-driven nature of human driving, recent approaches explore…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhijian Huang , Tao Tang , Shaoxiang Chen , Sihao Lin , Zequn Jie , Lin Ma , Guangrun Wang , Xiaodan Liang

Autonomous driving systems remain brittle in rare, ambiguous, and out-of-distribution scenarios, where human driver succeed through contextual reasoning. Shared autonomy has emerged as a promising approach to mitigate such failures by…

Robotics · Computer Science 2025-11-07 Phat Nguyen , Erfan Aasi , Shiva Sreeram , Guy Rosman , Andrew Silva , Sertac Karaman , Daniela Rus

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

Perception and prediction modules are critical components of autonomous driving systems, enabling vehicles to navigate safely through complex environments. The perception module is responsible for perceiving the environment, including…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Lucas Dal'Col , Miguel Oliveira , Vítor Santos

Recent advancements in driving world models enable controllable generation of high-quality RGB videos or multimodal videos. Existing methods primarily focus on metrics related to generation quality and controllability. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Kai Zeng , Zhanqian Wu , Kaixin Xiong , Xiaobao Wei , Xiangyu Guo , Zhenxin Zhu , Kalok Ho , Lijun Zhou , Bohan Zeng , Ming Lu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wentao Zhang

End-to-end autonomous driving systems are increasingly integrating Vision-Language Model (VLM) architectures, incorporating text reasoning or visual reasoning to enhance the robustness and accuracy of driving decisions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lingjun Zhang , Changjie Wu , Linzhe Shi , Jiangyang Li , Jiaxin Liu , Lei Yang , Hang Zhang , Mu Xu , Hong Wang

Recent advancements in autonomous driving have seen a paradigm shift towards end-to-end learning paradigms, which map sensory inputs directly to driving actions, thereby enhancing the robustness and adaptability of autonomous vehicles.…

Autonomous driving has the potential to set the stage for more efficient future mobility, requiring the research domain to establish trust through safe, reliable and transparent driving. Large Language Models (LLMs) possess reasoning…

Robotics · Computer Science 2025-03-06 Katharina Winter , Mark Azer , Fabian B. Flohr

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

Artificial Intelligence · Computer Science 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

Autonomous cars need geometric accuracy and semantic understanding to navigate complex environments, yet most stacks handle them separately. We present XYZ-Drive, a single vision-language model that reads a front-camera frame, a 25m…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Santosh Patapati , Trisanth Srinivasan , Murari Ambati

This literature review focuses on three important aspects of an autonomous car system: tracking (assessing the identity of the actors such as cars, pedestrians or obstacles in a sequence of observations), prediction (predicting the future…

Machine Learning · Computer Science 2023-08-30 Florin Leon , Marius Gavrilescu