English
Related papers

Related papers: CALMM-Drive: Confidence-Aware Autonomous Driving w…

200 papers

Hybrid planner switching framework (HPSF) for autonomous driving needs to reconcile high-speed driving efficiency with safe maneuvering in dense traffic. Existing HPSF methods often fail to make reliable mode transitions or sustain…

Robotics · Computer Science 2026-01-30 He Li , Zhaowei Chen , Rui Gao , Guoliang Li , Qi Hao , Shuai Wang , Chengzhong Xu

Recent advancements in open-source Visual Language Models (VLMs) such as LLaVA, Qwen-VL, and Llama have catalyzed extensive research on their integration with diverse systems. The internet-scale general knowledge encapsulated within these…

Robotics · Computer Science 2025-07-03 Cristian Gariboldi , Hayato Tokida , Ken Kinjo , Yuki Asada , Alexander Carballo

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

The advent of Large Multimodal Models (LMMs) offers a promising technology to tackle the limitations of modular design in autonomous driving, which often falters in open-world scenarios requiring sustained environmental understanding and…

Robotics · Computer Science 2026-01-21 Long Zhang , Yuchen Xia , Bingqing Wei , Zhen Liu , Shiwen Mao , Zhu Han , Mohsen Guizani

Efficient trajectory planning for urban intersections is currently one of the most challenging tasks for an Autonomous Vehicle (AV). Courteous behavior towards other traffic participants, the AV's comfort and its progression in the…

Robotics · Computer Science 2020-10-08 Oliver Speidel , Maximilian Graf , Ankit Kaushik , Thanh Phan-Huu , Andreas Wedel , Klaus Dietmayer

As autonomous driving technology progresses, the need for precise trajectory prediction models becomes paramount. This paper introduces an innovative model that infuses cognitive insights into trajectory prediction, focusing on perceived…

Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative…

Artificial Intelligence · Computer Science 2024-08-13 Zhenjie Yang , Xiaosong Jia , Hongyang Li , Junchi Yan

How to construct an interpretable autonomous driving decision-making system has become a focal point in academic research. In this study, we propose a novel approach that leverages large language models (LLMs) to generate executable,…

Artificial Intelligence · Computer Science 2025-06-18 Fanzhi Zeng , Siqi Wang , Chuzhao Zhu , Li Li

Autonomous Vehicles (AVs) must make reliable decisions in dense urban environments where pedestrian behavior is variable, sometimes abnormal, and often unseen during training. Reinforcement learning (RL)-based AV control systems perform…

Robotics · Computer Science 2026-05-19 Aidana Baimbetova , Haruki Yonekura , Hamada Rizk , Hirozumi Yamaguchi

End-to-End autonomous driving (E2E-AD) has emerged as a new paradigm, where trajectory planning plays a crucial role. Existing studies mainly follow two directions: trajectory generation oriented, which focuses on producing high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Bin Sun , Yaoguang Cao , Yan Wang , Rui Wang , Jiachen Shang , Xiejie Feng , Jiayi Lu , Jia Shi , Shichun Yang , Xiaoyu Yan , Ziying Song

Visual-language reasoning, driving knowledge, and value alignment are essential for advanced autonomous driving systems. However, existing approaches largely rely on data-driven learning, making it difficult to capture the complex logic…

Robotics · Computer Science 2026-03-13 Zhongyu Xia , Wenhao Chen , Yongtao Wang , Ming-Hsuan Yang

Autonomous driving remains a highly active research domain that seeks to enable vehicles to perceive dynamic environments, predict the future trajectories of traffic agents such as vehicles, pedestrians, and cyclists and plan safe and…

Existing Vision-Language models (VLMs) estimate either long-term trajectory waypoints or a set of control actions as a reactive solution for closed-loop planning based on their rich scene comprehension. However, these estimations are coarse…

Robotics · Computer Science 2024-04-01 Pranjal Paul , Anant Garg , Tushar Choudhary , Arun Kumar Singh , K. Madhava Krishna

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

Although planning is a crucial component of the autonomous driving stack, researchers have yet to develop robust planning algorithms that are capable of safely handling the diverse range of possible driving scenarios. Learning-based…

Artificial Intelligence · Computer Science 2024-01-02 S P Sharan , Francesco Pittaluga , Vijay Kumar B G , Manmohan Chandraker

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

In complex traffic environments, autonomous vehicles face multi-modal uncertainty about other agents' future behavior. To address this, recent advancements in learningbased motion predictors output multi-modal predictions. We present our…

Robotics · Computer Science 2024-05-07 Mohamed-Khalil Bouzidi , Bojan Derajic , Daniel Goehring , Joerg Reichardt

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Autonomous driving systems validation remains one of the biggest challenges car manufacturers must tackle in order to provide safe driverless cars. The high complexity stems from several factors: the multiplicity of vehicles, embedded…

Machine Learning · Computer Science 2020-08-04 Etienne Goffinet , Anthony Coutant , Mustapha Lebbah , Hanane Azzag , Loïc Giraldi