English
Related papers

Related papers: LLM-Driven Scenario-Aware Planning for Autonomous …

200 papers

Recent advances in metric, semantic, and topological mapping have equipped autonomous robots with semantic concept grounding capabilities to interpret natural language tasks. This work aims to leverage these new capabilities with an…

Autonomous driving systems require the ability to fully understand and predict the surrounding environment to make informed decisions in complex scenarios. Recent advancements in learning-based systems have highlighted the importance of…

Robotics · Computer Science 2024-02-07 Haochen Liu , Zhiyu Huang , Wenhui Huang , Haohan Yang , Xiaoyu Mo , Chen Lv

Autonomous vehicles need to handle various traffic conditions and make safe and efficient decisions and maneuvers. However, on the one hand, a single optimization/sampling-based motion planner cannot efficiently generate safe trajectories…

Robotics · Computer Science 2021-06-10 Jinning Li , Liting Sun , Jianyu Chen , Masayoshi Tomizuka , Wei Zhan

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed.…

Machine Learning · Computer Science 2025-08-04 Yusheng Zhao , Xiao Luo , Haomin Wen , Zhiping Xiao , Wei Ju , Ming Zhang

Rapid advancements in artificial intelligence (AI) have enabled robots to performcomplex tasks autonomously with increasing precision. However, multi-robot systems (MRSs) face challenges in generalization, heterogeneity, and safety,…

Robotics · Computer Science 2025-05-05 Zhaoxing Li , Wenbo Wu , Yue Wang , Yanran Xu , William Hunt , Sebastian Stein

Recent advances in Large Language Models (LLMs) are fostering their integration into several reasoning-related fields, including Automated Planning (AP). However, their integration into Hierarchical Planning (HP), a subfield of AP that…

Artificial Intelligence · Computer Science 2025-11-25 Israel Puerta-Merino , Carlos Núñez-Molina , Pablo Mesejo , Juan Fernández-Olivares

Autonomous driving demands safe motion planning, especially in critical "long-tail" scenarios. Recent end-to-end autonomous driving systems leverage large language models (LLMs) as planners to improve generalizability to rare events.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Deepti Hegde , Rajeev Yasarla , Hong Cai , Shizhong Han , Apratim Bhattacharyya , Shweta Mahajan , Litian Liu , Risheek Garrepalli , Vishal M. Patel , Fatih Porikli

This paper introduces a hierarchical framework that integrates graph search algorithms and model predictive control to facilitate efficient parking maneuvers for Autonomous Vehicles (AVs) in constrained environments. In the high-level…

Robotics · Computer Science 2023-11-15 Xuemin Chi , Zhitao Liu , Jihao Huang , Feng Hong , Hongye Su

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Neural Networks (NNs) trained through supervised learning struggle with managing edge-case scenarios common in real-world driving due to the intractability of exhaustive datasets covering all edge-cases, making knowledge-driven approaches,…

Artificial Intelligence · Computer Science 2025-04-17 Nicolas Baumann , Cheng Hu , Paviththiren Sivasothilingam , Haotong Qin , Lei Xie , Michele Magno , Luca Benini

We present a novel hybrid learning-assisted planning method, named HyPlan, for solving the collision-free navigation problem for self-driving cars in partially observable traffic environments. HyPlan combines methods for multi-agent…

Robotics · Computer Science 2026-02-09 Donald Pfaffmann , Matthias Klusch , Marcel Steinmetz

Mobile robot path planning in complex environments remains a significant challenge, especially in achieving efficient, safe and robust paths. The traditional path planning techniques like DRL models typically trained for a given…

Robotics · Computer Science 2025-01-28 Muhammad Taha Tariq , Congqing Wang , Yasir Hussain

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guoliang You , Xiaomeng Chu , Yifan Duan , Xingchen Li , Sha Zhang , Jianmin Ji , Yanyong Zhang

In mixed-traffic environments, autonomous vehicles (AVs) must interact with heterogeneous human-driven vehicles (HVs) whose intentions and driving styles vary across individuals and scenarios. Such variability introduces uncertainty into…

Robotics · Computer Science 2026-03-18 Xiaoyun Qiu , Haichao Liu , Yue Pan , Jun Ma , Xinhu Zheng

End-to-end autonomous driving systems powered by Vision-Language-Action (VLA) models achieve strong performance on common driving scenarios, yet remain brittle in rare but safety-critical long-tail situations such as active construction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ruiyang Zhu , Yuehan He , Boyuan Zheng , Zesen Zhao , Ahmad Chalhoub , Qingzhao Zhang , Z. Morley Mao

Decision-making and motion planning constitute critical components for ensuring the safety and efficiency of autonomous vehicles (AVs). Existing methodologies typically adopt two paradigms: decision then planning or generation then scoring.…

Robotics · Computer Science 2025-04-01 Ruoyu Yao , Yubin Wang , Haichao Liu , Rui Yang , Zengqi Peng , Lei Zhu , Jun Ma

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian