English
Related papers

Related papers: Enhancing Autonomous Vehicle Training with Languag…

200 papers

Generating adversarial safety-critical scenarios is a pivotal method for testing autonomous driving systems, as it identifies potential weaknesses and enhances system robustness and reliability. However, existing approaches predominantly…

Robotics · Computer Science 2025-03-03 Yukuan Yang , Xucheng Lu , Zhili Zhang , Zepeng Wu , Guoqi Li , Lingzhong Meng , Yunzhi Xue

Large language models are increasingly deployed as autonomous agents for multi-step workflows in real-world software environments. However, existing agent benchmarks are limited by trajectory-opaque grading, underspecified safety and…

Artificial Intelligence · Computer Science 2026-05-08 Bowen Ye , Rang Li , Qibin Yang , Yuanxin Liu , Linli Yao , Hanglong Lv , Zhihui Xie , Chenxin An , Lei Li , Lingpeng Kong , Qi Liu , Zhifang Sui , Tong Yang

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Vision-language-action (VLA) models are effective as end-to-end motion planners, but can be brittle when evaluated in closed-loop settings due to being trained under traditional imitation learning framework. Existing closed-loop supervision…

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Recent developments in large language models (LLMs) have been impressive. However, these models sometimes show inconsistencies and problematic behavior, such as hallucinating facts, generating flawed code, or creating offensive and toxic…

Computation and Language · Computer Science 2024-02-22 Zhibin Gou , Zhihong Shao , Yeyun Gong , Yelong Shen , Yujiu Yang , Nan Duan , Weizhu Chen

Autonomous driving and its widespread adoption have long held tremendous promise. Nevertheless, without a trustworthy and thorough testing procedure, not only does the industry struggle to mass-produce autonomous vehicles (AV), but neither…

Machine Learning · Computer Science 2023-06-13 Haoyi Niu , Kun Ren , Yizhou Xu , Ziyuan Yang , Yichen Lin , Yi Zhang , Jianming Hu

Safety is a critical concern in autonomous vehicle (AV) systems, especially when AI-based sensing and perception modules are involved. However, due to the black box nature of AI algorithms, it makes closed-loop analysis and synthesis…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Tao Yan , Zheyu Zhang , Jingjing Jiang , Wen-Hua Chen

For autonomous vehicles, safe navigation in complex environments depends on handling a broad range of diverse and rare driving scenarios. Simulation- and scenario-based testing have emerged as key approaches to development and validation of…

Developing and testing automated driving models in the real world might be challenging and even dangerous, while simulation can help with this, especially for challenging maneuvers. Deep reinforcement learning (DRL) has the potential to…

Achieving fully autonomous driving systems requires learning rational decisions in a wide span of scenarios, including safety-critical and out-of-distribution ones. However, such cases are underrepresented in real-world corpus collected by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Haochen Tian , Tianyu Li , Haochen Liu , Jiazhi Yang , Yihang Qiu , Guang Li , Junli Wang , Yinfeng Gao , Zhang Zhang , Liang Wang , Hangjun Ye , Tieniu Tan , Long Chen , Hongyang Li

The widescale deployment of Autonomous Vehicles (AV) appears to be imminent despite many safety challenges that are yet to be resolved. It is well-known that there are no universally agreed Verification and Validation (VV) methodologies…

Robotics · Computer Science 2020-11-17 Dhanoop Karunakaran , Stewart Worrall , Eduardo Nebot

Benchmarking autonomous driving planners to align with human judgment remains a critical challenge, as state-of-the-art metrics like the Extended Predictive Driver Model Score (EPDMS) lack context awareness in nuanced scenarios. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jingyu Song , Zhenxin Li , Shiyi Lan , Xinglong Sun , Nadine Chang , Maying Shen , Joshua Chen , Katherine A. Skinner , Jose M. Alvarez

Testing scenario library generation (TSLG) is a critical step for the development and deployment of connected and automated vehicles (CAVs). In Part I of this study, a general methodology for TSLG is proposed, and theoretical properties are…

Robotics · Computer Science 2020-09-30 Shuo Feng , Yiheng Feng , Haowei Sun , Shao Bao , Yi Zhang , Henry X. Liu

Assessing the safety of autonomous driving policy is of great importance, and reinforcement learning (RL) has emerged as a powerful method for discovering critical vulnerabilities in driving policies. However, existing RL-based approaches…

Cryptography and Security · Computer Science 2025-12-02 Le Qiu , Zelai Xu , Qixin Tan , Wenhao Tang , Chao Yu , Yu Wang

Ensuring safety in autonomous driving (AD) remains a significant challenge, especially in highly dynamic and complex traffic environments where diverse agents interact and unexpected hazards frequently emerge. Traditional reinforcement…

Robotics · Computer Science 2025-10-14 Dong Hu , Fenqing Hu , Lidong Yang , Chao Huang

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bardia Safaei , Vishal M. Patel

Traffic simulation is an efficient and cost-effective way to test Autonomous Vehicles (AVs) in a complex and dynamic environment. Numerous studies have been conducted for AV evaluation using traffic simulation over the past decades.…

Robotics · Computer Science 2021-10-15 Pei Li , Arpan Kusari , David J. LeBlanc

End-to-end autonomous driving policies based on Imitation Learning (IL) often struggle in closed-loop execution due to the misalignment between inadequate open-loop training objectives and real driving requirements. While Reinforcement…

Ensuring the functional correctness and safety of autonomous vehicles is a major challenge for the automotive industry. However, exhaustive physical test drives are not feasible, as billions of driven kilometers would be required to obtain…

Software Engineering · Computer Science 2021-02-09 Barbara Schuett , Thilo Braun , Stefan Otten , Eric Sax