English

From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving

Computer Vision and Pattern Recognition 2025-05-29 v1 Artificial Intelligence Robotics

Abstract

Ensuring robust and generalizable autonomous driving requires not only broad scenario coverage but also efficient repair of failure cases, particularly those related to challenging and safety-critical scenarios. However, existing scenario generation and selection methods often lack adaptivity and semantic relevance, limiting their impact on performance improvement. In this paper, we propose \textbf{SERA}, an LLM-powered framework that enables autonomous driving systems to self-evolve by repairing failure cases through targeted scenario recommendation. By analyzing performance logs, SERA identifies failure patterns and dynamically retrieves semantically aligned scenarios from a structured bank. An LLM-based reflection mechanism further refines these recommendations to maximize relevance and diversity. The selected scenarios are used for few-shot fine-tuning, enabling targeted adaptation with minimal data. Experiments on the benchmark show that SERA consistently improves key metrics across multiple autonomous driving baselines, demonstrating its effectiveness and generalizability under safety-critical conditions.

Keywords

Cite

@article{arxiv.2505.22067,
  title  = {From Failures to Fixes: LLM-Driven Scenario Repair for Self-Evolving Autonomous Driving},
  author = {Xinyu Xia and Xingjun Ma and Yunfeng Hu and Ting Qu and Hong Chen and Xun Gong},
  journal= {arXiv preprint arXiv:2505.22067},
  year   = {2025}
}
R2 v1 2026-07-01T02:45:34.038Z