English
Related papers

Related papers: RoCA: Robust Cross-Domain End-to-End Autonomous Dr…

200 papers

As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as…

Efficient and effective exploration in continuous space is a central problem in applying reinforcement learning (RL) to autonomous driving. Skills learned from expert demonstrations or designed for specific tasks can benefit the…

Robotics · Computer Science 2022-09-27 Tong Zhou , Letian Wang , Ruobing Chen , Wenshuo Wang , Yu Liu

This paper presents a novel two-level control architecture for a fully autonomous vehicle in a deterministic environment, which can handle traffic rules as specifications and low-level vehicle control with real-time performance. At the top…

Robotics · Computer Science 2021-05-07 Erfan Aasi , Cristian Ioan Vasile , Calin Belta

Real-world autonomous driving (AD) especially urban driving involves many corner cases. The lately released AD simulator CARLA v2 adds 39 common events in the driving scene, and provide more quasi-realistic testbed compared to CARLA v1. It…

Robotics · Computer Science 2024-07-23 Qifeng Li , Xiaosong Jia , Shaobo Wang , Junchi Yan

Tactical decision making and strategic motion planning for autonomous highway driving are challenging due to the complication of predicting other road users' behaviors, diversity of environments, and complexity of the traffic interactions.…

Robotics · Computer Science 2020-11-30 Majid Moghadam , Ali Alizadeh , Engin Tekin , Gabriel Hugh Elkaim

A safe and efficient decision-making system is crucial for autonomous vehicles. However, the complexity of driving environments limits the effectiveness of many rule-based and machine learning approaches. Reinforcement Learning (RL), with…

Robotics · Computer Science 2024-11-05 Rongliang Zhou , Jiakun Huang , Mingjun Li , Hepeng Li , Haotian Cao , Xiaolin Song

Autonomous Driving (AD) systems have made notable progress, but their performance in long-tail, safety-critical scenarios remains limited. These rare cases contribute a disproportionate number of accidents. Vision-Language Action (VLA)…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Yiming Cui , Haoyang Liang , Chen Lv , Peng Hang , Jian Sun

Integrating large language models (LLMs) into autonomous driving enhances personalization and adaptability in open-world scenarios. However, traditional edge computing models still face significant challenges in processing complex driving…

Robotics · Computer Science 2024-08-20 Jiao Chen , Suyan Dai , Fangfang Chen , Zuohong Lv , Jianhua Tang

Current end-to-end autonomous driving methods typically learn only from expert planning data collected from a single ego vehicle, severely limiting the diversity of learnable driving policies and scenarios. However, a critical yet…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Lin Liu , Caiyan Jia , Ziying Song , Hongyu Pan , Bencheng Liao , Wenchao Sun , Yongchang Zhang , Lei Yang , Yandan Luo

Human driving behavior is inherently diverse, yet most end-to-end autonomous driving (E2E-AD) systems learn a single average driving style, neglecting individual differences. Achieving personalized E2E-AD faces challenges across three…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xiaoru Dong , Ruiqin Li , Xiao Han , Zhenxuan Wu , Jiamin Wang , Jian Chen , Qi Jiang , SM Yiu , Xinge Zhu , Yuexin Ma

This work presents a novel Learning Model Predictive Control (LMPC) strategy for autonomous racing at the handling limit that can iteratively explore and learn unknown dynamics in high-speed operational domains. We start from existing LMPC…

Robotics · Computer Science 2024-08-22 Haoru Xue , Edward L. Zhu , John M. Dolan , Francesco Borrelli

Emerging generative world models and vision-language-action (VLA) systems are rapidly reshaping automated driving by enabling scalable simulation, long-horizon forecasting, and capability-rich decision making. Across these directions,…

Robotics · Computer Science 2026-03-11 Rongxiang Zeng , Yongqi Dong

End-to-end driving has made significant progress in recent years, demonstrating benefits such as system simplicity and competitive driving performance under both open-loop and closed-loop settings. Nevertheless, the lack of interpretability…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Tianqi Wang , Enze Xie , Ruihang Chu , Zhenguo Li , Ping Luo

End-to-end autonomous driving aims to produce planning trajectories from raw sensors directly. Currently, most approaches integrate perception, prediction, and planning modules into a fully differentiable network, promising great…

Robotics · Computer Science 2025-12-23 Pengxuan Yang , Yupeng Zheng , Qichao Zhang , Kefei Zhu , Zebin Xing , Qiao Lin , Yun-Fu Liu , Zhiguo Su , Dongbin Zhao

Efficient trajectory planning in off-road terrains presents a formidable challenge for autonomous vehicles, often necessitating complex multi-step pipelines. However, traditional approaches exhibit limited adaptability in dynamic…

Robotics · Computer Science 2026-01-13 Liangdong Zhang , Yiming Nie , Haoyang Li , Fanjie Kong , Baobao Zhang , Shunxin Huang , Kai Fu , Chen Min , Liang Xiao

We introduce EMMA, an End-to-end Multimodal Model for Autonomous driving. Built upon a multi-modal large language model foundation like Gemini, EMMA directly maps raw camera sensor data into various driving-specific outputs, including…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jyh-Jing Hwang , Runsheng Xu , Hubert Lin , Wei-Chih Hung , Jingwei Ji , Kristy Choi , Di Huang , Tong He , Paul Covington , Benjamin Sapp , Yin Zhou , James Guo , Dragomir Anguelov , Mingxing Tan

Vision-language models (VLMs) enhance the planning capability of end-to-end (E2E) driving policy by leveraging high-level semantic reasoning. However, existing approaches often overlook the dual-system consistency between VLM's high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuehao Song , Shaoyu Chen , Hao Gao , Yifan Zhu , Weixiang Yue , Jialv Zou , Bo Jiang , Zihao Lu , Yu Wang , Qian Zhang , Xinggang Wang

Recent Vision-Language-Action (VLA) models for autonomous driving explore inference-time reasoning as a way to improve driving performance and safety in challenging scenarios. Most prior work uses natural language to express…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Shuhan Tan , Kashyap Chitta , Yuxiao Chen , Ran Tian , Yurong You , Yan Wang , Wenjie Luo , Yulong Cao , Philipp Krahenbuhl , Marco Pavone , Boris Ivanovic

Reinforcement Learning (RL) has emerged as a transformative approach in the domains of automation and robotics, offering powerful solutions to complex problems that conventional methods struggle to address. In scenarios where the problem…

Robotics · Computer Science 2023-09-04 Meraj Mammadov

Autonomous driving demands safe motion planning, especially in critical "long-tail" scenarios. Recent end-to-end autonomous driving systems leverage large language models (LLMs) as planners to improve generalizability to rare events.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Deepti Hegde , Rajeev Yasarla , Hong Cai , Shizhong Han , Apratim Bhattacharyya , Shweta Mahajan , Litian Liu , Risheek Garrepalli , Vishal M. Patel , Fatih Porikli