English
Related papers

Related papers: SanDRA: Safe Large-Language-Model-Based Decision M…

200 papers

Modeling task-driven attention in driving is a fundamental challenge for both autonomous vehicles and cognitive science. Existing methods primarily predict where drivers look by generating spatial heatmaps, but fail to capture the cognitive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yuchen Zhou , Jiayu Tang , Xiaoyan Xiao , Yueyao Lin , Linkai Liu , Zipeng Guo , Hao Fei , Xiaobo Xia , Chao Gou

Autonomous driving has the potential to set the stage for more efficient future mobility, requiring the research domain to establish trust through safe, reliable and transparent driving. Large Language Models (LLMs) possess reasoning…

Robotics · Computer Science 2025-03-06 Katharina Winter , Mark Azer , Fabian B. Flohr

In recent years, autonomous driving systems have made significant progress, yet ensuring their safety remains a key challenge. To this end, scenario-based testing offers a practical solution, and simulation-based methods have gained…

Software Engineering · Computer Science 2025-11-07 Jiahui Wu , Chengjie Lu , Aitor Arrieta , Shaukat Ali

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process…

Robotics · Computer Science 2025-06-09 Jiawei Zhang , Xuan Yang , Taiqi Wang , Yu Yao , Aleksandr Petiushko , Bo Li

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

Recent advancements in large vision language models (VLMs) tailored for autonomous driving (AD) have shown strong scene understanding and reasoning capabilities, making them undeniable candidates for end-to-end driving systems. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Shuo Xing , Hongyuan Hua , Xiangbo Gao , Shenzhe Zhu , Renjie Li , Kexin Tian , Xiaopeng Li , Heng Huang , Tianbao Yang , Zhangyang Wang , Yang Zhou , Huaxiu Yao , Zhengzhong Tu

End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks…

Robotics · Computer Science 2025-06-04 Wei Liu , Jiyuan Zhang , Binxiong Zheng , Yufeng Hu , Yingzhan Lin , Zengfeng Zeng

Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with…

Robotics · Computer Science 2025-05-23 Augusto Luis Ballardini , Miguel Ángel Sotelo

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

Density of the reachable states can help understand the risk of safety-critical systems, especially in situations when worst-case reachability is too conservative. Recent work provides a data-driven approach to compute the density…

Robotics · Computer Science 2022-09-19 Yue Meng , Zeng Qiu , Md Tawhid Bin Waez , Chuchu Fan

Real-world autonomous driving must adhere to complex human social rules that extend beyond legally codified traffic regulations. Many of these semantic constraints, such as yielding to emergency vehicles, complying with traffic officers'…

Robotics · Computer Science 2026-01-06 Qian Cheng , Weitao Zhou , Cheng Jing , Nanshan Deng , Junze Wen , Zhaoyang Liu , Kun Jiang , Diange Yang

Autonomous highway driving demands a critical balance between proactive, efficiency-seeking behavior and robust safety guarantees. This paper proposes Language Action-guided Reinforcement Learning (LA-RL) with Safety Guarantees, a novel…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Yiming Shu , Jiahui Xu , Jiwei Tang , Ruiyang Gao , Chen Sun

As the horizon of intelligent transportation expands with the evolution of Automated Driving Systems (ADS), ensuring paramount safety becomes more imperative than ever. Traditional risk assessment methodologies, primarily crafted for…

Systems and Control · Electrical Eng. & Systems 2024-01-19 Anil Ranjitbhai Patel , Peter Liggesmeyer

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

We present OpenDriveVLA, a Vision Language Action model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially grounded driving actions by leveraging multimodal inputs,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Xingcheng Zhou , Xuyuan Han , Feng Yang , Yunpu Ma , Volker Tresp , Alois Knoll

Generating varied scenarios through simulation is crucial for training and evaluating safety-critical systems, such as autonomous vehicles. Yet, the task of modeling the trajectories of other vehicles to simulate diverse and meaningful…

Robotics · Computer Science 2024-06-07 Phat Nguyen , Tsun-Hsuan Wang , Zhang-Wei Hong , Sertac Karaman , Daniela Rus

Autonomous driving systems face significant challenges in achieving human-like adaptability, robustness, and interpretability in complex, open-world environments. These challenges stem from fragmented architectures, limited generalization…

Robotics · Computer Science 2025-08-01 Yi Zhang , Erik Leo Haß , Kuo-Yi Chao , Nenad Petrovic , Yinglei Song , Chengdong Wu , Alois Knoll

Can safety analysis make use of Large Language Models (LLMs)? A case study explores Systems Theoretic Process Analysis (STPA) applied to Automatic Emergency Brake (AEB) and Electricity Demand Side Management (DSM) systems using ChatGPT. We…

Computation and Language · Computer Science 2025-02-14 Yi Qi , Xingyu Zhao , Siddartha Khastgir , Xiaowei Huang