English
Related papers

Related papers: Why Braking? Scenario Extraction and Reasoning Uti…

200 papers

The context window of large language models (LLMs) has been extended significantly in recent years. However, while the context length that the LLM can process has grown, the capability of the model to accurately reason over that context…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Pat Verga , Priyanka Sen , Bowen Yang , Vijay Viswanathan , Patrick Lewis , Taro Watanabe , Yixuan Su

Following road safety norms is non-negotiable not only for humans but also for the AI systems that govern autonomous vehicles. In this work, we evaluate how well multi-modal large language models (LLMs) understand road safety concepts,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Chalamalasetti Kranti

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

Currently, most existing approaches for the design of Automated Driving System (ADS) scenarios focus on the description at one particular abstraction level typically the most detailed one. This practice often removes information at higher…

Software Engineering · Computer Science 2021-09-14 Stefan Klikovits , Paolo Arcaini

Autonomous Vehicles (AVs) collect and pseudo-label terabytes of multi-modal data localized to HD maps during normal fleet testing. However, identifying interesting and safety-critical scenarios from uncurated driving logs remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Cainan Davidson , Deva Ramanan , Neehar Peri

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

Despite significant advancements in recent decades, autonomous vehicles (AVs) continue to face challenges in navigating certain traffic scenarios where human drivers excel. In such situations, AVs often become immobilized, disrupting…

Artificial Intelligence · Computer Science 2025-11-17 Zhipeng Bao , Qianwen Li

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

The fusion of human-centric design and artificial intelligence (AI) capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond transportation. These vehicles can dynamically interact with passengers…

Human-Computer Interaction · Computer Science 2023-10-13 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Driving scenario data play an increasingly vital role in the development of intelligent vehicles and autonomous driving. Accurate and efficient scenario data search is critical for both online vehicle decision-making and planning, and…

Robotics · Computer Science 2025-04-08 Cheng Chang , Jingwei Ge , Jiazhe Guo , Zelin Guo , Binghong Jiang , Li Li

Autonomous Braking and Throttle control is key in developing safe driving systems for the future. There exists a need for autonomous vehicles to negotiate a multi-agent environment while ensuring safety and comfort. A Deep Reinforcement…

Artificial Intelligence · Computer Science 2020-08-19 Varshit S. Dubey , Ruhshad Kasad , Karan Agrawal

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Intelligent Traffic Monitoring (ITMo) technologies hold the potential for improving road safety/security and for enabling smart city infrastructure. Understanding traffic situations requires a complex fusion of perceptual information with…

Computation and Language · Computer Science 2023-07-18 Jiarui Zhang , Filip Ilievski , Kaixin Ma , Aravinda Kollaa , Jonathan Francis , Alessandro Oltramari

Safety testing serves as the fundamental pillar for the development of autonomous driving systems (ADSs). To ensure the safety of ADSs, it is paramount to generate a diverse range of safety-critical test scenarios. While existing ADS…

Software Engineering · Computer Science 2025-01-03 Haoxiang Tian , Xingshuo Han , Yuan Zhou , Guoquan Wu , An Guo , Mingfei Cheng , Shuo Li , Jun Wei , Tianwei Zhang

Simulation is an invaluable tool for developing and evaluating controllers for self-driving cars. Current simulation frameworks are driven by highly-specialist domain specific languages, and so a natural language interface would greatly…

Artificial Intelligence · Computer Science 2023-10-27 Antonio Valerio Miceli-Barone , Alex Lascarides , Craig Innes

Cooperative autonomous driving requires traffic scene understanding from both vehicle and infrastructure perspectives. While vision-language models (VLMs) show strong general reasoning capabilities, their performance in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rui Gan , Junyi Ma , Pei Li , Xingyou Yang , Kai Chen , Sikai Chen , Bin Ran

Autonomous driving systems depend on on models that can reason about high-level scene contexts and accurately predict the dynamics of their surrounding environment. Vision- Language Models (VLMs) have recently emerged as promising tools for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Stefan Englmeier , Katharina Winter , Fabian B. Flohr

Free-text crash narratives recorded in real-world crash databases have been shown to play a significant role in improving traffic safety. However, large-scale analyses remain difficult to implement as there are no documented tools that can…

Computation and Language · Computer Science 2025-10-13 Xixi Wang , Jordanka Kovaceva , Miguel Costa , Shuai Wang , Francisco Camara Pereira , Robert Thomson

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

A principal barrier to large-scale deployment of urban autonomous driving systems lies in the prevalence of complex scenarios and edge cases. Existing systems fail to effectively interpret semantic information within traffic contexts and…

Robotics · Computer Science 2025-07-09 Yuhang Zhang , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun