English
Related papers

Related papers: Causal Scene Narration with Runtime Safety Supervi…

200 papers

Accurately identifying, understanding and describing traffic safety-critical events (SCEs), including crashes, tire strikes, and near-crashes, is crucial for advanced driver assistance systems, automated driving systems, and traffic safety.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Liang Shi , Boyu Jiang , Tong Zeng , Feng Guo

Current end-to-end autonomous driving systems are fundamentally limited by a mismatch between temporal causal reasoning and global trajectory consistency. Autoregressive (AR) models capture interaction-aware temporal dependencies via causal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Xiyang Wang , Xinlin Wang , Tingguang Zhou , Gong Chen , Xingtai Gui , Zhi Xu , Xiaolei Wu , Feiyang Tan , Hangning Zhou , Mu Yang

Scene understanding is essential for enhancing driver safety, generating human-centric explanations for Automated Vehicle (AV) decisions, and leveraging Artificial Intelligence (AI) for retrospective driving video analysis. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Mohammed Elhenawy , Huthaifa I. Ashqar , Andry Rakotonirainy , Taqwa I. Alhadidi , Ahmed Jaber , Mohammad Abu Tami

Cooperative autonomous driving requires traffic scene understanding from both vehicle and infrastructure perspectives. While vision-language models (VLMs) show strong general reasoning capabilities, their performance in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rui Gan , Junyi Ma , Pei Li , Xingyou Yang , Kai Chen , Sikai Chen , Bin Ran

Simulation-based testing is crucial for validating autonomous vehicles (AVs), yet existing scenario generation methods either overfit to common driving patterns or operate in an offline, non-interactive manner that fails to expose rare,…

Artificial Intelligence · Computer Science 2025-07-16 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

Real-world crash reports, which combine textual summaries and sketches, are valuable for scenario-based testing of autonomous driving systems (ADS). However, current methods cannot effectively translate this multimodal data into precise,…

Software Engineering · Computer Science 2026-02-25 Fida Khandaker Safa , Yupeng Jiang , Xi Zheng

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

Vision-Language-Action (VLA) models for autonomous driving show promise but falter in unstructured corner case scenarios, largely due to a scarcity of targeted benchmarks. To address this, we introduce Impromptu VLA. Our core contribution…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Haohan Chi , Huan-ang Gao , Ziming Liu , Jianing Liu , Chenyu Liu , Jinwei Li , Kaisen Yang , Yangcheng Yu , Zeda Wang , Wenyi Li , Leichen Wang , Xingtao Hu , Hao Sun , Hang Zhao , Hao Zhao

Vision-Language-Action (VLA) models have recently emerged in autonomous driving, with the promise of leveraging rich world knowledge to improve the cognitive capabilities of driving systems. However, adapting such models for driving tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yongkang Li , Lijun Zhou , Sixu Yan , Bencheng Liao , Tianyi Yan , Kaixin Xiong , Long Chen , Hongwei Xie , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Haiyang Sun , Xinggang Wang

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic control, with test-time scaling (TTS) gaining attention to enhance robustness beyond training. However, existing TTS methods for VLAs…

Robotics · Computer Science 2026-02-05 Hyeonbeom Choi , Daechul Ahn , Youhan Lee , Taewook Kang , Seongwon Cho , Jonghyun Choi

Autonomous driving systems remain critically vulnerable to the long-tail of rare, out-of-distribution semantic anomalies. While VLMs have emerged as promising tools for perception, their application in anomaly detection remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , David Pop , Yuan Gao , Mattia Piccinini , Johannes Betz

Vision-Language Models (VLMs) are increasingly proposed for autonomous driving tasks, yet their performance on sequential driving scenes remains poorly characterized, particularly regarding how input configurations affect their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , Mattia Piccinini , Johannes Betz

Leveraging temporal context is crucial for success in partially observable robotic tasks. However, prior work in behavior cloning has demonstrated inconsistent performance gains when using multi-frame observations. In this paper, we…

Robotics · Computer Science 2025-10-07 Huiwon Jang , Sihyun Yu , Heeseung Kwon , Hojin Jeon , Younggyo Seo , Jinwoo Shin

Recognizing a traffic accident is an essential part of any autonomous driving or road monitoring system. An accident can appear in a wide variety of forms, and understanding what type of accident is taking place may be useful to prevent it…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Aaron Lohner , Francesco Compagno , Jonathan Francis , Alessandro Oltramari

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Learning-based autonomous driving systems are trained mostly on incident-free data, offering little guidance near safety-performance boundaries. Real crash reports contain precisely the contrastive evidence needed, but they are hard to use:…

Robotics · Computer Science 2025-09-24 Jay Patrikar , Apoorva Sharma , Sushant Veer , Boyi Li , Sebastian Scherer , Marco Pavone

Vision-Language Models (VLMs) offer a promising approach to end-to-end autonomous driving due to their human-like reasoning capabilities. However, troublesome gaps remains between current VLMs and real-world autonomous driving applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hao Jiang , Chuan Hu , Yukang Shi , Yuan He , Ke Wang , Xi Zhang , Zhipeng Zhang

Recent advances in vision language action (VLA) models have shown remarkable potential for autonomous driving by directly mapping multimodal inputs to control signals. However, previous VLA-based methods have not explicitly exploited the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Lijin Yang , Jianing Huang , Zhongzhan Huang , Shu Liu , Hao Yang

Event-based camera has emerged as a promising paradigm for robot perception, offering advantages with high temporal resolution, high dynamic range, and robustness to motion blur. However, existing deep learning-based event processing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Shenqi Wang , Guangzhi Tang

Vision-language models (VLMs) are increasingly deployed in real-world and embodied settings where safety decisions depend on visual context. However, it remains unclear which visual evidence drives these judgments. We study whether…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Carlos Hinojosa , Clemens Grange , Bernard Ghanem