English
Related papers

Related papers: ScVLM: Enhancing Vision-Language Model for Safety-…

200 papers

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Autonomous Vehicle (AV) requires rigorous testing in safety-critical scenarios for safety validation, yet its validation is hindered by the high cost of field testing and the lack of fidelity in current simulations for rare safety-critical…

Robotics · Computer Science 2026-05-19 Hongyi Zhao , Shuo Wang , Qijie He , Ziyuan Pu

Cooperative autonomous driving requires traffic scene understanding from both vehicle and infrastructure perspectives. While vision-language models (VLMs) show strong general reasoning capabilities, their performance in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rui Gan , Junyi Ma , Pei Li , Xingyou Yang , Kai Chen , Sikai Chen , Bin Ran

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Ensuring the safety of vulnerable road users (VRUs), such as pedestrians and cyclists, is a critical challenge for autonomous driving systems, as crashes involving VRUs often result in severe or fatal consequences. While multimodal large…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Younggun Kim , Ahmed S. Abdelrahman , Mohamed Abdel-Aty

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Crash detection from video feeds is a critical problem in intelligent transportation systems. Recent developments in large language models (LLMs) and vision-language models (VLMs) have transformed how we process, reason about, and summarize…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

Vision-Language Models (VLMs) are increasingly proposed for autonomous driving tasks, yet their performance on sequential driving scenes remains poorly characterized, particularly regarding how input configurations affect their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , Mattia Piccinini , Johannes Betz

Autonomous driving faces critical challenges in rare long-tail events and complex multi-agent interactions, which are scarce in real-world data yet essential for robust safety validation. This paper presents a high-fidelity scenario…

Machine Learning · Computer Science 2025-11-27 Yuhang Wang , Heye Huang , Zhenhua Xu , Kailai Sun , Baoshen Guo , Jinhua Zhao

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

The recognition and understanding of traffic incidents, particularly traffic accidents, is a topic of paramount importance in the realm of intelligent transportation systems and intelligent vehicles. This area has continually captured the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Xingcheng Zhou , Alois C. Knoll

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Ensuring safety in autonomous driving systems remains a critical challenge, particularly in handling rare but potentially catastrophic safety-critical scenarios. While existing research has explored generating safety-critical scenarios for…

Robotics · Computer Science 2025-02-24 Zihao Sheng , Zilin Huang , Yansong Qu , Yue Leng , Sruthi Bhavanam , Sikai Chen

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

Recent advances in end-to-end (E2E) autonomous driving have been enabled by training on diverse large-scale driving datasets, yet autonomous driving models still struggle in out-of-distribution (OOD) scenarios. The COOOL benchmark targets…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shingo Yokoi , Kento Sasaki , Yu Yamaguchi

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

Robotics · Computer Science 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

Traffic video description and analysis have received much attention recently due to the growing demand for efficient and reliable urban surveillance systems. Most existing methods only focus on locating traffic event segments, which…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Quang Minh Dinh , Minh Khoi Ho , Anh Quan Dang , Hung Phong Tran

Vision-Language Models (VLMs) offer the ability to generate high-level, interpretable descriptions of complex activities from images and videos, making them valuable for situational awareness (SA) applications. In such settings, the focus…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Pavana Pradeep , Krishna Kant , Suya Yu
‹ Prev 1 2 3 10 Next ›