English
Related papers

Related papers: Automating Crash Diagram Generation Using Vision-L…

200 papers

We introduce STSBench, a scenario-based framework to benchmark the holistic understanding of vision-language models (VLMs) for autonomous driving. The framework automatically mines pre-defined traffic scenarios from any dataset using…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Christian Fruhwirth-Reisinger , Dušan Malić , Wei Lin , David Schinagl , Samuel Schulter , Horst Possegger

Understanding the short-term motion of vulnerable road users (VRUs) like pedestrians and cyclists is critical for safe autonomous driving, especially in urban scenarios with ambiguous or high-risk behaviors. While vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Mihir Godbole , Xiangbo Gao , Zhengzhong Tu

Clinicians spend a significant amount of time reviewing medical images and transcribing their findings regarding patient diagnosis, referral and treatment in text form. Vision-language models (VLMs), which automatically interpret images and…

Language and Vision-Language Models (LLMs/VLMs) have revolutionized the field of AI by their ability to generate human-like text and understand images, but ensuring their reliability is crucial. This paper aims to evaluate the ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Tobias Groot , Matias Valdenegro-Toro

Software testing ensures the quality and reliability of software products, but manual test case creation is labor-intensive. With the rise of large language models (LLMs), there is growing interest in unit test creation with LLMs. However,…

Software Engineering · Computer Science 2025-02-06 Hung-Fu Chang , Mohammad Shokrolah Shirazi

Large Vision-Language Models (LVLMs) have received widespread attention for advancing the interpretable self-driving. Existing evaluations of LVLMs primarily focus on multi-faceted capabilities in natural circumstances, lacking automated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Kai Chen , Yanze Li , Wenhua Zhang , Yanxin Liu , Pengxiang Li , Ruiyuan Gao , Lanqing Hong , Meng Tian , Xinhai Zhao , Zhenguo Li , Dit-Yan Yeung , Huchuan Lu , Xu Jia

Scene understanding is critical for various downstream tasks in autonomous driving, including facilitating driver-agent communication and enhancing human-centered explainability of autonomous vehicle (AV) decisions. This paper evaluates the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mohammed Elhenawy , Shadi Jaradat , Taqwa I. Alhadidi , Huthaifa I. Ashqar , Ahmed Jaber , Andry Rakotonirainy , Mohammad Abu Tami

In this paper, we introduce VisioPath, a novel framework combining vision-language models (VLMs) with model predictive control (MPC) to enable safe autonomous driving in dynamic traffic environments. The proposed approach leverages a…

Systems and Control · Electrical Eng. & Systems 2025-07-10 Shanting Wang , Panagiotis Typaldos , Chenjun Li , Andreas A. Malikopoulos

The role of Large Language Models (LLMs) has not been extensively explored in analog circuit design, which could benefit from a reasoning-based approach that transcends traditional optimization techniques. In particular, despite their…

Machine Learning · Computer Science 2025-02-13 Lejla Skelic , Yan Xu , Matthew Cox , Wenjie Lu , Tao Yu , Ruonan Han

The emergence of advanced neural networks has opened up new ways in automated code generation from conceptual models, promising to enhance software development processes. This paper presents a preliminary evaluation of GPT-4-Vision, a…

Software Engineering · Computer Science 2024-04-23 Gábor Antal , Richárd Vozár , Rudolf Ferenc

CAR-Scenes is a frame-level dataset for autonomous driving that enables training and evaluation of vision-language models (VLMs) for interpretable, scene-level understanding. We annotate 5,192 images drawn from Argoverse 1, Cityscapes,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuankai He , Weisong Shi

Vision Language Models (VLMs) are increasingly deployed in autonomous vehicles and mobile systems, making it crucial to evaluate their ability to support safer decision-making in complex environments. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Takara Taniguchi , Kuniaki Saito , Atsushi Hashimoto

The reliable analysis of blood reports is important for health knowledge, but individuals often struggle with interpretation, leading to anxiety and overlooked issues. We explore the potential of general-purpose Vision-Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Nadia Bakhsheshi , Hamid Beigy

Construction safety inspection remains mostly manual, and automated approaches still rely on task-specific datasets that are hard to maintain in fast-changing construction environments due to frequent retraining. Meanwhile, field inspection…

Robotics · Computer Science 2025-12-17 Hossein Naderi , Alireza Shojaei , Philip Agee , Kereshmeh Afsari , Abiola Akanmu

Vision-Language Models (VLMs) are increasingly proposed for autonomous driving tasks, yet their performance on sequential driving scenes remains poorly characterized, particularly regarding how input configurations affect their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , Mattia Piccinini , Johannes Betz

Industrial computer vision systems often struggle with noise, material variability, and uncontrolled imaging conditions, limiting the effectiveness of classical edge detectors and handcrafted pipelines. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Liang Gong , Tommy , Wang , Sara Chaker , Yanchen Dong , Fouad Bousetouane , Brenden Morton , Mark Mendez

Autonomous driving faces critical challenges in rare long-tail events and complex multi-agent interactions, which are scarce in real-world data yet essential for robust safety validation. This paper presents a high-fidelity scenario…

Machine Learning · Computer Science 2025-11-27 Yuhang Wang , Heye Huang , Zhenhua Xu , Kailai Sun , Baoshen Guo , Jinhua Zhao

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

This paper introduces an open-source benchmark for evaluating Vision-Language Models (VLMs) on Optical Character Recognition (OCR) tasks in dynamic video environments. We present a curated dataset containing 1,477 manually annotated frames…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sankalp Nagaonkar , Augustya Sharma , Ashish Choithani , Ashutosh Trivedi

To assist human drivers and autonomous vehicles in assessing crash risks, driving scene analysis using dash cameras on vehicles and deep learning algorithms is of paramount importance. Although these technologies are increasingly available,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Muhammad Monjurul Karim , Yu Li , Ruwen Qin , Zhaozheng Yin