English
Related papers

Related papers: Automating Crash Diagram Generation Using Vision-L…

200 papers

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

The pursuit of autonomous driving technology hinges on the sophisticated integration of perception, decision-making, and control systems. Traditional approaches, both data-driven and rule-based, have been hindered by their inability to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Licheng Wen , Xuemeng Yang , Daocheng Fu , Xiaofeng Wang , Pinlong Cai , Xin Li , Tao Ma , Yingxuan Li , Linran Xu , Dengke Shang , Zheng Zhu , Shaoyan Sun , Yeqi Bai , Xinyu Cai , Min Dou , Shuanglu Hu , Botian Shi , Yu Qiao

As robotics become increasingly integrated into construction workflows, their ability to interpret and respond to human behavior will be essential for enabling safe and effective collaboration. Vision-Language Models (VLMs) have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Hieu Bui , Nathaniel E. Chodosh , Arash Tavakoli

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Addressing hard cases in autonomous driving, such as anomalous road users, extreme weather conditions, and complex traffic interactions, presents significant challenges. To ensure safety, it is crucial to detect and manage these scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Yi Yang , Qingwen Zhang , Kei Ikemura , Nazre Batool , John Folkesson

Automating crash video analysis is essential to leverage the growing availability of driving video data for traffic safety research and accountability attribution in autonomous driving. Crash video analysis is a challenging multitask…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaidi Liang , Ke Li , Xianbiao Hu , Ruwen Qin

Urban traffic management faces significant challenges due to the dynamic environments, and traditional algorithms fail to quickly adapt to this environment in real-time and predict possible conflicts. This study explores the ability of a…

Computation and Language · Computer Science 2024-08-05 Sari Masri , Huthaifa I. Ashqar , Mohammed Elhenawy

Conventional road-situation detection methods achieve strong performance in predefined scenarios but fail in unseen cases and lack semantic interpretation, which is crucial for reliable traffic recommendations. This work introduces a…

Robotics · Computer Science 2025-11-11 Kailin Tong , Selim Solmaz , Kenan Mujkic , Gottfried Allmer , Bo Leng

Engineering design is undergoing a transformative shift with the advent of AI, marking a new era in how we approach product, system, and service planning. Large language models have demonstrated impressive capabilities in enabling this…

Artificial Intelligence · Computer Science 2024-12-10 Cyril Picard , Kristen M. Edwards , Anna C. Doris , Brandon Man , Giorgio Giannone , Md Ferdous Alam , Faez Ahmed

Detecting anomalous hazards in visual data, particularly in video streams, is a critical challenge in autonomous driving. Existing models often struggle with unpredictable, out-of-label hazards due to their reliance on predefined object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Shashank Shriram , Srinivasa Perisetla , Aryan Keskar , Harsha Krishnaswamy , Tonko Emil Westerhof Bossen , Andreas Møgelmose , Ross Greer

The rapid growth of ego-centric dashcam footage presents a major challenge for detecting safety-critical events such as collisions and near-collisions, scenarios that are brief, rare, and difficult for generic vision models to capture.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mohammad Qazim Bhat , Yufan Huang , Niket Agarwal , Hao Wang , Michael Woods , John Kenyon , Tsung-Yi Lin , Xiaodong Yang , Ming-Yu Liu , Kevin Xie

Vision-Language Models (VLMs) and Multi-Modal Language models (MMLMs) have become prominent in autonomous driving research, as these models can provide interpretable textual reasoning and responses for end-to-end autonomous driving safety…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Akshay Gopalkrishnan , Ross Greer , Mohan Trivedi

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

Artificial Intelligence · Computer Science 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Handling long tail corner cases is a major challenge faced by autonomous vehicles (AVs). While large language models (LLMs) hold great potentials to handle the corner cases with excellent generalization and explanation capabilities and…

Artificial Intelligence · Computer Science 2024-07-25 Zuoyin Tang , Jianhua He , Dashuai Pei , Kezhong Liu , Tao Gao

Recent advances in multimodal large language models enable new possibilities for image-based decision support. However, their reliability and operational trade-offs in neuroimaging remain insufficiently understood. We present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Katarina Trojachanec Dineva , Stefan Andonov , Ilinka Ivanoska , Ivan Kitanovski , Sasho Gramatikov , Tamara Kostova , Monika Simjanoska Misheva , Kostadin Mishev

Engineering drawings are fundamental to manufacturing communication, serving as the primary medium for conveying design intent, tolerances, and production details. However, interpreting complex multi-view drawings with dense annotations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Muhammad Tayyab Khan , Zane Yong , Lequn Chen , Wenhe Feng , Nicholas Yew Jin Tan , Seung Ki Moon

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande

Autonomous driving is a complex and challenging task that aims at safe motion planning through scene understanding and reasoning. While vision-only autonomous driving methods have recently achieved notable performance, through enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chenbin Pan , Burhaneddin Yaman , Tommaso Nesti , Abhirup Mallik , Alessandro G Allievi , Senem Velipasalar , Liu Ren