English
Related papers

Related papers: A Study of Situational Reasoning for Traffic Under…

200 papers

Traffic control in unsignalized urban intersections presents significant challenges due to the complexity, frequent conflicts, and blind spots. This study explores the capability of leveraging Multimodal Large Language Models (MLLMs), such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Sari Masri , Huthaifa I. Ashqar , Mohammed Elhenawy

The Multi-modal Large Language Models (MLLMs) with extensive world knowledge have revitalized autonomous driving, particularly in reasoning tasks within perceivable regions. However, when faced with perception-limited areas (dynamic or…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Mingliang Zhai , Cheng Li , Zengyuan Guo , Ningrui Yang , Xiameng Qin , Sanyuan Zhao , Junyu Han , Ji Tao , Yuwei Wu , Yunde Jia

Recent Vision-Language-Action (VLA) models for autonomous driving explore inference-time reasoning as a way to improve driving performance and safety in challenging scenarios. Most prior work uses natural language to express…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Shuhan Tan , Kashyap Chitta , Yuxiao Chen , Ran Tian , Yurong You , Yan Wang , Wenjie Luo , Yulong Cao , Philipp Krahenbuhl , Marco Pavone , Boris Ivanovic

Traffic monitoring is crucial for urban mobility, road safety, and intelligent transportation systems (ITS). Deep learning has advanced video-based traffic monitoring through video question answering (VideoQA) models, enabling structured…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Joseph Raj Vishal , Divesh Basina , Rutuja Patil , Manas Srinivas Gowda , Katha Naik , Yezhou Yang , Bharatesh Chakravarthi

Large language models (LLMs) show strong potential for Intelligent Transportation Systems (ITS), particularly in tasks requiring situational reasoning and multi-agent coordination. These capabilities make them well suited for cooperative…

Artificial Intelligence · Computer Science 2026-05-21 Abderrahmane Lakas , Mohamed Amine Ferrag , Merouane Debbah

Knowledge representation and reasoning has a long history of examining how knowledge can be formalized, interpreted, and semantically analyzed by machines. In the area of automated vehicles, recent advances suggest the ability to formalize…

Artificial Intelligence · Computer Science 2022-07-06 Lukas Westhofen , Christian Neurohr , Martin Butz , Maike Scholtes , Michael Schuldes

Human drivers possess spatial and causal intelligence, enabling them to perceive driving scenarios, anticipate hazards, and react to dynamic environments. In contrast, autonomous vehicles lack these abilities, making it challenging to…

Robotics · Computer Science 2025-09-12 Shucheng Huang , Freda Shi , Chen Sun , Jiaming Zhong , Minghao Ning , Yufeng Yang , Yukun Lu , Hong Wang , Amir Khajepour

We study conflict situations that dynamically arise in traffic scenarios, where different agents try to achieve their set of goals and have to decide on what to do based on their local perception. We distinguish several types of conflicts…

Multiagent Systems · Computer Science 2019-05-29 Werner Damm , Martin Fränzle , Willem Hagemann , Paul Kröger , Astrid Rakow

Urban transportation systems face growing safety challenges that require scalable intelligence for emerging smart mobility infrastructures. While recent advances in foundation models and large-scale multimodal datasets have strengthened…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Wenhui Huang , Songyan Zhang , Collister Chua , Yang Liang , Zhiqi Mao , Heng Yang , Chen Lv

Multimodal large language models (MLLMs) have shown strong potential for autonomous driving, yet existing benchmarks remain largely ego-centric and therefore cannot systematically assess model performance in infrastructure-centric and…

Robotics · Computer Science 2026-04-06 Junwei You , Pei Li , Zhuoyu Jiang , Weizhe Tang , Zilin Huang , Rui Gan , Jiaxi Liu , Yan Zhao , Sikai Chen , Bin Ran

Recent advances in video question answering (VideoQA) offer promising applications, especially in traffic monitoring, where efficient video interpretation is critical. Within ITS, answering complex, real-time queries like "How many red cars…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Joseph Raj Vishal , Divesh Basina , Aarya Choudhary , Bharatesh Chakravarthi

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Recent advances in multi-modal large language models (MLLMs) have demonstrated strong performance across various domains; however, their ability to comprehend driving scenes remains less proven. The complexity of driving scenarios, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sung-Yeon Park , Can Cui , Yunsheng Ma , Ahmadreza Moradipari , Rohit Gupta , Kyungtae Han , Ziran Wang

Traditional approaches to safety event analysis in autonomous systems have relied on complex machine learning models and extensive datasets for high accuracy and reliability. However, the advent of Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Mohammad Abu Tami , Huthaifa I. Ashqar , Mohammed Elhenawy

The recognition and understanding of traffic incidents, particularly traffic accidents, is a topic of paramount importance in the realm of intelligent transportation systems and intelligent vehicles. This area has continually captured the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Xingcheng Zhou , Alois C. Knoll

Challenges in Intelligent Traffic Monitoring (ITMo) are exacerbated by the large quantity and modalities of data and the need for the utilization of state-of-the-art (SOTA) reasoners. We formulate the problem of ITMo and introduce HANS, a…

Artificial Intelligence · Computer Science 2022-09-02 Ehsan Qasemi , Alessandro Oltramari

We study conflict situations that dynamically arise in traffic scenarios, where different agents try to achieve their set of goals and have to decide on what to do based on their local perception. We distinguish several types of conflicts…

Multiagent Systems · Computer Science 2019-11-19 Werner Damm , Martin Fränzle , Willem Hagemann , Paul Kröger , Astrid Rakow

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

We present TUMTraffic-VideoQA, a novel dataset and benchmark designed for spatio-temporal video understanding in complex roadside traffic scenarios. The dataset comprises 1,000 videos, featuring 85,000 multiple-choice QA pairs, 2,300 object…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Xingcheng Zhou , Konstantinos Larintzakis , Hao Guo , Walter Zimmer , Mingyu Liu , Hu Cao , Jiajie Zhang , Venkatnarayanan Lakshminarasimhan , Leah Strand , Alois C. Knoll

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang