English
Related papers

Related papers: A Study of Situational Reasoning for Traffic Under…

200 papers

Understanding a driver's behavior and intentions is important for potential risk assessment and early accident prevention. Safety and driver assistance systems can be tailored to individual drivers' behavior, significantly enhancing their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junda Wu , Jessica Echterhoff , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in Traffic Accident Detection (TAD) and Traffic Accident Understanding (TAU). However, existing studies mainly focus on describing and interpreting accident videos,…

Computation and Language · Computer Science 2026-04-24 Zijin Zhou , Songan Zhang

Everyday conversations require understanding everyday events, which in turn, requires understanding temporal commonsense concepts interwoven with those events. Despite recent progress with massive pre-trained language models (LMs) such as…

Computation and Language · Computer Science 2021-06-09 Lianhui Qin , Aditya Gupta , Shyam Upadhyay , Luheng He , Yejin Choi , Manaal Faruqui

Accurate trajectory prediction has long been a major challenge for autonomous driving (AD). Traditional data-driven models predominantly rely on statistical correlations, often overlooking the causal relationships that govern traffic…

Artificial Intelligence · Computer Science 2025-05-13 Bonan Wang , Haicheng Liao , Chengyue Wang , Bin Rao , Yanchen Guan , Guyang Yu , Jiaxun Zhang , Songning Lai , Chengzhong Xu , Zhenning Li

Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaohui Wang , Tengbo Yu , Hao Tang

Traffic scene understanding is essential for enabling autonomous vehicles to accurately perceive and interpret their environment, thereby ensuring safe navigation. This paper presents a novel framework that transforms a single frontal-view…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Danial Sadrian Zadeh , Otman A. Basir , Behzad Moshiri

Large Language Models (LLMs) have shown promise in the autonomous driving sector, particularly in generalization and interpretability. We introduce a unique object-level multimodal LLM architecture that merges vectorized numeric modalities…

LLM-powered multimodal systems are increasingly used to interpret human behavior, yet how researchers apply the models' 'social competence' remains poorly understood. This paper presents a systematic literature review of 176 publications…

Human-Computer Interaction · Computer Science 2025-11-19 Zihan Liu , Parisa Rabbani , Veda Duddu , Kyle Fan , Madison Lee , Yun Huang

Accurate driving behavior recognition and reasoning are critical for autonomous driving video understanding. However, existing methods often tend to dig out the shallow causal, fail to address spurious correlations across modalities, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Tongtong Cheng , Rongzhen Li , Yixin Xiong , Tao Zhang , Jing Wang , Kai Liu

Vehicle crashes involve complex interactions between road users, split-second decisions, and challenging environmental conditions. Among these, two-vehicle crashes are the most prevalent, accounting for approximately 70% of roadway crashes…

Artificial Intelligence · Computer Science 2025-10-16 Boyou Chen , Gerui Xu , Zifei Wang , Huizhong Guo , Ananna Ahmed , Zhaonan Sun , Zhen Hu , Kaihan Zhang , Shan Bao

The current expressway operation relies on rule-based and isolated models, which limits the ability to jointly analyze knowledge across different systems. Meanwhile, Large Language Models (LLMs) are increasingly applied in intelligent…

Artificial Intelligence · Computer Science 2026-03-18 Zihe Wang , Yihuan Wang , Haiyang Yu. Zhiyong Cui , Xiaojian Liao , Chengcheng Wang , Yonglin Tian , Yongxin Tong

Existing learning-based autonomous driving (AD) systems face challenges in comprehending high-level information, generalizing to rare events, and providing interpretability. To address these problems, this work employs Large Language Models…

Robotics · Computer Science 2025-04-16 Hao Sha , Yao Mu , Yuxuan Jiang , Li Chen , Chenfeng Xu , Ping Luo , Shengbo Eben Li , Masayoshi Tomizuka , Wei Zhan , Mingyu Ding

With the acceleration of urbanization, modern urban traffic systems are becoming increasingly complex, leading to frequent traffic anomalies. These anomalies encompass not only common traffic jams but also more challenging issues such as…

Artificial Intelligence · Computer Science 2025-03-04 Tianchi Ren , Haibo Hu , Jiacheng Zuo , Xinhong Chen , Jianping Wang , Chun Jason Xue , Jen-Ming Wu , Nan Guan

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Modern transportation systems face pressing challenges due to increasing demand, dynamic environments, and heterogeneous information integration. The rapid evolution of Large Language Models (LLMs) offers transformative potential to address…

Artificial Intelligence · Computer Science 2025-06-24 Tong Nie , Jian Sun , Wei Ma

The widespread adoption of dashcams has made video evidence in traffic accidents increasingly abundant, yet transforming "what happened in the video" into "who is responsible under which legal provisions" still relies heavily on human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Jingchun Yang , Jinchang Zhang

Existing benchmarks for Vision-Language Model (VLM) on autonomous driving (AD) primarily assess interpretability through open-form visual question answering (QA) within coarse-grained tasks, which remain insufficient to assess capabilities…

Computation and Language · Computer Science 2025-03-28 Yue Li , Meng Tian , Zhenyu Lin , Jiangtong Zhu , Dechang Zhu , Haiqiang Liu , Zining Wang , Yueyi Zhang , Zhiwei Xiong , Xinhai Zhao

Traditional autonomous driving systems often struggle to connect high-level reasoning with low-level control, leading to suboptimal and sometimes unsafe behaviors. Recent advances in multimodal large language models (MLLMs), which process…

Robotics · Computer Science 2025-06-09 Jiawei Zhang , Xuan Yang , Taiqi Wang , Yu Yao , Aleksandr Petiushko , Bo Li