English
Related papers

Related papers: TrafficLens: Multi-Camera Traffic Video Analysis U…

200 papers

Multimodal large language models (MLLMs) have demonstrated remarkable potential for enhancing scene understanding in autonomous driving systems through powerful logical reasoning capabilities. However, the deployment of these models faces…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Yunsheng Ma , Amr Abdelraouf , Rohit Gupta , Ziran Wang , Kyungtae Han

Traffic control in unsignalized urban intersections presents significant challenges due to the complexity, frequent conflicts, and blind spots. This study explores the capability of leveraging Multimodal Large Language Models (MLLMs), such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Sari Masri , Huthaifa I. Ashqar , Mohammed Elhenawy

Extracting actionable insights from long-duration urban videos is often labor-intensive: analysts must manually sift through raw footage to pinpoint target events or uncover broader behavioral trends. In this work, we present…

Human-Computer Interaction · Computer Science 2026-04-17 Joel Perca , Luis Sante , Juanpablo Heredia , Joao Rulff , Claudio Silva , Jorge Poco

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

The advent of Large Multimodal Models (LMMs) has significantly enhanced Large Language Models (LLMs) to process and interpret diverse data modalities (e.g., image and video). However, as input complexity increases, particularly with long…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Shilin Yan , Jiaming Han , Joey Tsai , Hongwei Xue , Rongyao Fang , Lingyi Hong , Ziyu Guo , Ray Zhang

This study examines the feasibility of applying large language models (LLMs) for forecasting the impact of traffic incidents on the traffic flow. The use of LLMs for this task has several advantages over existing machine learning-based…

Artificial Intelligence · Computer Science 2025-07-08 George Jagadeesh , Srikrishna Iyer , Michal Polanowski , Kai Xin Thia

Traffic Signal Control (TSC) plays a critical role in urban traffic management by optimizing traffic flow and mitigating congestion. While Large Language Models (LLMs) have recently emerged as promising tools for TSC due to their…

Machine Learning · Computer Science 2025-03-18 Zirui Yuan , Siqi Lai , Hao Liu

This study aims to comprehensively review and empirically evaluate the application of multimodal large language models (MLLMs) and Large Vision Models (VLMs) in object detection for transportation systems. In the first fold, we provide a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Huthaifa I. Ashqar , Ahmed Jaber , Taqwa I. Alhadidi , Mohammed Elhenawy

Large Language Models (LLMs) offer significant promise for intelligent traffic management; however, current chain-based systems like TrafficGPT are hindered by sequential task execution, high token usage, and poor scalability, making them…

Artificial Intelligence · Computer Science 2025-07-21 Nabil Abdelaziz Ferhat Taleb , Abdolazim Rezaei , Raj Atulkumar Patel , Mehdi Sookhak

Cooperative autonomous driving requires traffic scene understanding from both vehicle and infrastructure perspectives. While vision-language models (VLMs) show strong general reasoning capabilities, their performance in safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rui Gan , Junyi Ma , Pei Li , Xingyou Yang , Kai Chen , Sikai Chen , Bin Ran

The recognition and understanding of traffic incidents, particularly traffic accidents, is a topic of paramount importance in the realm of intelligent transportation systems and intelligent vehicles. This area has continually captured the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Xingcheng Zhou , Alois C. Knoll

Traffic Signal Control (TSC) is a crucial component in urban traffic management, aiming to optimize road network efficiency and reduce congestion. Traditional TSC methods, primarily based on transportation engineering and reinforcement…

Artificial Intelligence · Computer Science 2024-12-18 Siqi Lai , Zhao Xu , Weijia Zhang , Hao Liu , Hui Xiong

While accurate traffic forecasting is vital for Intelligent Transportation Systems (ITS), effectively communicating predicted conditions via natural language for human-centric decision support remains a challenge and is often handled…

Machine Learning · Computer Science 2026-01-13 Zeming Du , Qitan Shao , Hongfei Liu , Yong Zhang

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Understanding abnormal events in videos is a vital and challenging task that has garnered significant attention in a wide range of applications. Although current video understanding Multi-modal Large Language Models (MLLMs) are capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yingxian Chen , Jiahui Liu , Ruidi Fan , Yanwei Li , Chirui Chang , Shizhen Zhao , Wilton W. T. Fok , Xiaojuan Qi , Yik-Chung Wu

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Autonomous vehicles (AVs) rely on sophisticated perception systems to interpret their surroundings, a cornerstone for safe navigation and decision-making. The integration of Large Language Models (LLMs) into AV perception frameworks offers…

Robotics · Computer Science 2024-12-31 Athanasios Karagounis

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Mobility analysis is a crucial element in the research area of transportation systems. Forecasting traffic information offers a viable solution to address the conflict between increasing transportation demands and the limitations of…

Machine Learning · Computer Science 2025-02-24 Zijian Zhang , Yujie Sun , Zepu Wang , Yuqi Nie , Xiaobo Ma , Ruolin Li , Peng Sun , Xuegang Ban

Accident detection and traffic analysis is a critical component of smart city and autonomous transportation systems that can reduce accident frequency, severity and improve overall traffic management. This paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Victor Adewopo , Nelly Elsayed , Zag Elsayed , Murat Ozer , Victoria Wangia-Anderson , Ahmed Abdelgawad