English
Related papers

Related papers: TrafficLens: Multi-Camera Traffic Video Analysis U…

200 papers

Recently, Vision Large Language Models (VLLMs) integrated with vision encoders have shown promising performance in vision understanding. The key of VLLMs is to encode visual content into sequences of visual tokens, enabling VLLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zhuqiang Lu , Zhenfei Yin , Mengwei He , Zhihui Wang , Zicheng Liu , Zhiyong Wang , Kun Hu

Video Large Language Models (Video-LLMs) excel at understanding videos in-context, provided they have full access to the video when answering queries. However, these models face challenges in streaming scenarios where hour-long videos must…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Vaggelis Dorovatas , Soroush Seifi , Gunshi Gupta , Rahaf Aljundi

Pedestrian safety is a critical component of urban mobility and is strongly influenced by the interactions between pedestrian decision-making and driver yielding behavior at crosswalks. Modeling driver--pedestrian interactions at…

Computation and Language · Computer Science 2025-09-25 Yicheng Yang , Zixian Li , Jean Paul Bizimana , Niaz Zafri , Yongfeng Dong , Tianyi Li

Traffic signal control (TSC) is a core challenge in urban mobility, where real-time decisions must balance efficiency and safety. Existing methods - ranging from rule-based heuristics to reinforcement learning (RL) - often struggle to…

Systems and Control · Electrical Eng. & Systems 2025-12-12 Maonan Wang , Yirong Chen , Aoyu Pang , Yuxin Cai , Chung Shue Chen , Yuheng Kan , Man-On Pun

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

Computational Engineering, Finance, and Science · Computer Science 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

Traffic forecasting is crucial for intelligent transportation systems. It has experienced significant advancements thanks to the power of deep learning in capturing latent patterns of traffic data. However, recent deep-learning…

Machine Learning · Computer Science 2026-01-19 Xusen Guo , Qiming Zhang , Junyue Jiang , Mingxing Peng , Meixin Zhu , Hao , Yang

Traditionally, neighborhood studies have used interviews, surveys, and manual image annotation guided by detailed protocols to identify environmental characteristics, including physical disorder, decay, street safety, and sociocultural…

Human-Computer Interaction · Computer Science 2025-10-14 Jina Kim , Leeje Jang , Yao-Yi Chiang , Guanyu Wang , Michelle C. Pasco

Empowered by Large Language Models (LLMs), recent advancements in Video-based LLMs (VideoLLMs) have driven progress in various video understanding tasks. These models encode video representations through pooling or query aggregation over a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuetian Weng , Mingfei Han , Haoyu He , Xiaojun Chang , Bohan Zhuang

Transforming a large language model (LLM) into a Vision-Language Model (VLM) can be achieved by mapping the visual tokens from a vision encoder into the embedding space of an LLM. Intriguingly, this mapping can be as simple as a shallow MLP…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Benno Krojer , Shravan Nayak , Oscar Mañas , Vaibhav Adlakha , Desmond Elliott , Siva Reddy , Marius Mosbach

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji

Visual Language Models (VLMs) are now increasingly being merged with Large Language Models (LLMs) to enable new capabilities, particularly in terms of improved interactivity and open-ended responsiveness. While these are remarkable…

With the acceleration of urbanization, modern urban traffic systems are becoming increasingly complex, leading to frequent traffic anomalies. These anomalies encompass not only common traffic jams but also more challenging issues such as…

Artificial Intelligence · Computer Science 2025-03-04 Tianchi Ren , Haibo Hu , Jiacheng Zuo , Xinhong Chen , Jianping Wang , Chun Jason Xue , Jen-Ming Wu , Nan Guan

Large Multimodal Models (LMMs) have recently gained prominence in autonomous driving research, showcasing promising capabilities across various emerging benchmarks. LMMs specifically designed for this domain have demonstrated effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Ayesha Ishaq , Jean Lahoud , Fahad Shahbaz Khan , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer

Pre-trained vision-language models (VLMs) have enabled significant progress in open vocabulary computer vision tasks such as image classification, object detection and image segmentation. Some recent works have focused on extending VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Rohit Gupta , Mamshad Nayeem Rizve , Jayakrishnan Unnikrishnan , Ashish Tawari , Son Tran , Mubarak Shah , Benjamin Yao , Trishul Chilimbi

Road traffic accidents represent a leading cause of mortality globally, with incidence rates rising due to increasing population, urbanization, and motorization. Rising accident rates raise concerns about traffic surveillance effectiveness.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Tanu Singh , Pranamesh Chakraborty , Long T. Truong

In this paper, we address the challenge of fine-grained video event understanding in traffic scenarios, vital for autonomous driving and safety. Traditional datasets focus on driver or vehicle behavior, often neglecting pedestrian…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Quan Kong , Yuki Kawana , Rajat Saini , Ashutosh Kumar , Jingjing Pan , Ta Gu , Yohei Ozao , Balazs Opra , David C. Anastasiu , Yoichi Sato , Norimasa Kobori

With the exponential growth of video data, there is an urgent need for automated technology to analyze and comprehend video content. However, existing video understanding models are often task-specific and lack a comprehensive capability of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Guo Chen , Yin-Dong Zheng , Jiahao Wang , Jilan Xu , Yifei Huang , Junting Pan , Yi Wang , Yali Wang , Yu Qiao , Tong Lu , Limin Wang

Vision-language models (VLMs) have emerged as powerful tools for enabling automated traffic analysis; however, current approaches often demand substantial computational resources and struggle with fine-grained spatio-temporal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Tinh-Anh Nguyen-Nhu , Triet Dao Hoang Minh , Dat To-Thanh , Phuc Le-Gia , Tuan Vo-Lan , Tien-Huy Nguyen