English
Related papers

Related papers: TAU-R1: Visual Language Model for Traffic Anomaly …

200 papers

VILA-U is a Unified foundation model that integrates Video, Image, Language understanding and generation. Traditional visual language models (VLMs) use separate modules for understanding and generating visual content, which can lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Yecheng Wu , Zhuoyang Zhang , Junyu Chen , Haotian Tang , Dacheng Li , Yunhao Fang , Ligeng Zhu , Enze Xie , Hongxu Yin , Li Yi , Song Han , Yao Lu

We introduce STSBench, a scenario-based framework to benchmark the holistic understanding of vision-language models (VLMs) for autonomous driving. The framework automatically mines pre-defined traffic scenarios from any dataset using…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Christian Fruhwirth-Reisinger , Dušan Malić , Wei Lin , David Schinagl , Samuel Schulter , Horst Possegger

Vision-language model-based mobile agents have gained the ability to understand complex instructions and mobile screenshots, benefiting from reinforcement learning paradigms like Group Relative Policy Optimization (GRPO). However, existing…

Artificial Intelligence · Computer Science 2026-04-28 Jihao Gu , Qihang Ai , Yingyao Wang , Pi Bu , Jingxuan Xing , Zekun Zhu , Wei Jiang , Ziming Wang , Yingxiu Zhao , Ming-Liang Zhang , Jun Song , Yuning Jiang , Bo Zheng

Vision-language models (VLMs) have recently emerged as a promising paradigm for video anomaly detection (VAD) due to their strong visual reasoning ability and natural language-based explainability. In this paper, we aim to address a key…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Mitchell Piehl , Muchao Ye

In modern urban environments, camera networks generate massive amounts of operational footage -- reaching petabytes each day -- making scalable video analytics essential for efficient processing. Many existing approaches adopt an SQL-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yanrui Yu , Tianfei Zhou , Jiaxin Sun , Lianpeng Qiao , Lizhong Ding , Ye Yuan , Guoren Wang

Anomaly detection, which aims to identify anomalies deviating from normal patterns, is challenging due to the limited amount of normal data available. Unlike most existing unified methods that rely on carefully designed image feature…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Jiawei Liu , Jiahe Hou , Wei Wang , Jinsong Du , Yang Cong , Huijie Fan

Vision-language models (VLMs) have emerged as powerful tools for enabling automated traffic analysis; however, current approaches often demand substantial computational resources and struggle with fine-grained spatio-temporal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Tinh-Anh Nguyen-Nhu , Triet Dao Hoang Minh , Dat To-Thanh , Phuc Le-Gia , Tuan Vo-Lan , Tien-Huy Nguyen

Spoken Language Understanding (SLU), which aims to extract user semantics to execute downstream tasks, is a crucial component of task-oriented dialog systems. Existing SLU datasets generally lack sufficient diversity and complexity, and…

Computation and Language · Computer Science 2025-12-02 Yuezhang Peng , Chonghao Cai , Ziang Liu , Shuai Fan , Sheng Jiang , Hua Xu , Yuxin Liu , Qiguang Chen , Kele Xu , Yao Li , Sheng Wang , Libo Qin , Xie Chen

Roundabouts reduce severe crashes, yet risk patterns vary by conditions. This study analyzes 2017-2021 Ohio roundabout crashes using a two-step, explainable workflow. Cluster Correspondence Analysis (CCA) identifies co-occurring factors and…

Artificial Intelligence · Computer Science 2025-09-17 Rohit Chakraborty , Subasish Das

The rapidly evolving cloud platforms and the escalating complexity of network traffic demand proper network traffic monitoring and anomaly detection to ensure network security and performance. This paper introduces a large language model…

Networking and Internet Architecture · Computer Science 2025-04-28 Ze Yang , Yihong Jin , Juntian Liu , Xinhe Xu , Yihan Zhang , Shuyang Ji

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Anomaly detection in connected autonomous vehicles (CAVs) is crucial for maintaining safe and reliable transportation networks, as CAVs can be susceptible to sensor malfunctions, cyber-attacks, and unexpected environmental disruptions. This…

Machine Learning · Computer Science 2025-07-01 Prathyush Kumar Reddy Lebaku , Lu Gao , Yunpeng Zhang , Zhixia Li , Yongxin Liu , Tanvir Arafin

Learning diverse and high-fidelity traffic simulations from human driving demonstrations is crucial for autonomous driving evaluation. The recent next-token prediction (NTP) paradigm, widely adopted in large language models (LLMs), has been…

Robotics · Computer Science 2026-03-30 Ziyan Wang , Peng Chen , Ding Li , Chiwei Li , Qichao Zhang , Zhongpu Xia , Guizhen Yu

Pedestrian-vehicle incidents remain a critical urban safety challenge, with pedestrians accounting for over 20% of global traffic fatalities. Although existing video-based systems can detect when incidents occur, they provide little insight…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Hao Zhen , Yunxiang Yang , Jidong J. Yang

Explainable video anomaly detection (VAD) is crucial for safety-critical applications, yet even with recent progress, much of the research still lacks spatial grounding, making the explanations unverifiable. This limitation is especially…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Inpyo Song , Minjun Joo , Joonhyung Kwon , Eunji Jeon , Jangwon Lee

This paper presents a mixed traffic control policy designed to optimize traffic efficiency across diverse road topologies, addressing issues of congestion prevalent in urban environments. A model-free reinforcement learning (RL) approach is…

Robotics · Computer Science 2025-01-29 Chuyang Xiao , Dawei Wang , Xinzheng Tang , Jia Pan , Yuexin Ma

We introduce RoadSocial, a large-scale, diverse VideoQA dataset tailored for generic road event understanding from social media narratives. Unlike existing datasets limited by regional bias, viewpoint bias and expert-driven annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Chirag Parikh , Deepti Rawat , Rakshitha R. T. , Tathagata Ghosh , Ravi Kiran Sarvadevabhatla

Video anomaly detection (VAD) is crucial in scenarios such as surveillance and autonomous driving, where timely detection of unexpected activities is essential. Although existing methods have primarily focused on detecting anomalous objects…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yuzhi Huang , Chenxin Li , Haitao Zhang , Zixu Lin , Yunlong Lin , Hengyu Liu , Wuyang Li , Xinyu Liu , Jiechao Gao , Yue Huang , Xinghao Ding , Yixuan Yuan

Vision-Language (VL) models have garnered considerable research interest; however, they still face challenges in effectively handling text within images. To address this limitation, researchers have developed two approaches. The first…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Jonathan Fhima , Elad Ben Avraham , Oren Nuriel , Yair Kittenplon , Roy Ganz , Aviad Aberdam , Ron Litman

Traffic anomaly detection has played a crucial role in Intelligent Transportation System (ITS). The main challenges of this task lie in the highly diversified anomaly scenes and variational lighting conditions. Although much work has…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Jingyuan Chen , Guanchen Ding , Yuchen Yang , Wenwei Han , Kangmin Xu , Tianyi Gao , Zhe Zhang , Wanping Ouyang , Hao Cai , Zhenzhong Chen