English
Related papers

Related papers: PEDESTRIANQA: A Benchmark for Vision-Language Mode…

200 papers

In crowd scenarios, predicting trajectories of pedestrians is a complex and challenging task depending on many external factors. The topology of the scene and the interactions between the pedestrians are just some of them. Due to…

Machine Learning · Computer Science 2022-09-12 Raphael Korbmacher , Antoine Tordeux

Accurately predicting the trajectory of surrounding vehicles is a critical challenge for autonomous vehicles. In complex traffic scenarios, there are two significant issues with the current autonomous driving system: the cognitive…

Robotics · Computer Science 2024-09-25 Wen Wei , Jiankun Wang

Predicting pedestrian motion trajectories is critical for the path planning and motion control of autonomous vehicles. Recent diffusion-based models have shown promising results in capturing the inherent stochasticity of pedestrian behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

If a Large Language Model (LLM) were to take a driving knowledge test today, would it pass? Beyond standard spatial and visual question-answering (QA) tasks on current autonomous driving benchmarks, driving knowledge tests require a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Maolin Wei , Wanzhou Liu , Eshed Ohn-Bar

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani

To ensure safe autonomous driving in urban environments with complex vehicle-pedestrian interactions, it is critical for Autonomous Vehicles (AVs) to have the ability to predict pedestrians' short-term and immediate actions in real-time. In…

Robotics · Computer Science 2023-05-23 Jia Huang , Alvika Gautam , Srikanth Saripalli

Autonomous Vehicles (AVs) must make reliable decisions in dense urban environments where pedestrian behavior is variable, sometimes abnormal, and often unseen during training. Reinforcement learning (RL)-based AV control systems perform…

Robotics · Computer Science 2026-05-19 Aidana Baimbetova , Haruki Yonekura , Hamada Rizk , Hirozumi Yamaguchi

Pedestrian trajectory prediction is a critical technology in the evolution of self-driving cars toward complete artificial intelligence. Over recent years, focusing on the trajectories of pedestrians to model their social interactions has…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Jiajia Xie , Sheng Zhang , Beihao Xia , Zhu Xiao , Hongbo Jiang , Siwang Zhou , Zheng Qin , Hongyang Chen

The evolution of autonomous driving towards full automation demands robust interactive capabilities; however, the development of Vision-Language-Action (VLA) models is constrained by the sparsity of interactive scenarios and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Haojie Feng , Peizhi Zhang , Mengjie Tian , Xinrui Zhang , Zhuoren Li , Junpeng Huang , Xiurong Wang , Junfan Zhu , Jianzhou Wang , Dongxiao Yin , Lu Xiong

Walking as a form of active travel is essential in promoting sustainable transport. It is thus crucial to accurately predict pedestrian crossing intention and avoid collisions, especially with the advent of autonomous and advanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Chia-Yen Chiang , Yasmin Fathy , Gregory Slabaugh , Mona Jaber

Predicting the future trajectories of pedestrians on the road is an important task for autonomous driving. The pedestrian trajectory prediction is affected by scene paths, pedestrian's intentions and decision-making, which is a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Amar Fadillah , Ching-Lin Lee , Zhi-Xuan Wang , Kuan-Ting Lai

Vision Language Models (VLMs) demonstrate significant potential as embodied AI agents for various mobility applications. However, a standardized, closed-loop benchmark for evaluating their spatial reasoning and sequential decision-making…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Weizhen Wang , Chenda Duan , Zhenghao Peng , Yuxin Liu , Bolei Zhou

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems. Pedestrians often exhibit complex behaviors influenced by various contextual elements. To address this problem, we propose BiPed, a multitask…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Amir Rasouli , Mohsen Rohani , Jun Luo

Recent advances in autonomous driving have motivated research on pedestrian intention prediction, which aims to infer future crossing decisions and actions by modeling temporal dynamics, social interactions, and environmental context.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yanping Wu , Meiting Dang , Lin Wu , Edmond S. L. Ho , Zhenghua Chen , Chongfeng Wei

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

In recent years, road safety has attracted significant attention from researchers and practitioners in the intelligent transport systems domain. As one of the most common and vulnerable groups of road users, pedestrians cause great concerns…

Robotics · Computer Science 2021-11-09 Zheyu Zhang , Boyang Wang , Chao Lu , Jinghang Li , Cheng Gong , Jianwei Gong

Traffic prediction constitutes a pivotal facet within the purview of Intelligent Transportation Systems (ITS), and the attainment of highly precise predictions holds profound significance for efficacious traffic management. The precision of…

Machine Learning · Computer Science 2024-10-27 Yilong Ren , Yue Chen , Shuai Liu , Boyue Wang , Haiyang Yu , Zhiyong Cui

Understanding the behaviors and intentions of humans are one of the main challenges autonomous ground vehicles still faced with. More specifically, when it comes to complex environments such as urban traffic scenes, inferring the intentions…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Khaled Saleh , Mohammed Hossny , Saeid Nahavandi