English
Related papers

Related papers: Pedestrian Intention Prediction via Vision-Languag…

200 papers

Autonomous robotic exploration of unknown and hazardous environments, a long-standing challenge, can be significantly improved by leveraging the advanced reasoning of Vision-Language Models (VLMs). We introduce a novel exploration pipeline…

Robotics · Computer Science 2026-05-25 Aarush Aitha , Avideh Zakhor

Driver intention prediction seeks to anticipate drivers' actions by analyzing their behaviors with respect to surrounding traffic environments. Existing approaches primarily focus on late-fusion techniques, and neglect the importance of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Yunsheng Ma , Wenqian Ye , Xu Cao , Amr Abdelraouf , Kyungtae Han , Rohit Gupta , Ziran Wang

Predicting human behavior in shared environments is crucial for safe and efficient human-robot interaction. Traditional data-driven methods to that end are pre-trained on domain-specific datasets, activity types, and prediction horizons. In…

Robotics · Computer Science 2025-06-24 Yuchen Liu , Lino Lerch , Luigi Palmieri , Andrey Rudenko , Sebastian Koch , Timo Ropinski , Marco Aiello

Accurately modeling pedestrian intention and understanding driver decision-making processes are critical for the development of safe and socially aware autonomous driving systems. We introduce PSI, a benchmark dataset that captures the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Taotao Jing , Tina Chen , Renran Tian , Yaobin Chen , Joshua Domeyer , Heishiro Toyoda , Rini Sherony , Zhengming Ding

Accurate vehicle trajectory prediction is critical for safe and efficient autonomous driving, especially in mixed traffic environments when both human-driven and autonomous vehicles co-exist. However, uncertainties introduced by inherent…

Machine Learning · Computer Science 2025-08-15 Chandra Raskoti , Iftekharul Islam , Xuan Wang , Weizi Li

As autonomous vehicles (AVs) need to interact with other road users, it is of importance to comprehensively understand the dynamic traffic environment, especially the future possible trajectories of surrounding vehicles. This paper presents…

Machine Learning · Computer Science 2019-06-10 Long Xin , Pin Wang , Ching-Yao Chan , Jianyu Chen , Shengbo Eben Li , Bo Cheng

Trajectory prediction is of significant importance in computer vision. Accurate pedestrian trajectory prediction benefits autonomous vehicles and robots in planning their motion. Pedestrians' trajectories are greatly influenced by their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Pengqian Han , Jiamou Liu , Jialing He , Zeyu Zhang , Song Yang , Yanni Tang

Trajectory prediction is a fundamental technology for advanced autonomous driving systems and represents one of the most challenging problems in the field of cognitive intelligence. Accurately predicting the future trajectories of each…

Robotics · Computer Science 2025-04-24 Qu Weiming , Wang Jia , Du Jiawei , Zhu Yuanhao , Yu Jianfeng , Xia Rui , Cao Song , Wu Xihong , Luo Dingsheng

Predicting pedestrian motion trajectories is critical for path planning and motion control of autonomous vehicles. However, accurately forecasting crowd trajectories remains a challenging task due to the inherently multimodal and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

Early lane-change intention prediction is essential for autonomous driving and ADAS, but it remains challenging because lane-changing behavior depends on evolving traffic risk, surrounding-vehicle interactions, and target-lane feasibility…

Machine Learning · Computer Science 2026-05-26 Jiazhao Shi , Qiyang Xie , Ziyu Wang , Dongxu Zhang , Yichen Lin , Di Zhu , Chen Xie , Ziwei Wang , Haoyun Zhang , Enliang Li , Zetong Guan

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Pedestrians and vehicles often share the road in complex inner city traffic. This leads to interactions between the vehicle and pedestrians, with each affecting the other's motion. In order to create robust methods to reason about…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Daniela A. Ridel , Nachiket Deo , Denis Wolf , Mohan M. Trivedi

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Yugyung Lee

Detecting and predicting the behavior of pedestrians is extremely crucial for self-driving vehicles to plan and interact with them safely. Although there have been several research works in this area, it is important to have fast and memory…

Artificial Intelligence · Computer Science 2021-01-08 Prateek Agrawal , Pratik Prabhanjan Brahma

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve…

Systems and Control · Electrical Eng. & Systems 2023-03-09 Johanna Bethge , Maik Pfefferkorn , Alexander Rose , Jan Peters , Rolf Findeisen

Avoiding collisions with vulnerable road users (VRUs) using sensor-based early recognition of critical situations is one of the manifold opportunities provided by the current development in the field of intelligent vehicles. As especially…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Michael Goldhammer , Sebastian Köhler , Stefan Zernetsch , Konrad Doll , Bernhard Sick , Klaus Dietmayer

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

For autonomous driving in highly dynamic environments, it is anticipated to predict the future behaviors of surrounding vehicles (SVs) and make safe and effective decisions. However, modeling the inherent coupling effect between the…

Robotics · Computer Science 2024-08-07 Xiao Zhou , Chengzhen Meng , Wenru Liu , Zengqi Peng , Ming Liu , Jun Ma

Recent research on automotive driving developed an efficient end-to-end learning mode that directly maps visual input to control commands. However, it models distinct driving variations in a single network, which increases learning…

Robotics · Computer Science 2019-12-02 Huifang Ma , Yue Wang , Rong Xiong , Sarath Kodagoda , Li Tang