中文
相关论文

相关论文: Pedestrian Intention Prediction via Vision-Languag…

200 篇论文

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions.…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Lina Achaji , Julien Moreau , François Aioun , François Charpillet

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus…

计算与语言 · 计算机科学 2024-08-26 Songwei Li , Jie Feng , Jiawei Chi , Xinyuan Hu , Xiaomeng Zhao , Fengli Xu

In recent years, road safety has attracted significant attention from researchers and practitioners in the intelligent transport systems domain. As one of the most common and vulnerable groups of road users, pedestrians cause great concerns…

机器人学 · 计算机科学 2021-11-09 Zheyu Zhang , Boyang Wang , Chao Lu , Jinghang Li , Cheng Gong , Jianwei Gong

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Understanding and predicting pedestrian crossing behavioral intention is crucial for the driving safety of autonomous vehicles. Nonetheless, challenges emerge when using promising images or environmental context masks to extract various…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Chen Xie , Ciyun Lin , Xiaoyu Zheng , Bowen Gong , Antonio M. López

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

人工智能 · 计算机科学 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

With the rapid advancements in autonomous driving, accurately predicting pedestrian behavior has become essential for ensuring safety in complex and unpredictable traffic conditions. The growing interest in this challenge highlights the…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Ruthvik Bokkasam , Shankar Gangisetty , A. H. Abdul Hafez , C. V. Jawahar

Human intention-based systems enable robots to perceive and interpret user actions to interact with humans and adapt to their behavior proactively. Therefore, intention prediction is pivotal in creating a natural interaction with social…

机器人学 · 计算机科学 2025-04-09 Hassan Ali , Philipp Allgeuer , Stefan Wermter

The world is constantly moving towards AI based systems and autonomous vehicles are now reality in different parts of the world. These vehicles require sensors and cameras to detect objects and maneuver according to that. It becomes…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Subhasis Dasgupta , Preetam Saha , Agniva Roy , Jaydip Sen

Current video understanding models excel at recognizing "what" is happening but fall short in high-level cognitive tasks like causal reasoning and future prediction, a limitation rooted in their lack of commonsense world knowledge. To…

计算机视觉与模式识别 · 计算机科学 2025-12-30 L'ea Dubois , Klaus Schmidt , Chengyu Wang , Ji-Hoon Park , Lin Wang , Santiago Munoz

In mixed-traffic environments, autonomous vehicles (AVs) must interact with heterogeneous human-driven vehicles (HVs) whose intentions and driving styles vary across individuals and scenarios. Such variability introduces uncertainty into…

机器人学 · 计算机科学 2026-03-18 Xiaoyun Qiu , Haichao Liu , Yue Pan , Jun Ma , Xinhu Zheng

Understanding the short-term motion of vulnerable road users (VRUs) like pedestrians and cyclists is critical for safe autonomous driving, especially in urban scenarios with ambiguous or high-risk behaviors. While vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Mihir Godbole , Xiangbo Gao , Zhengzhong Tu

Predicting pedestrian crossing intention is an indispensable aspect of deploying advanced driving systems (ADS) or advanced driver-assistance systems (ADAS) to real life. State-of-the-art methods in predicting pedestrian crossing intention…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Zhuoran Zeng

Pedestrian action prediction is of great significance for many applications such as autonomous driving. However, state-of-the-art methods lack explainability to make trustworthy predictions. In this paper, a novel framework called MulCPred…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Yan Feng , Alexander Carballo , Keisuke Fujii , Robin Karlsson , Ming Ding , Kazuya Takeda

Autonomous Vehicles (AVs) must make reliable decisions in dense urban environments where pedestrian behavior is variable, sometimes abnormal, and often unseen during training. Reinforcement learning (RL)-based AV control systems perform…

机器人学 · 计算机科学 2026-05-19 Aidana Baimbetova , Haruki Yonekura , Hamada Rizk , Hirozumi Yamaguchi

In the driving scene, the road agents usually conduct frequent interactions and intention understanding of the surroundings. Ego-agent (each road agent itself) predicts what behavior will be engaged by other road users all the time and…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Jianwu Fang , Fan Wang , Jianru Xue , Tat-seng Chua

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Understanding and predicting human behavior in-thewild, particularly at urban intersections, remains crucial for enhancing interaction safety between road users. Among the most critical behaviors are crossing intentions of Vulnerable Road…

计算机视觉与模式识别 · 计算机科学 2025-05-16 Ahmed S. Abdelrahman , Mohamed Abdel-Aty , Quoc Dai Tran