English
Related papers

Related papers: VIT-Ped: Visionary Intention Transformer for Pedes…

200 papers

Pedestrian intention and trajectory prediction are critical for the safe deployment of autonomous driving systems, directly influencing navigation decisions in complex traffic environments. Recent advances in large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Naman Mishra , Shankar Gangisetty , C. V. Jawahar

Detecting and predicting the behavior of pedestrians is extremely crucial for self-driving vehicles to plan and interact with them safely. Although there have been several research works in this area, it is important to have fast and memory…

Artificial Intelligence · Computer Science 2021-01-08 Prateek Agrawal , Pratik Prabhanjan Brahma

We propose a novel solution for predicting future trajectories of pedestrians. Our method uses a multimodal encoder-decoder transformer architecture, which takes as input both pedestrian locations and ego-vehicle speeds. Notably, our…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haleh Damirchi , Michael Greenspan , Ali Etemad

Accurate pedestrian intention prediction (PIP) by Autonomous Vehicles (AVs) is one of the current research challenges in this field. In this article, we introduce PIP-Net, a novel framework designed to predict pedestrian crossing intentions…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Mohsen Azarmi , Mahdi Rezaei , He Wang

Reasoning over visual data is a desirable capability for robotics and vision-based applications. Such reasoning enables forecasting of the next events or actions in videos. In recent years, various models have been developed based on…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Bingbin Liu , Ehsan Adeli , Zhangjie Cao , Kuan-Hui Lee , Abhijeet Shenoi , Adrien Gaidon , Juan Carlos Niebles

In order to plan a safe maneuver, self-driving vehicles need to understand the intent of other traffic participants. We define intent as a combination of discrete high-level behaviors as well as continuous trajectories describing future…

Robotics · Computer Science 2021-01-21 Sergio Casas , Wenjie Luo , Raquel Urtasun

The advancement of socially-aware autonomous vehicles hinges on precise modeling of human behavior. Within this broad paradigm, the specific challenge lies in accurately predicting pedestrian's trajectory and intention. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Farzeen Munir , Tomasz Piotr Kucner

Predicting pedestrian crossing intention is an indispensable aspect of deploying advanced driving systems (ADS) or advanced driver-assistance systems (ADAS) to real life. State-of-the-art methods in predicting pedestrian crossing intention…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Zhuoran Zeng

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Amir Rasouli , Tiffany Yau , Mohsen Rohani , Jun Luo

Understanding and predicting pedestrian crossing behavioral intention is crucial for the driving safety of autonomous vehicles. Nonetheless, challenges emerge when using promising images or environmental context masks to extract various…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Chen Xie , Ciyun Lin , Xiaoyu Zheng , Bowen Gong , Antonio M. López

Predicting pedestrian crossing intention is crucial for autonomous vehicles to prevent pedestrian-related collisions. However, effectively extracting and integrating complementary cues from different types of data remains one of the major…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuanzhe Li , Steffen Müller

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lina Achaji , Julien Moreau , François Aioun , François Charpillet

Pedestrian intention recognition is very important to develop robust and safe autonomous driving (AD) and advanced driver assistance systems (ADAS) functionalities for urban driving. In this work, we develop an end-to-end pedestrian…

Current research on pedestrian behavior understanding focuses on the dynamics of pedestrians and makes strong assumptions about their perceptual abilities. For instance, it is often presumed that pedestrians have omnidirectional view of the…

Artificial Intelligence · Computer Science 2023-02-09 Iuliia Kotseruba , Amir Rasouli

Predicting pedestrian motion trajectories is critical for the path planning and motion control of autonomous vehicles. Recent diffusion-based models have shown promising results in capturing the inherent stochasticity of pedestrian behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

Accurate vehicle trajectory prediction is critical for safe and efficient autonomous driving, especially in mixed traffic environments when both human-driven and autonomous vehicles co-exist. However, uncertainties introduced by inherent…

Machine Learning · Computer Science 2025-08-15 Chandra Raskoti , Iftekharul Islam , Xuan Wang , Weizi Li

Predicting pedestrian behavior is the key to ensure safety and reliability of autonomous vehicles. While deep learning methods have been promising by learning from annotated video frame sequences, they often fail to fully grasp the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Jia Huang , Peng Jiang , Alvika Gautam , Srikanth Saripalli

Predicting driver intentions is a difficult and crucial task for advanced driver assistance systems. Traditional confidence measures on predictions often ignore the way predicted trajectories affect downstream decisions for safe driving. In…

Multi-agent trajectory prediction is crucial for autonomous systems operating in dense, interactive environments. Existing methods often fail to jointly capture agents' long-term goals and their fine-grained social interactions, which leads…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Stephane Da Silva Martins , Emanuel Aldea , Sylvie Le Hégarat-Mascle

Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Accurately forecasting crowd trajectories is challenging due to the uncertain nature of human motions in different…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Yu Liu , Yuexin Zhang , Kunming Li , Yongliang Qiao , Stewart Worrall , You-Fu Li , He Kong