English
Related papers

Related papers: KEMP: Keyframe-Based Hierarchical End-to-End Deep …

200 papers

We present CoverNet, a new method for multimodal, probabilistic trajectory prediction for urban driving. Previous work has employed a variety of methods, including multimodal regression, occupancy maps, and 1-step stochastic policies. We…

Machine Learning · Computer Science 2020-04-03 Tung Phan-Minh , Elena Corina Grigore , Freddy A. Boulton , Oscar Beijbom , Eric M. Wolff

Existing Vision-Language models (VLMs) estimate either long-term trajectory waypoints or a set of control actions as a reactive solution for closed-loop planning based on their rich scene comprehension. However, these estimations are coarse…

Robotics · Computer Science 2024-04-01 Pranjal Paul , Anant Garg , Tushar Choudhary , Arun Kumar Singh , K. Madhava Krishna

Predicting the future behavior of moving agents is essential for real world applications. It is challenging as the intent of the agent and the corresponding behavior is unknown and intrinsically multimodal. Our key insight is that for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Hang Zhao , Jiyang Gao , Tian Lan , Chen Sun , Benjamin Sapp , Balakrishnan Varadarajan , Yue Shen , Yi Shen , Yuning Chai , Cordelia Schmid , Congcong Li , Dragomir Anguelov

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

Predicting traffic conditions has been recently explored as a way to relieve traffic congestion. Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they…

Artificial Intelligence · Computer Science 2023-08-22 Xingyi Cheng , Ruiqing Zhang , Jie Zhou , Wei Xu

Estimating the joint distribution of on-road agents' future trajectories is essential for autonomous driving. In this technical report, we propose a next-generation framework for joint multi-agent trajectory prediction called QCNeXt. First,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Zikang Zhou , Zihao Wen , Jianping Wang , Yung-Hui Li , Yu-Kai Huang

With the unprecedented shift towards automated urban environments in recent years, a new paradigm is required to study pedestrian behaviour. Studying pedestrian behaviour in futuristic scenarios requires modern data sources that consider…

Human-Computer Interaction · Computer Science 2021-11-11 Arash Kalatian , Bilal Farooq

While trajectory prediction plays a critical role in enabling safe and effective path-planning in automated vehicles, standardized practices for evaluating such models remain underdeveloped. Recent efforts have aimed to unify dataset…

Machine Learning · Computer Science 2025-09-19 Julian F. Schumann , Anna Mészáros , Jens Kober , Arkady Zgonnikov

Accurate prediction of surrounding road users' trajectories is essential for safe and efficient autonomous driving. While deep learning models have improved performance, challenges remain in preventing off-road predictions and ensuring…

We present a new method for multi-modal, long-term vehicle trajectory prediction. Our approach relies on using lane centerlines captured in rich maps of the environment to generate a set of proposed goal paths for each vehicle. Using these…

Machine Learning · Computer Science 2020-11-17 Lingyao Zhang , Po-Hsun Su , Jerrick Hoang , Galen Clark Haynes , Micol Marchetti-Bowick

We consider the challenging problem of high speed autonomous racing in a realistic Formula One environment. DeepRacing is a novel end-to-end framework, and a virtual testbed for training and evaluating algorithms for autonomous racing. The…

Robotics · Computer Science 2020-05-12 Trent Weiss , Madhur Behl

Given their flexibility and encouraging performance, deep-learning models are becoming standard for motion prediction in autonomous driving. However, with great flexibility comes a lack of interpretability and possible violations of…

Robotics · Computer Science 2023-04-25 Theodor Westny , Joel Oskarsson , Björn Olofsson , Erik Frisk

Predicting the future motion of road participants is crucial for autonomous driving but is extremely challenging due to staggering motion uncertainty. Recently, most motion forecasting methods resort to the goal-based strategy, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Mingkun Wang , Xinge Zhu , Changqian Yu , Wei Li , Yuexin Ma , Ruochun Jin , Xiaoguang Ren , Dongchun Ren , Mingxu Wang , Wenjing Yang

End-to-end data-driven machine learning methods often have exuberant requirements in terms of quality and quantity of training data which are often impractical to fulfill in real-world applications. This is specifically true in time series…

Machine Learning · Computer Science 2022-02-17 Muhammad Ali Chattha , Ludger van Elst , Muhammad Imran Malik , Andreas Dengel , Sheraz Ahmed

As an essential task in autonomous driving (AD), motion prediction aims to predict the future states of surround objects for navigation. One natural solution is to estimate the position of other agents in a step-by-step manner where each…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Xiaosong Jia , Shaoshuai Shi , Zijun Chen , Li Jiang , Wenlong Liao , Tao He , Junchi Yan

Predicting the future trajectories of pedestrians on the road is an important task for autonomous driving. The pedestrian trajectory prediction is affected by scene paths, pedestrian's intentions and decision-making, which is a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Amar Fadillah , Ching-Lin Lee , Zhi-Xuan Wang , Kuan-Ting Lai

Displaying near-real-time traffic information is a useful feature of digital navigation maps. However, most commercial providers rely on privacy-compromising measures such as deriving location information from cellphones to estimate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Piyush Yadav , Dipto Sarkar , Dhaval Salwala , Edward Curry

Accurate and robust trajectory prediction of neighboring agents is critical for autonomous vehicles traversing in complex scenes. Most methods proposed in recent years are deep learning-based due to their strength in encoding complex…

Robotics · Computer Science 2023-03-27 Yujun Jiao , Mingze Miao , Zhishuai Yin , Chunyuan Lei , Xu Zhu , Linzhen Nie , Bo Tao

We address the decision-making capability within an end-to-end planning framework that focuses on motion prediction, decision-making, and trajectory planning. Specifically, we formulate decision-making and trajectory planning as a…

Robotics · Computer Science 2024-12-03 Wenru Liu , Yongkang Song , Chengzhen Meng , Zhiyu Huang , Haochen Liu , Chen Lv , Jun Ma

Predicting ego vehicle trajectories remains a critical challenge, especially in urban and dense areas due to the unpredictable behaviours of other vehicles and pedestrians. Multimodal trajectory prediction enhances decision-making by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Sushil Sharma , Arindam Das , Ganesh Sistu , Mark Halton , Ciarán Eising